Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AutoConfig]Add multi prune #60954

Merged
merged 8 commits into from
Feb 2, 2024
Merged

Conversation

Difers
Copy link
Contributor

@Difers Difers commented Jan 18, 2024

PR types

New features

PR changes

Others

Description

PCard-80218
This feature aims to enhance the search performance of the Autotuner.
The main idea is to introduce "pruned_cfgs" in the search class to record historical pruning information. This assists the Autotuner in making multi-dimensional pruning decisions during the search process, optimizing the search space and improving the overall speed.

experimental results

model cluster GBS before acceleration after acceleration
LLaMA2-7B V100 32G*8 16 12h 4.8h

Copy link

paddle-bot bot commented Jan 18, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

Copy link

paddle-ci-bot bot commented Jan 26, 2024

Sorry to inform you that 07e9f14's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.

@Caozhou1995 Caozhou1995 merged commit 8c7f8eb into PaddlePaddle:develop Feb 2, 2024
32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants