-
Notifications
You must be signed in to change notification settings - Fork 5.9k
[Cherry-pick] add rms_norm and fix large tensor #77265
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: release/3.3
Are you sure you want to change the base?
[Cherry-pick] add rms_norm and fix large tensor #77265
Conversation
* mv fastln to ln * fix build error on win and hip * fix build error for infer * support backward * fix error * merge fast_rms_norm and fused_rms_norm_ext to rms_norm * fix CMake error * remove windows version * add rms_norm for xpu * fix cmake * fix cmake2 * fix test_rms_norm * rms_norm align torch * fix test_rms_norm_xpu * remove fast_rms_norm in rms_norm * rename rms_norm_nzs to rms_norm * fix * fix RmsNormInferMeta * mv fused_rms_norm_quant form ops.yaml to fused_ops.yaml * revert mv fused_rms_norm_quant form ops.yaml to fused_ops.yaml * fix rms_norm docs * fix doctest * fix doctest * fix test_rms_norm * fix test cmakefile * fix test_rms_norm * add InferSymbolicShapeInterface * add check_pir --------- Co-authored-by: DanielSun11 <[email protected]>
…rors (PaddlePaddle#77183) * update * update 2
…addlePaddle#77149) * fix * align lerp to torch * fix cpu * fix ce
…#77098) * accuracy and Torch alignment * support rms_norm behavior to be the same as torch * fix rms_norm_xpu_kernel * add valueError_test * Revert "add valueError_test" This reverts commit ccaaa1b. * Reapply "add valueError_test" This reverts commit 19513e8. * optimize performance * add vectorization * fix * fix dtype of normalized_shape
|
你的PR提交成功,感谢你对开源项目的贡献! |
Codecov Report❌ Patch coverage is ❌ Your patch status has failed because the patch coverage (80.42%) is below the target coverage (90.00%). You can increase the patch coverage or adjust the target coverage. Additional details and impacted files@@ Coverage Diff @@
## release/3.3 #77265 +/- ##
==============================================
Coverage ? 80.42%
==============================================
Files ? 14
Lines ? 189
Branches ? 0
==============================================
Hits ? 152
Misses ? 37
Partials ? 0 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
wanghuancoder
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
|
dev也豁免合入,代码风格修改居多 |
PR Category
Operator Mechanism
PR Types
Bug fixes
Description
Cherry-pick from develop branch.
devPR:#76930
devPR:#77154
devPR:#77183
devPR:#77149
devPR:#77098
devPR:#77191
devPR:#77244
pcard-93269