Skip to content

[Cherry-Pick][RMSNorm] remove invvar from rms_norm Python API return value#78608

Merged
sneaxiy merged 2 commits intoPaddlePaddle:release/3.3from
DanielSun11:cp_rms_norm
Apr 9, 2026
Merged

[Cherry-Pick][RMSNorm] remove invvar from rms_norm Python API return value#78608
sneaxiy merged 2 commits intoPaddlePaddle:release/3.3from
DanielSun11:cp_rms_norm

Conversation

@DanielSun11
Copy link
Copy Markdown
Contributor

PR Category

Operator Mechanism

PR Types

Improvements

Description

devPR:#78438

是否引起精度变化

DanielSun11 and others added 2 commits April 8, 2026 16:10
…Paddle#78438)

* [RMSNorm] remove invvar from rms_norm Python API return value and update default eps

- rms_norm now returns only `out` (Tensor) instead of `(out, invvar)` tuple
- Updated return type annotation from `tuple[Tensor, Tensor]` to `Tensor`
- Changed default eps from 1e-5 to 0.0 in both norm.py and ops.yaml
- Updated unit tests: rms_norm_wrapper now calls _C_ops directly to preserve
  op-level invvar output for OpTest framework; removed invvar assertion in TestRMSNormAPI

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* default eps is none

* fix ut

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
@paddle-bot
Copy link
Copy Markdown

paddle-bot bot commented Apr 8, 2026

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@DanielSun11 DanielSun11 changed the title Cp rms norm [Cherry-Pick][RMSNorm] remove invvar from rms_norm Python API return value Apr 8, 2026
@codecov-commenter
Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (release/3.3@2b08ed9). Learn more about missing BASE report.

Additional details and impacted files
@@               Coverage Diff               @@
##             release/3.3    #78608   +/-   ##
===============================================
  Coverage               ?   100.00%           
===============================================
  Files                  ?         1           
  Lines                  ?         6           
  Branches               ?         0           
===============================================
  Hits                   ?         6           
  Misses                 ?         0           
  Partials               ?         0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Copy Markdown
Contributor

@wanghuancoder wanghuancoder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@sneaxiy sneaxiy merged commit 2525e23 into PaddlePaddle:release/3.3 Apr 9, 2026
158 of 179 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants