Skip to content

[CINN] Remove the restriction of automatically falling back to SOT after enabling CINN #4411

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: develop
Choose a base branch
from
Open

[CINN] Remove the restriction of automatically falling back to SOT after enabling CINN #4411

wants to merge 4 commits into from
+21 −15

Conversation

DrRyanHuang
Copy link
Contributor

移除开启CINN后自动回退到SOT的限制
cc @SigureMo

@paddle-bot Paddle-bot
Copy link

paddle-bot bot commented Oct 14, 2025

Thanks for your contribution!

@DrRyanHuang DrRyanHuang changed the title [CINN] Remove CINN limitation [CINN] Remove the restriction of automatically falling back to SOT after enabling CINN Oct 14, 2025
@DrRyanHuang DrRyanHuang requested a review from SigureMo October 16, 2025 12:48
DrRyanHuang
DrRyanHuang commented Oct 16, 2025
View reviewed changes
tests/graph_optimization/test_graph_opt_backend.py
atol=1e-6, # for CINN
)

paddle.jit.sot.opcode_translator.executor.executor_cache.OpcodeExecutorCache().clear()
Copy link
Contributor Author

@DrRyanHuang DrRyanHuang Oct 16, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#4378 合入后，SOT动转静会更加严格

由于创建模型时 fd_config 参数发生了变化，所以会产生两个 code 导致异常抛出

test_model = Attention(fd_config=fd_config, **self.model_config)

所以这里手动清除一下 Cache
cc @SigureMo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@SigureMo SigureMo Awaiting requested review from SigureMo

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@DrRyanHuang @SigureMo