-
Notifications
You must be signed in to change notification settings - Fork 1.5k
refs #12358 - CI-unixish.yml: added step which checks for AST and ValueFlow changes #7800
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
53bbd97
to
d03a4c5
Compare
Since |
d03a4c5
to
4e0fe3e
Compare
4e0fe3e
to
b7514bd
Compare
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I spontanously don't have a good feeling about this. such golden files are not easy to maintain. so if we fix various tokenizer, ast and valueflow problems we will potentially have to update the golden file even though nothing is wrong. We will not spot problems that exist in such big data.
Write tests that check if we do the right thing and don't need constant maintenance..
I understand that but we need something like this. The test coverage is not enough and this makes e.f. ValueFlow optimization work safer. I had several cases where the output didn't change but it is was actually totally wrong. We need to catch such things before going in daca. And it might not even manifest in there. I chose simplecpp since it is just a single file. So there is no need to manually edit files but just pull the newer version from the CI and overwrite it. I wanted to maintain this externally but that will most certainly bitrot if it is not tied to the build. |
See #7768 (comment) for a case where this found a subtle bug I would have introduced. |
No description provided.