v20251115-002502
·
74 commits
to main
since this release
Add Helion Regression Config (#7473) #Overview Add regression report for helion # frequency the summary report is generated daily # what is considered as regression for helion 1. we find baseline point used to judge new data: median of (4th - 8th day speedup data) 2. if more than 2 new dp of helion speedup are continuously 15% lower than the basline value, considered as regression ## Demo Regression Report https://torchci-git-addhelionregressionreport-fbopensource.vercel.app/benchmark/regression/report/ada0e5ba-874b-47ff-b76c-b281ac08d179 <img width="741" height="851" alt="image" src="https://github.com/user-attachments/assets/abcde75b-f34d-49d1-9c23-0544ac38ba37" /> ## Notification Currently we do not trigger workplace chat notification, this is experimental. But we do: 1. have a github issue that will be used to accept regression report as link, can be used for notification when it's ready 2. have helion dashboard to access to the regression report list, and signal regression if find any https://github.com/pytorch/test-infra/issues/7472