Releases: pytorch/test-infra
Releases · pytorch/test-infra
v20251124-174744
Add Hud x-token in lambda (#7511) Add token in pytorch-lab/pytorch now, modify code to access it
v20251122-001153
Make lambda pass the bot managment (#7509) learned from the job_utilization attacker lol, this is a way to allow me to call the hud api in lambda
v20251121-205947
change monitor days for torch ao regression report (#7506)
v20251118-232015
Fix compiler bug (#7482) 1. fix compiler name bug for geomean, it should be geomean_speedup 2. filter export for all other aggregated metrics except passrate https://torchci-git-fixcompilerbug-fbopensource.vercel.app/benchmark/compilers_regression 3. render missing data with light grey if it's enabled
v20251118-202854
Update flake8 deps (#7485) - And `ruff==0.14.4` + other dependencies as well To match https://github.com/pytorch/pytorch/blob/d1f6dd61055a71ec2072dc0d006e9f12d8e23501/.lintrunner.toml#L44 This avoids env trashing when one is switching between `pytorch` and `test-infra` Fix lint issues detected by newer versions of the tools
v20251118-025300
Regression Micro Benchmark and Torchao (#7478) add regression config
v20251115-002502
Add Helion Regression Config (#7473) #Overview Add regression report for helion # frequency the summary report is generated daily # what is considered as regression for helion 1. we find baseline point used to judge new data: median of (4th - 8th day speedup data) 2. if more than 2 new dp of helion speedup are continuously 15% lower than the basline value, considered as regression ## Demo Regression Report https://torchci-git-addhelionregressionreport-fbopensource.vercel.app/benchmark/regression/report/ada0e5ba-874b-47ff-b76c-b281ac08d179 <img width="741" height="851" alt="image" src="https://github.com/user-attachments/assets/abcde75b-f34d-49d1-9c23-0544ac38ba37" /> ## Notification Currently we do not trigger workplace chat notification, this is experimental. But we do: 1. have a github issue that will be used to accept regression report as link, can be used for notification when it's ready 2. have helion dashboard to access to the regression report list, and signal regression if find any https://github.com/pytorch/test-infra/issues/7472
v20251112-220849
[Add notification for Pytorch Operator Microbenchmark (#7447) ## Overview Add notification for pytorch operator microbenchmark Add median option as option to choose the median value as baseline the data visualization example; https://hud.pytorch.org/benchmark/regression/report/acfae3e8-7680-403b-a234-79e5c194f4c0 ## Bug Fix 1. [Notification] return skip when timeseries from api resp is empty list, not the class object 2. [API] fix the emptyTimeseriesResponse to match the response format with the data one ## Next step Add search filter for regression report
v20251105-232748
[autorevert] use 'tests.all_test_runs' instead of 'default.test_run_s…
v20251105-183009
[autorevert] combine test outcomes across shards, prioritizing failur…