Skip to content

Releases: pytorch/test-infra

v20251124-174744

24 Nov 17:49
02e8644

Choose a tag to compare

Add Hud x-token in lambda (#7511)

Add token in pytorch-lab/pytorch now, modify code to access it

v20251122-001153

22 Nov 00:13
0f66519

Choose a tag to compare

Make lambda pass the bot managment (#7509)

learned from the job_utilization attacker lol, this is a way to allow me
to call the hud api in lambda

v20251121-205947

21 Nov 21:01
df117bf

Choose a tag to compare

change monitor days for torch ao regression report (#7506)

v20251118-232015

18 Nov 23:21
a64c479

Choose a tag to compare

Fix compiler bug (#7482)

1. fix compiler name bug for geomean, it should be geomean_speedup
2. filter export for all other aggregated metrics except passrate

https://torchci-git-fixcompilerbug-fbopensource.vercel.app/benchmark/compilers_regression
3. render missing data with light grey if it's enabled

v20251118-202854

18 Nov 20:30
89981f3

Choose a tag to compare

Update flake8 deps (#7485)

- And `ruff==0.14.4` + other dependencies as well
To match
https://github.com/pytorch/pytorch/blob/d1f6dd61055a71ec2072dc0d006e9f12d8e23501/.lintrunner.toml#L44
This avoids env trashing when one is switching between `pytorch` and
`test-infra`


Fix lint issues detected by newer versions of the tools

v20251118-025300

18 Nov 02:54
4b41c2b

Choose a tag to compare

Regression Micro Benchmark and Torchao (#7478)

add regression config

v20251115-002502

15 Nov 00:26
39523dd

Choose a tag to compare

Add Helion Regression Config (#7473)

#Overview
Add regression report for helion

# frequency
the summary report is generated daily

# what is considered as regression for helion
1. we find baseline point used to judge new data: median of (4th - 8th
day speedup data)
2. if more than 2 new dp of helion speedup are continuously 15% lower
than the basline value, considered as regression


## Demo Regression Report


https://torchci-git-addhelionregressionreport-fbopensource.vercel.app/benchmark/regression/report/ada0e5ba-874b-47ff-b76c-b281ac08d179

<img width="741" height="851" alt="image"
src="https://github.com/user-attachments/assets/abcde75b-f34d-49d1-9c23-0544ac38ba37"
/>


## Notification
Currently we do not trigger workplace chat notification, this is
experimental.
But we do:
1. have a github issue that will be used to accept regression report as
link, can be used for notification when it's ready
2. have helion dashboard to access to the regression report list, and
signal regression if find any

https://github.com/pytorch/test-infra/issues/7472

v20251112-220849

12 Nov 22:10
9571290

Choose a tag to compare

[Add notification for Pytorch Operator Microbenchmark (#7447)

## Overview
Add notification for pytorch  operator microbenchmark
Add median option as option to choose the median value as baseline

the data visualization example;

https://hud.pytorch.org/benchmark/regression/report/acfae3e8-7680-403b-a234-79e5c194f4c0

## Bug Fix
1. [Notification] return skip when timeseries from api resp is empty
list, not the class object
2. [API] fix the emptyTimeseriesResponse to match the response format
with the data one

## Next step
Add search filter for regression report

v20251105-232748

05 Nov 23:29
bc5f540

Choose a tag to compare

[autorevert] use 'tests.all_test_runs' instead of 'default.test_run_s…

v20251105-183009

05 Nov 18:32
0021389

Choose a tag to compare

[autorevert] combine test outcomes across shards, prioritizing failur…