Skip to content

v20260128-210015

Choose a tag to compare

@github-actions github-actions released this 28 Jan 21:02
· 35 commits to main since this release
165c8ed
set up PT x vLLM regression config (#7684)

Summary:
As title, this should connect regressions to the newly created GH issue.
Using 1.20 and 0.8 as thresholds.

Test Plan:
Local run with the following:
```
python aws/lambda/benchmark_regression_summary_report/lambda_function.py --clickhouse-endpoint ${CLICKHOUSE_ENDPOINT} --clickhouse-username ${DEV_USERNAME} --clickhouse-password ${CLICKHOUSE_PASSWORD} --config-id pytorch_x_vllm_benchmark
```
Ran both yesterday and today, and run today was sufficient to trigger
thresholds for regressions, so 20% seems appropriate here.

Reviewers:

Subscribers:

Tasks:

Tags: