Skip to content

Update Llama70b 6U tsu range#23112

Merged
djordje-tt merged 1 commit intomainfrom
divanovic/update_6u_full_demo_targets
Jun 6, 2025
Merged

Update Llama70b 6U tsu range#23112
djordje-tt merged 1 commit intomainfrom
divanovic/update_6u_full_demo_targets

Conversation

@djordje-tt
Copy link
Contributor

@djordje-tt djordje-tt commented Jun 5, 2025

Update tsu range to relevant since lot of improvements went in

Problem description

Llama70b on 6U full demo was not executing often and tsu range is out of date

What's changed

tsu range [49,53] -> [53,58] due to lot if improvements in the meantime

Checklist

Update tsu range to relevant since lot of improvements went in
@barci2
Copy link
Contributor

barci2 commented Jun 5, 2025

The perf sometimes goes up to 58.1 tps, I'd change the max perf to be 59, based on the recent demo regression CI run

@djordje-tt djordje-tt added this pull request to the merge queue Jun 6, 2025
Merged via the queue into main with commit 3c78ec4 Jun 6, 2025
45 checks passed
@djordje-tt djordje-tt deleted the divanovic/update_6u_full_demo_targets branch June 6, 2025 10:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants