Skip to content

gpt-oss-20b#880

Open
ddilbazTT wants to merge 5 commits intomainfrom
ddilbaz/new_gpt_oss_20b
Open

gpt-oss-20b#880
ddilbazTT wants to merge 5 commits intomainfrom
ddilbaz/new_gpt_oss_20b

Conversation

@ddilbazTT
Copy link
Contributor

@ddilbazTT ddilbazTT commented Feb 6, 2026

Adding gpt-oss-20b tp benchmark test to tt-forge. Several notes about gpt-oss-20b:

@ddilbazTT
Copy link
Contributor Author

I'll attach the logs from 2x4 and 1x8 meshes
gpt_oss_20b_tp_1x8.log
gpt_oss_20b_tp_2x4.log

Copy link
Collaborator

@odjuricicTT odjuricicTT left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome! Thanks for adding!

Requesting changes because of default optimization level.

@ddilbazTT ddilbazTT force-pushed the ddilbaz/new_gpt_oss_20b branch 2 times, most recently from 12d0c86 to 728a94c Compare February 10, 2026 16:43
@ddilbazTT ddilbazTT force-pushed the ddilbaz/new_gpt_oss_20b branch from 728a94c to 1c9e1e6 Compare February 10, 2026 16:44
@ddilbazTT ddilbazTT force-pushed the ddilbaz/new_gpt_oss_20b branch from 1c9e1e6 to cdb4a5f Compare February 10, 2026 16:54
Comment on lines 174 to 175
batch_size=None,
optimization_level=None,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You should be able to pass batch_size and optimization_level without adding them as explicit arguments here. They will be picked up in **kwargs?

Comment on lines 183 to 186
if batch_size is None:
batch_size = DEFAULT_BATCH_SIZE
if optimization_level is None:
optimization_level = DEFAULT_OPTIMIZATION_LEVEL
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not needed is removed from function signature.

@ddilbazTT ddilbazTT force-pushed the ddilbaz/new_gpt_oss_20b branch from c87efef to 5f20110 Compare February 11, 2026 11:41
@ddilbazTT ddilbazTT force-pushed the ddilbaz/new_gpt_oss_20b branch from 5f20110 to cdc5018 Compare February 11, 2026 11:43
@ddilbazTT
Copy link
Contributor Author

@odjuricicTT https://github.com/tenstorrent/tt-forge/actions/runs/21906541734/job/63248243625 Here is the test I added running for reference.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants