Skip to content

chore: DATA-12702 Update gemini model#70

Merged
bc-rmalyavc merged 1 commit into
mainfrom
DATA-12702
Sep 1, 2025
Merged

chore: DATA-12702 Update gemini model#70
bc-rmalyavc merged 1 commit into
mainfrom
DATA-12702

Conversation

@bc-rmalyavc

@bc-rmalyavc bc-rmalyavc commented Sep 1, 2025

Copy link
Copy Markdown
Contributor

Jira: DATA-12702

What/Why?

  • Upgrade gemini model version to gemini-2.0-flash
  • Include Jira token into PR template

Rollout/Rollback

Merge/revert

Testing

Tested on preview environment. Deployed the changes to preview env and pointed a draft app to the preview domain. Reinstalled the app on a sandbox store and verified that the descriptions are being generated without throwing errors

Screen.Recording.2025-09-01.at.14.48.29.mov

Performed the same steps on the live app once the change was deployed. In addition measured the request time before an after. The new model shows ~twice better performance

Before

Screen.Recording.2025-09-01.at.14.55.39.mov

After

Screen.Recording.2025-09-01.at.14.59.46.mov

@bigcommerce/team-data

@bc-rmalyavc
bc-rmalyavc requested a review from a team as a code owner September 1, 2025 11:28
@vercel

vercel Bot commented Sep 1, 2025

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
ai-app-foundation Ready Ready Preview Comment Sep 1, 2025 11:53am

@solofeed solofeed left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide Before/After examples with latency
I expect better performance

@bc-rmalyavc
bc-rmalyavc merged commit 963b748 into main Sep 1, 2025
2 of 3 checks passed
@bc-rmalyavc

Copy link
Copy Markdown
Contributor Author

Please provide Before/After examples with latency I expect better performance

Indeed! Executed the exact request 4 times for each version. With the previous version the request took 5.58 - 6.43 seconds. With the new version the range is 2.81 - 3.35 seconds. Attaching the recordings to the description.

@solofeed
solofeed deleted the DATA-12702 branch September 1, 2025 17:09
@bc-rmalyavc
bc-rmalyavc restored the DATA-12702 branch September 11, 2025 11:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants