Skip to content

fix(analytics): DATA-13528 Upgrade BigAI Copywriter model#78

Merged
bc-facundo-yuffrida merged 1 commit into
mainfrom
DATA-13528
Jun 5, 2026
Merged

fix(analytics): DATA-13528 Upgrade BigAI Copywriter model#78
bc-facundo-yuffrida merged 1 commit into
mainfrom
DATA-13528

Conversation

@bc-facundo-yuffrida

@bc-facundo-yuffrida bc-facundo-yuffrida commented Jun 5, 2026

Copy link
Copy Markdown
Contributor

Jira: DATA-13528

What/Why?

Upgrade BigAI Copywriter model from gemini-2.0-flash to gemini-2.5-flash-lite because it's been retired on June 1st.
Google recommends upgrade to gemini-3.1-flash-lite although a Claude analysis recommends better gemini-2.5-flash-lite based on:

  1. It is Generally Available on Vertex AI. It is a stable, production GA model with a normal SLA. By contrast, gemini-3.1-flash-lite is currently in preview on Vertex. Preview models have no production SLA, can change behavior, and can be retired with shorter notice, which is exactly the failure class we are fixing right now. We should not introduce a preview model into a merchant-facing flow as a same-day hotfix.
  2. It is a drop-in change. It uses the same Vertex AI SDK and the same us-central1 region already configured in the app. The fix is a single line (the MODEL_NAME constant). Preview 3.x models are typically served only through the global endpoint, so moving to gemini-3.1-flash-lite could also require changing the location, adding risk to a fast fix.
  3. It lowers cost. Per 1M tokens on Vertex AI standard pricing:
      - gemini-2.0-flash (retired): $0.15 input / $0.60 output
      - gemini-2.5-flash-lite: $0.10 input / $0.40 output (about 33% cheaper on both input and output)
      - gemini-3.1-flash-lite: $0.25 input / $1.50 output (more expensive than the retired model: +67% input, +150% output)

Rollout/Rollback

Revert.

Testing

  • Generate successfully a description text for a product using BigAI Copywriter.

@bigcommerce/team-data

@bc-facundo-yuffrida bc-facundo-yuffrida self-assigned this Jun 5, 2026
@bc-facundo-yuffrida
bc-facundo-yuffrida requested a review from a team as a code owner June 5, 2026 15:14
@vercel

vercel Bot commented Jun 5, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
ai-app-foundation Ready Ready Preview, Comment Jun 5, 2026 3:14pm

Request Review

@bc-facundo-yuffrida
bc-facundo-yuffrida merged commit 2147468 into main Jun 5, 2026
10 checks passed
@bc-facundo-yuffrida
bc-facundo-yuffrida deleted the DATA-13528 branch June 5, 2026 15:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants