Skip to content

Conversation

jimniels
Copy link
Collaborator

@jimniels jimniels commented Sep 30, 2025

Relevant issue(s)

[insert link(s) here]

Description

Add an experiment that gives different users different AI limits and track (long-term) which number helps conversion best.

Implementation details

  • Track on a team-by-team basis (so all users in team are in the same experiment)
  • Use a one-way hashing function based on team UUID to get their value
    • See example in this sheet
    • This will have to live in our shared folder, as we need the function on the server and client to calculate their bucket
  • Log the experiment value in mixpanel using mixpanel.register_once
    • Leep track in localStorage if we've bucketed them already, in which case skip this step
    • Event name: experiment.aiMsgLimit.{{teamUuid}}
    • Event value: a number between 1 and 30
  • Turn on a dev flag that will log what your limit number is

To Test

  • Create a few different teams
  • Turn on the dev flag for this feature
  • Ensure the limits are different for each team

Copy link

qa-wolf bot commented Sep 30, 2025

QA Wolf here! As you write new code it's important that your test coverage is keeping up.
Click here to request test coverage for this PR!

@cla-bot cla-bot bot added the cla-signed label Sep 30, 2025
Copy link
Contributor

github-actions bot commented Sep 30, 2025

Preview - Build, Deploy & Tests-E2E

✅ Build images
✅ Deploy images - Sep 30, 2025 at 05:17 PM UTC - Preview
✅ Tests-E2E - Report

Copy link

codecov bot commented Sep 30, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 89.76%. Comparing base (2160fa8) to head (552ceed).

Additional details and impacted files
@@           Coverage Diff           @@
##               qa    #3491   +/-   ##
=======================================
  Coverage   89.76%   89.76%           
=======================================
  Files         437      437           
  Lines       90097    90097           
=======================================
  Hits        80873    80873           
  Misses       9224     9224           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant