Sprint - Mar 10 - Mar 21

[ioannisj]

Sprint Planning

List of incidents + any action items that haven't been scheduled yet

Team sprint planning

For your team sprint planning copy this template into a comment below for each team.

# Team ___

**Support hero:** ___

## OKR

1. OKR, status (red/yellow/green) and action points if yellow/red

## Retro

<!-- Grab the high and low priority items from last time and add whether that item was completed or not -->
- 

### High priority

-

### Low priority / side quests

-

[ioannisj]

Team Surveys

• Support hero: @lucasheriques and @ioannisj
• 2 PTO - Mar 14-17 @marandaneto

🟢=finished 🟡=in progress 🔴=won't finish ⚪=not started

Retro

Retro - Team Notes

• Feeling grateful! ❤️ - @ioannisj
• Feels like SDK issues keep surfacing making it hard for me to stay focused on high-priority tasks. Need to block out some days of the week for deep high-priority work @ioannisj
• Made an effort to be more active and engaged in PRs but there's still room for improvement @ioannisj
• iOS multiple SDK instances is finally out @ioannisj
• PR reviews have been really helpful to make sure we're covering all changes @lucasheriques

Retro - Tasks

High priority

• 🟢 RN surveys - address all edge cases and release the 1st alpha @marandaneto
  • 🟢 add documentation with samples and limitations
  • ⚪ start with android or flutter if time allows
  • 🟢 add a toggle on the SDK so it is enabled SDK side as well
  • ⚪ lets wait for behavioral cohorts until we address the issue of surveys being shown on mobile | web -> send an email and let them know about device type config
• 🟡 Close these iOS crashes @ioannisj
  • 🟢 Crash in PostHogSessionManager.swift posthog-ios#302
  • 🟡 Crash in UIView+Util.swift posthog-ios#303 - Got some stack traces back but didn't help much. Waiting for more input from the user
• 🟢 Focus on iOS survey @ioannisj
  • finish display logic
  • start working on the UI
• 🟡 Surveys: partial responses @lucasheriques
  • some work has been done, need to see what's missing to fix it
  • see how this is charged, check usage report and survey response events
• 🟢 Have at least one customer call scheduled @lucasheriques
• 🟢 🐛 Wrong graph series after changing question order @lucasheriques
  • compute a stable question index in the BE, use that to allow reordering
• 🔴 🐛 Errors on saving a survey form are not displayed @lucasheriques
• 🔴 🐛 Don't calculate NPS score for non-NPS questions @lucasheriques
• 🔴 🐛 Survey feedback widget events can be more accurate @lucasheriques
• 🔴 🐛 Triggering survey doesn't respect condition setted @lucasheriques
• 🟢 Survey Can't Be Positioned Properly @lucasheriques

Low priority / Side quest

• 🟢 Session Replay Mask text forces parent element to mask everything posthog-ios#296 @ioannisj
• 🟡 SwiftUI masked items zindex on top of everything posthog-ios#295 @ioannisj
• 🟡 Check if any pending issues on flutter session replay and go GA (in 2 weeks time) if not @marandaneto
  • I spent quite some time on this issue (memory leak) caused by the GC not running fast enough, not sure if there's an easy fix here.
• ⚪ 🐛 Surveys - Long questions overflow in list of steps @lucasheriques
• ⚪ 🐛 Surveys on mobile web are buggy right now @lucasheriques
  • Looks like there's some community interest in helping out with this
• 🟢 Better positioning for Selector-type surveys

Goals

• 🟡 Improve quality
• 🟡 Mobile Surveys
• 🟡 Talk to customers
• 🟡 Finish up WIP features

High priority

• Presentation of all question types, capture survey events and hopefully get a 1st alpha PR out by the end of the sprint @ioannisj
• Start with either Android or Flutter Surveys (TBC - will check if @ioannisj has a preference) @marandaneto
• Assist @lucasheriques with BE changes, most WIP features are heavy BE changes that will need some thinking (cost, pricing, RFCs...) @marandaneto
• Adaptive sampling for surveys @lucasheriques
• Surveys: partial responses @lucasheriques
• 🐛 Errors on saving a survey form are not displayed @lucasheriques
• 🐛 Triggering survey doesn't respect condition setted @lucasheriques

Low priority / Side quest

• SwiftUI masked items zindex on top of everything posthog-ios#295 @ioannisj
• https://posthog.com/questions/broken-on-m1-pro-mac-after-version-1-0-0
  • Depending on what we hear back from the user
• Stop all integrations like session replay and autocapture on opt-out posthog-ios#280
  • This should be a quick win with recent SDK refactor
• Flutter session recording memory leak @marandaneto
• Survey actions @lucasheriques
• 🐛 Don't calculate NPS score for non-NPS questions @lucasheriques
• Survey feedback widget events can be more accurate @lucasheriques

[MichaelKutsch-ph]

Team infra

Support: @frankh

Retro

High priority

• ✅ ArgoCD improve DX for rollingSync @MichaelKutsch-ph
• ✅ Signed up with DoIt Essentials
• ✅ new notifications for deployments in argo @danielxnj
• ✅ Performance improvement Grafana/Loki
• 🟡Move non-capture steps to Warpstream @frankh - prod-us is tomorrow, huzza!
• 🟡 helping to get dagster up @bciaraldi
• 🟡karpenter upgrade among other upgrades @bciaraldi
• ⚪ (maybe) Move apps to RollingSync @MichaelKutsch-ph
• ⚪ Move last services from posthog chart to new chart (migration, ingestion) @danielxnj
• ⚪ plan central grafana / alerting? (maybe)

Low priority / side quests

• ⚪ move old capture to new capture @MichaelKutsch-ph
• 🔴 Evaluation of Robusta.dev (better alerts, AI and fancy things...) - killed

OKR

1. 🏃 Next level ArgoCD - Continuous Delivery
2. ☁️ 🕸️ Scalable networking
3. 💰 Mr. Bezos, bring down those costs!
4. 🎮 A stable pre-prod environment

High priority

• Move apps to RollingSync @MichaelKutsch-ph
• Migrate asset upload to argo @MichaelKutsch-ph
• Migrate migration job to argo and new chart @danielxnj
• Move non-capture steps to Warpstream on all prods @frankh
• Move ingestion services to argo/new chart @danielxnj
• Rollout new subnets on prod @bciaraldi
• Purchase warpstream from AWS marketplace (cost savings / ppa)
• Check other things to purchase from marketplace (cost savings / ppa)

Low priority / side quests

• plan central grafana / alerting?

✅=finished 🟡=in progress 🔴=won't finish ⚪=not started

[veryayskiy]

Team RePAAy

Support hero: @pauldambra

Retro

• i'll just repeat mine
  • OMG support load -> Support is more or less under control @pauldambra 🚀
  • CI has been horrible @pauldambra - > CI team?
• not convinced we can get through all of our goals given other distractions @annikaschmid
• worried about support and rrweb distractions @veryayskiy

## what we shipped
chunking
a lot from paul :)

High priority

• 👩‍🔬 Goal 2: Churn and retention exploration
  • 🟡 PLAYLIST COUNTERS - can we process all playlists that have filters (Saved filters) once a day so we can say "X new recordings in the last 24 hours" @pauldambra - yes we can ✅
• 🎤 Goal 3: Watch less and get more value making filters better
  • ❌ split saved filters and playlists @veryayskiy (with @pauldambra supporting)
• 💀 Goal 4: Squash distractions @pauldambra
  • 🟡 move E2E tests from Cypress to Playwright - @pauldambra
    • get as much as possible done
    • but also get other folk set up to keep this going

Side quests and lower priority

• 🟡 🎤 Goal 3: Watch less and get more value
  • ❌ link from analytics (particularly funnels) to replay @pauldambra ]
  • ✅ chat with recordings - getting feeback / fixing bugs

OKRs 🟡

1. OKR, status (red/yellow/green) and action points if yellow/red

• ✅ 🚀 Goal 1: Get Alex rocketing
• 🟡 👩‍🔬 Goal 2: Churn and retention exploration
  • talking to users and picking metrics
• 🟡 🎤 Goal 3: Watch less and get more value
  • in the short term, looking at playlists and filters to see what we can get
• 🟡 💀 Goal 4: Squash distractions
  • need support to be less tricky-things-heavy

High priority

• 👩‍🔬 Goal 2: Churn and retention exploration
  • PLAYLIST COUNTERS - roll out to all projects @pauldambra
• 🟡 🎤 Goal 3: Watch less and get more value making filters better
  • Beta "mark similar recordings as watched" @veryayskiy
  • Analize and tweak prompts "chat with recordings" @veryayskiy
• 💀 Goal 4: Squash distractions @pauldambra
  • move E2E tests from Cypress to Playwright - @pauldambra
    • get as much as possible done
    • but also get other folk set up to keep this going

Side quests and lower priority

* split saved filters and playlists @veryayskiy (with @pauldambra  supporting)
* add-on: research store recordings longer paid feature @annikaschmid 
* RN - stop of recordings (we have it in web) @veryayskiy 

what might we do? -> https://posthog.slack.com/archives/C03PB072FMJ/p1739953734791699

[benjackwhite]

Team CDP

• Support: @meikelmosby

Retro

• 🟢 Rollout Logs and Testing tools for retrying failed functions @benjackwhite @MarconLP
• 🟢 Get GeoIP moved to using S3 mounted bucket (makes it more deterministic) @benjackwhite
• 🟡 Return to the purge @benjackwhite
  • Bunch of mini purges done to remove jobs, schedules and old ingestion
• 🟢 Make the Hog Function API public and that the documentation isn't too bad @meikelmosby @benjackwhite
• 🔴 Add legacy plugins comparison logic to validate it is all 1-1 @meikelmosby @benjackwhite
• 🟡 Move over to WS with Infra peeps @benjackwhite
• 🟢 GET requests for prop defs go via API and not the DB @eli-r-ph
• 🟡 Focus on finishing integrations @MarconLP
  • 🟢 Google ads work (nested accounts)
  • 🟡 Slack app submission finalised
  • 🟢 Release Reddit / snapchat with warning about rate limit
  • 🔴 TikTok
  • 🟢 Intercom
• 🔴 Move existing templates to Nodejs @MarconLP
• 🟡 Feature parity with Blobby v1 @pl
  • Get Team 2 reading from Blobby v2
  • Parity with Blobby v1 for events tables
  • Comparison testing to ensure all end data is the same as before
  • Realtime polling from client for S3 data

Out-of-plan

• Pivot to investigating missing prop defs @eli-r-ph
• Issues with slack channel loading

Discussion

OKRs

• 😍 People choose us for their CDP first 🟡
• 🖕 Plugins be gone 🟢
• 🚀 Warpstream for events 🟢
• 🎈 Write-optimized session replay ingestion 🟢
• 💪 We make changes and improvements to the Node services with confidence 🟢

High priority

• Add legacy plugins comparison logic to validate it is all 1-1 so we can move off of @benjackwhite
• Migrate all existing Zapier hooks to hog functions @benjackwhite
• Release Hog based transformations @meikelmosby
  • Load test the hog function based transforms to ensure it is release ready
  • Work with docs team to get transforms and destinations good for release
• Try to hook up Segment destinations to PostHog @MarconLP
• TikTok Ads destination @MarconLP
• Fix the Slack integration channel selection widget @pl
• Feature parity with Blobby v1 @pl
  • Get Team 2 reading from Blobby v2
  • Parity with Blobby v1 for events tables
  • Comparison testing to ensure all end data is the same as before
  • Realtime polling from client for S3 data
• Improve metrics and reliability of prop-defs ingestion @eli-r-ph
  • Goal would be that we can verify for any event if the properties were written or not and why
  • Get the node based comparison service up and running @benjackwhite
• Get prop-defs api working and used via django @eli-r-ph

Low priority

• Playwright tests for creating, modifying hog functions (would have caught a bunch of bugs this week)
• Add RBAC to Hog Functions? @PostHog/team-cdp
• Move existing templates to Nodejs @MarconLP

[mariusandra]

Team DevEx

OKR

• 🟡 Build a framework where we can have 50+ products? @mariusandra
  • 🟡 Defining and splitting the common layer from the rest of the apps
  • 🟡 Defining and implementing boundaries between apps
  • 🟡 UX changes to support the new structure
  • ⚪ Every product is able to export operations (backend) and widgets (components) => AI, notebooks etc.
  • 🟡 Testing independently - if you change things on one product, we only run tests for that product
• 🟡 Levelling up our product quality. @adamleithp
  • Design system that is self documenting
  • Mobile support
  • Finally figure out (explain) modals vs drawers
  • More standardised components
• 🟢 Anti-goal for Q1: @corywatilo
  • Fixing CI when it randomly breaks (each team owns their tests)
  • Rewrite everything
  • Implement everything ourselves

Retro

• Cory
  • Fine tune the new layout / sidebar
    • Waiting for implementation
• Adam
  • Implement the new layout's frontend (design & interactions, dnd, etc)
    • Progress with tree view, more changes to come
• Marius
  • Implement the new layout's backend (file tree backend persistence, new node sync)
    • Mostly there, still missing pagination
  • Make our tests not suck
    • Tests still suck

High priority

This is for the ongoing week and the next one

• Marius
  • Get the project tree feature complete and into testing with some real users.
• Adam
  • Implement the new layout
• Cory
  • Continuous feedback and iteration

Low priority / side quests

• Marius
  • Continuous Hog/QL support
• Adam
  • Tailwind v4 upgrade

[timgl]

Team ClickHog

Objective

Goals for Q1:

• Query Scheduling Service
  • Paid API use case is covered
  • We should have all queries running through this
  • Basic load shedding
  • Differentiate API queries based on $
• Iceberg continuation
  • Keep on top of Altinity builds for CH
  • Query logs into Iceberg
  • Ingestion pipeline work (monitoring & automation)
• Cluster topology consolidation and cost reductions
  • We are on one cluster
  • Query performance is equivalent
  • Costs are down
  • Schema management
• Ongoing HogQL/Performance improvements
  • Query Scheduling
  • Productizing Performance Tooling
  • Better query attribution (in query comments)
    • By end of query we do not run queries with no annotations
    • Some sort of Type for queries that will run

Board

https://github.com/orgs/PostHog/projects/85/views/2

Retro

🔥 Incidents 🔥

Happy cluster. Happy Life.

Last Sprint's Goals

• 🔴 Duplication investigation @tkaemming
• 🟢 Expose whether or not a new query is utilizing indexes @orian
  • Only need to be exposed in the UI but the API returns it
• 🔴 Clickhouse in K8s @Daesgar
  • will be issues with NVME, so either we switch US to EU topology, or we try to use s3backedmergetree with TTL setup to move off of NVME.
• 🟢 Finish standing up EU Offline replica set @Daesgar
• 🔴 Backups to Dagster @fuziontech
• ❓ Metabase dashboard for delete compliance @fuziontech
  • Table data is available in ClickHouse, but not sure about the Metabase dashboard
• 🟢 Clean up weekend EU disk alerts @fuziontech @Daesgar
  • Tuned the alert, but still can page. We can't tune it more so we need to provide enough storage for weekend mutations.
• 🟡 Backfill Person Properties into a map on US @tkaemming
  • This is still in progress? We are backfilling, but still need to complete it
• ❓ HogQL printer/ast/visitor improvements @orian
• ❓ Turn on/off logic/button for "Query as a Service" @orian

This Sprint's Goals

TL;DR

• Duplication investigation @tkaemming
• Move backups to Dagster @Daesgar
  • Backups are flaky right now in HouseWatch and hardly retriable
• Rework ClickHouse on-calls / update runbooks while Jams is out @Daesgar
  • Of course, we need to agree as a team, but I'll send a proposal
• Analysis of date partitions hit by event queries @Daesgar
• Add created_at to person table (link) @Daesgar
• Add QaaS usage reporting to billing @orian
• Switch between free / paid QaaS based on billing data @orian

[Twixes]

Team Max AI

Support hero: @skoob13

OKR

Replace 10 full-time data analysts around the world with AI

Retro

High priority

• ✅ Semantic search on actions MVP shipped @skoob13
• ✅ SQL insights support (based on current code from the SQL editor) @Twixes
• 🟠 Natural language "Add insight" on dashboards @Twixes
• 🔴 History of conversations @skoob13
• 🟡 Fix other issues identified in our Feedback review @Twixes @skoob13

Low priority / side quests

• ➡️ Prototype integrating @PostHog/team-replay's recordings search into core Max (RFC on how teams can add Max skills)

High priority

• General release for Teams+Enterprise users
  • Add indication of Max can and can't do in UI @Twixes
• Semantic search on cohorts @skoob13
• History of conversations @skoob13
• Integrate Max throughout app: @Twixes @skoob13
  • AI "Add insight" on dashboards
  • AI "Edit/explain insight" on insight
  • AI "Edit SQL" on SQL editor
  • 👆 Based on above, RFC on how product teams can implement AI
• Question clustering script to group questions coming up @skoob13

Low priority / side quests

• Continue tackling Feedback review points @skoob13 @Twixes
• Check utility of Max against data warehouse

[daibhin]

Team Error Tracking

Retro

🟢 Successful week onboarding Hugues in London
🟢 Source map upload cli v1 planned & almost built (needs cymbal changes)
🟡 Progress on framework specific bugs but looks like there is a lot more to tackle here
🔴 Did not realise how close to the end of the quarter we are

OKR

🟠 Migrate PostHog off Sentry
🟠 Ship the damn thing

High priority

Migrate PostHog off Sentry @daibhin

• Track exceptions in EU & US (carried over)
• Remove everyone from Sentry (except for tracing, on-call engineer)
• Add it to the billing repo (in-person)

Ship the damn thing

• Source map uploads @oliverb123
  • Cymbal changes and e2e flow working
  • posthog-cli release automation (optional)
  • Another round of bug hunting
    • Issue source
    • Python ordering
• Issue page UI improvements @hpouillot
  • Move date range filter
  • Select earliest / latest exception
• Move to public beta
  • Onboarding flow
  • Quickstart guide (optional)
  • Add product intents
  • Pricing exploration
• Separate SDKs for specific frameworks
  • Starting with NextJS
  • Work with @joshsny on wizard to make framework specific changes

Low priority / side quests

• Bulk actions (resolve, assign, etc)
• Decide on launch extras for marketing
• Resolve forever e.g. drop exceptions by issue id (expensive to do in cymbal given current pipeline, but imo a blocker to release given impact on billing)

[EDsCODE]

Team Data Storehouse

OKR Q1 2025

Objective

Objective: World class query experience

• Key Results:
  • SQL copilot
  • Draft mode
  • Data modeling and lineage controls

Objective: Data Visualizations

• Key Results:
  • Complete suite of charting options
  • External data for all insights

Objective: Extensible sources

• Key Results:
  • Repeatable and easy to build data import source pattern
  • Revised source configuration experience

Priorities

• graceful shutdown of temporal workers @tomasfarias
• release bigquery source @tomasfarias
• live testing of sources @phixMe
• allow users to define trigger time of syncs @phixMe
• final memory fixes across all sql sources @Gilbert09
• query run state—dont rerun long queries and local cache as optimistically as possible @EDsCODE

[robbie-c]

Team Web Analytics

Support hero: @robbie-c + @rafaeelaudibert

OKRs

• 🟡 Finish cookieless mode
• Build marketing analytics
  • 🟡 Add revenue data to web analytics
  • 🟡 Get ad spend data into data warehouse and use it for per-channel analytics
• Build per-page reports
  • 🟢 Core web vitals

Retro

• 🟡 dogfood reddit & snapchat pixels, fix problems @robbie-c
• 🟡 Cookieless next steps - decide endpoint @robbie-c
• 🟡 Page reports @lricoy
• 🟢 Finish Host selection UI @rafaeelaudibert
• 🟢 Clickhouse dictionary for currency @rafaeelaudibert
• 🟢 add a CDP function to block CIDR IP address ranges @robbie-c
• 🟢 charts visualization option for web analytics' stats tables @lricoy
• 🟡 improve docs (e.g. docs on bounce rate) @lricoy
• 🔴 CSP violation report @lricoy

Extra:

• Web Analytics was added to Quick Start @rafaeelaudibert
• Fixed path cleaning for duplicate aliases @rafaeelaudibert

Next sprint

High priority

• Cookieless next steps - decide endpoint @robbie-c
• Page reports @lricoy
• data warehouse -> revenue @rafaeelaudibert
• revenue docs @rafaeelaudibert
• heatmaps - @lricoy

Low priority

• improve docs (e.g. docs on bounce rate) @lricoy
• Add a source for revenuecat