Release v0.6.70

Release notes for v0.6.70

Full Changelog: v0.6.69...v0.6.70

Release v0.6.69

Release notes for v0.6.69

What's Changed

• 📝 Update docs / README with 40k + 40MB/s bench by @RTLS in #1085
• ✨ Stop replication connection without launching task by @RTLS in #1094
• Add Docker Compose setup mention to README by @abc3 in #1086
• ✨ Heartbeat lifecycle to detect stale connections by @RTLS in #1095
• Add time units to timer.tc calls by @abc3 in #1087

Full Changelog: v0.6.68...v0.6.69

Release v0.6.68

Release notes for v0.6.68

What's Changed

• Partition slot handling pipeline by @acco in #1070
• ⚡️ Move idempotency to sink pipeline by @RTLS in #1072
• ✨ Move smoothed timeseries to Sequin.Metrics by @RTLS in #1073
• ✨ Add graphs to consumer/index by @RTLS in #1074
• Rename SlotProcessor to SlotProcessorServer by @acco in #1076
• ♻️ Move State, handle_data out of SlotProcessorServer and into SlotProcessor by @acco in #1077
• ♻️ Move rest of message handling from SlotProcessorServer -> SlotProcessor by @acco in #1078
• 🐛 fix batch_size for config loader by @RTLS in #1083
• Support actions in ReplicationConnection by changing return tuples by @acco in #1080
• ✨ Improve back-pressure handling by keeping SlotProcessor up by @acco in #1081

Full Changelog: v0.6.67...v0.6.68

Release v0.6.67

Release notes for v0.6.67

Full Changelog: v0.6.66...v0.6.67

Release v0.6.66

Release notes for v0.6.66

What's Changed

• ✨ SERVER_CHECK_ORIGIN support for self-hosted by @RTLS in #1061

Full Changelog: v0.6.65...v0.6.66

Release v0.6.65

Release notes for v0.6.65

What's Changed

• 📈 Add timing metrics around Redis by @acco in #1030
• In CheckSystemHealth, try to run a mutation to verify we're on primary by @acco in #1031
• 🐛 Clean up Metrics for acked messages by @RTLS in #1036
• ✨ Move more into :put_messages_after_reply by @RTLS in #1037
• ✨ Accumulate messages across multiple commits by @RTLS in #1038
• ✨ [SlotProcessor] Handle relation messages inline by @RTLS in #1039
• ⚡️ Refactor SP buffering ahead of concurrent flushes by @RTLS in #1040
• ♻️ Call start_fn in database ConnectionCache async by @acco in #1032
• ⚡️ Move TableReaderServer fetching into a Task by @acco in #1041
• ♻️ [TableReader] Port fetch_batch_by_primary_keys from #1003 by @acco in #1042
• ♻️ [TableReader] Port tests for fetch_batch_by_primary_keys from #1003 by @acco in #1043
• ♻️ [TableReader] Return next cursor from fetch_batch_primary_keys by @acco in #1044
• [TableReaderServer] ♻️ Use PK fetch -> batch fetch strategy by @acco in #1045
• [TableReaderServer] Improvements after end-to-end testing by @acco in #1046
• [TableReader] update fetch_batch_by_primary_keys to use join by @acco in #1047
• ♻️ [TableReader] Refactor to use fetch_batch_pk and fetch_batch (same query kind) by @acco in #1048
• ✨ Lolad metrics async to sink consumer Show by @RTLS in #1050
• [stash] Call TRS to drop seen PKs by @acco in #1049
• ♻️ Refactor TableReaderServer pk filtering by @acco in #1051
• ♻️ Prepare for async message handler by adding before_handle_messages by @acco in #1053
• 💄 Show health events on backfill fetch errors by @acco in #1055
• ♻️ Combine DatabaseRuntime and ConsumerRuntime by @acco in #1056
• ♻️ Merge consumer pipeline into SlotSupervisor by @acco in #1057
• 🐛 Restart replication after sink_consumer update by @acco in #1058
• ♻️ Refactor sink pipelines out into behaviour SinkPipeline by @acco in #1034

Full Changelog: v0.6.63...v0.6.65

Release v0.6.64

Release notes for v0.6.64

What's Changed

• 📈 Add timing metrics around Redis by @acco in #1030
• In CheckSystemHealth, try to run a mutation to verify we're on primary by @acco in #1031

Full Changelog: v0.6.63...v0.6.64

Release v0.6.63

Release notes for v0.6.63

What's Changed

• ♻️ Prepare TableReaderServer for >1 batch by @acco in #1017
• [TableReaderServer] Add timing and process logging by @acco in #1018
• [TableReaderServer] ♻️ Support multiple in-flight batches by @acco in #1019
• ♻️ In Kafka sink, use encoded payload size to determine bandwidth by @acco in #1022
• 🔨 mix assets.setup by @RTLS in #1027
• Add bytes_processed to telemetry by @thisisgoldman in #1026
• ⚡️ Remove one mapping over messages in MessageHandler by @RTLS in #1028
• Updated quickstart docs to reflect "docker ps" output by @rexposadas in #1001
• Removed unused const and type by @rexposadas in #997
• ⚡️ SMS.put_messages validation and early GenServer.reply to SP by @RTLS in #1029

Full Changelog: v0.6.62...v0.6.63

Release v0.6.62

Release notes for v0.6.62

What's Changed

• ✨ timeout: :infinity for backfill stats by @RTLS in #1006
• ⚡️ Add PageSizeOptimizer for TableReaderServer by @acco in #999
• 🐛 Avoid re-accumulating bytes by @RTLS in #1009
• ⚡️ [TableReaderServer] back off in pushing to SMS by @acco in #1008
• ✨ LoadGenerator script by @RTLS in #1007
• ♻️ Support multiple in-flight table reader batches in SMS by @acco in #1010
• ♻️ Refactor TableReaderServer by @acco in #1011
• 🐛 [TableReaderServer] Tag watermarks with replication_id by @acco in #1012
• ✨ Batching for GCP PubSub pipeline by ordering_key by @RTLS in #1014
• 🎤 Add more logging around starting core processes by @acco in #1015
• 🐛 Don't trust the LSN from pg_logical_emit_message/3 by @acco in #1016

Full Changelog: v0.6.61...v0.6.62

Release v0.6.61

Release notes for v0.6.61

What's Changed

• Add verbiage in Contributions page for needed pguser by @rexposadas in #998
• Add vector extension to docker image so mix test can pass by @rexposadas in #1000
• 🐛Gracefully handle no consumer_messages.log file by @RTLS in #1002

New Contributors

• @rexposadas made their first contribution in #998

Full Changelog: v0.6.60...v0.6.61