Email: liusinan1998@gmail.com
WeChat: Denovo1998
π§ββοΈ Disaggregated streaming, purpose-built for Apache Pulsar.
Stateless brokers. Shared object storage. One offset truth. No ZooKeeper, no BookKeeper bookies β just your object store and Oxia for coordination. The kind of streaming engine you wish Pulsar shipped with.
- Stateless brokers β add or remove nodes without partition reassignment or lag spikes
- Object storage as the data plane β S3, MinIO, GCS. Zero local disk on brokers
- One canonical address β
streamId + offsetreplaces ledger IDs, entry IDs, and cursor bookkeeping - Oxia for metadata β linearizable, cloud-native coordination without ZooKeeper operational overhead
| Repo | What it is |
|---|---|
| nereus | Core engine: StreamStorage, Object WAL, ManagedLedger facade, Pulsar & KoP adapters |
| pulsar | Pulsar fork integrating Nereus as a broker backend |
| kop | KoP fork β Kafka protocol on Nereus, no Pulsar required |
- apache/pulsar#24928
featpipβ PIP-448: Topic-level delayed message tracker (memory optimization) - apache/pulsar#24927, apache/pulsar#24922
featbrokerβ Topic-level delayed delivery tracking (in-memory manager) - apache/pulsar#24370, apache/pulsar#23907
improvepipbrokerβ PIP-423: Admin API to acknowledge a single message - apache/pulsar#23895, apache/pulsar#23896
improvepipclientβ PIP-405: Enhanced dynamic handling of selective consumers in MultiTopicConsumers - apache/pulsar#23143, apache/pulsar#23194
improvepipbrokerβ PIP-371: Support for request-reply model (RPC calls) - apache/pulsar#19566
improvebrokerβ PIP-246: Improve PROTOBUF_NATIVE schema compatibility checks (no avro-protobuf) - apache/pulsar#17449
fixbrokerβ PIP-236: Fix schema-based consumer creation failure after AUTO_CONSUME subscribe
- apache/pulsar#24739
improvebrokerβ Optimize fine-grained concurrency control for BucketDelayedDeliveryTracker - apache/pulsar#24372
improvebrokerβ Support consumer-side delayed messages - apache/pulsar#23609
improvemlβ Avoid repetitive nested lock forisMessageDeletedinManagedCursorImpl - apache/pulsar#20415
improvebrokerβ Supplement schema ledger if schema ledger is lost - apache/pulsar#19753
cleanupbrokerβ Remove duplicate code in SchemaRegistryServiceImpl (schema checks) - apache/pulsar#24770
fixbrokerβ Flaky-test: ExtensibleLoadManagerImplTest.testDisableBroker
- datastax/starlight-for-kafka#124
improvecinettyβ Add Netty leak detection reporting to CI and local tests - datastax/starlight-for-kafka#126
improveentryFormatterβ Reduce allocations in PulsarEntryFormatter batch encoding - datastax/starlight-for-kafka#127
fixbugnettyβ Complete ResponseCallbackWrapper on encoding failure - datastax/starlight-for-kafka#128
improveprotocolβ Add Kafka client quotas support in KoP
- apache/pulsar-java-contrib#6
improvepcipβ PCIP-2: Distributed RPC framework implemented by the Pulsar client - apache/pulsar-java-contrib#12
improvepcipβ PCIP-4: Improve delayed RPC message handling in pulsar-rpc
- apache/pulsar-helm-chart#645
feathelmbookkeeperβ Add support for BookKeeperindexDirectoriesconfiguration

