Skip to content
This repository was archived by the owner on Jun 7, 2024. It is now read-only.

Commit 3c20ea2

Browse files
authored
Merge pull request #1106 from zalando/repartitioning-docs
Repartitioning documentation
2 parents 0dfb4ff + 9a81a18 commit 3c20ea2

File tree

1 file changed

+21
-0
lines changed

1 file changed

+21
-0
lines changed
Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
---
2+
title: Repartitioning
3+
position: 12
4+
---
5+
6+
## Repartitioning
7+
8+
Throughput of event type is defined by default statistic, which basically sets number of partitions for the event
9+
type (although it does not represent it clearly). Number of partitions is a scaling unit for Nakadi publishing and
10+
consumption. In order to change number of partitions one have to repartition event type by changing
11+
read_parallelism and write_parallelism. Nakadi takes for repartitioning the maximum of read_parallelism and
12+
write_parallelism.
13+
14+
### Important caveats
15+
16+
- Publishing events to event type with hash partition strategy will change the partitions in which they were appearing
17+
before
18+
- Nakadi guarantees ordering per partition per batch, repartitioning event types from 1 partitions to more will break
19+
total order of events
20+
- Repartitioning allows to only increase number of partitions
21+
- Consuming subscriptions are disconnected once repartitioning is finished

0 commit comments

Comments
 (0)