Commit d06cab3
Add control plane / data plane architecture (#146)
* Add control plane / data plane architecture for zero-downtime deployments
Implement a multi-process architecture that splits duckgres into a control
plane (connection management, routing) and data plane (pool of long-lived
DuckDB worker processes). This enables zero-downtime deployments, cross-session
DuckDB cache reuse, and rolling worker updates.
Key components:
- gRPC-based worker management (Configure, Health, Drain, Shutdown)
- Unix socket FD passing via SCM_RIGHTS for TCP connection handoff
- Least-connections load balancing across worker pool
- Graceful control plane handover via listener FD transfer
- Rolling worker updates triggered by SIGUSR2
- Health check loop with automatic worker restart
New CLI modes: --mode control-plane | worker | standalone (default)
Standalone mode (existing behavior) is completely unchanged.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
* Fix done channel leak and per-query cancellation in control plane
ConnectExistingWorker never closed the done channel, causing
ShutdownAll and RollingUpdate to always hit their timeout for
handed-over workers. Add a health-check monitoring goroutine.
CancelQuery killed the entire session instead of just the running
query. Use the per-session minServer.CancelQuery() to cancel only
the in-flight query, matching standalone mode behavior.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
* Fix lint errors: unchecked Close() returns and unused code
- Add _ = prefix to all unchecked .Close() return values (errcheck)
- Remove unused nextWorker field from WorkerPool (unused)
- Remove unused activeQueriesMu field from Worker (unused)
- Remove unused loadExtensions/attachDuckLake method wrappers (unused)
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>1 parent 9a25bf9 commit d06cab3
19 files changed
Lines changed: 3718 additions & 83 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
| 11 | + | |
| 12 | + | |
11 | 13 | | |
12 | | - | |
| 14 | + | |
| 15 | + | |
13 | 16 | | |
14 | 17 | | |
15 | 18 | | |
16 | 19 | | |
17 | | - | |
18 | | - | |
| 20 | + | |
| 21 | + | |
19 | 22 | | |
20 | 23 | | |
| 24 | + | |
21 | 25 | | |
22 | 26 | | |
23 | 27 | | |
24 | 28 | | |
| 29 | + | |
| 30 | + | |
25 | 31 | | |
26 | 32 | | |
27 | 33 | | |
28 | 34 | | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
29 | 44 | | |
30 | 45 | | |
31 | 46 | | |
| |||
74 | 89 | | |
75 | 90 | | |
76 | 91 | | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
77 | 106 | | |
78 | 107 | | |
79 | 108 | | |
80 | | - | |
| 109 | + | |
81 | 110 | | |
82 | 111 | | |
83 | 112 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
| 29 | + | |
| 30 | + | |
29 | 31 | | |
30 | 32 | | |
31 | 33 | | |
| |||
45 | 47 | | |
46 | 48 | | |
47 | 49 | | |
| 50 | + | |
48 | 51 | | |
49 | 52 | | |
50 | 53 | | |
| |||
177 | 180 | | |
178 | 181 | | |
179 | 182 | | |
180 | | - | |
181 | | - | |
182 | | - | |
183 | | - | |
184 | | - | |
185 | | - | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
186 | 193 | | |
187 | 194 | | |
188 | 195 | | |
| |||
428 | 435 | | |
429 | 436 | | |
430 | 437 | | |
| 438 | + | |
| 439 | + | |
| 440 | + | |
| 441 | + | |
| 442 | + | |
| 443 | + | |
431 | 444 | | |
432 | 445 | | |
433 | 446 | | |
| |||
449 | 462 | | |
450 | 463 | | |
451 | 464 | | |
| 465 | + | |
| 466 | + | |
| 467 | + | |
| 468 | + | |
| 469 | + | |
| 470 | + | |
| 471 | + | |
| 472 | + | |
| 473 | + | |
| 474 | + | |
| 475 | + | |
| 476 | + | |
| 477 | + | |
| 478 | + | |
| 479 | + | |
| 480 | + | |
| 481 | + | |
| 482 | + | |
| 483 | + | |
| 484 | + | |
| 485 | + | |
| 486 | + | |
| 487 | + | |
| 488 | + | |
| 489 | + | |
| 490 | + | |
| 491 | + | |
| 492 | + | |
| 493 | + | |
| 494 | + | |
| 495 | + | |
| 496 | + | |
| 497 | + | |
| 498 | + | |
| 499 | + | |
| 500 | + | |
| 501 | + | |
| 502 | + | |
| 503 | + | |
| 504 | + | |
| 505 | + | |
| 506 | + | |
| 507 | + | |
| 508 | + | |
| 509 | + | |
| 510 | + | |
| 511 | + | |
| 512 | + | |
| 513 | + | |
| 514 | + | |
| 515 | + | |
| 516 | + | |
| 517 | + | |
| 518 | + | |
| 519 | + | |
| 520 | + | |
| 521 | + | |
| 522 | + | |
452 | 523 | | |
453 | 524 | | |
454 | 525 | | |
| |||
509 | 580 | | |
510 | 581 | | |
511 | 582 | | |
512 | | - | |
513 | | - | |
514 | | - | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
515 | 586 | | |
516 | 587 | | |
517 | 588 | | |
| |||
0 commit comments