You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: website/docs/deployment/gcp/index.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -64,7 +64,7 @@ For burst or low-utilization workloads, use [GKE Autopilot](https://cloud.google
64
64
65
65
#### 2. Configure Workload Identity for GCP access
66
66
67
-
Most Spice connectors (Cloud Storage via the [S3 connector](../../components/data-connectors/s3) with HMAC, BigQuery via [ADBC](../../components/data-connectors/adbc), Cloud SQL via [PostgreSQL](../../components/data-connectors/postgres) or [MySQL](../../components/data-connectors/mysql)) accept GCP credentials from [Application Default Credentials](https://cloud.google.com/docs/authentication/application-default-credentials). Use Workload Identity so pods receive scoped, short-lived tokens without static keys:
67
+
Most Spice connectors (Cloud Storage via the [S3 connector](../components/data-connectors/s3) with HMAC, BigQuery via [ADBC](../components/data-connectors/adbc), Cloud SQL via [PostgreSQL](../components/data-connectors/postgres) or [MySQL](../components/data-connectors/mysql)) accept GCP credentials from [Application Default Credentials](https://cloud.google.com/docs/authentication/application-default-credentials). Use Workload Identity so pods receive scoped, short-lived tokens without static keys:
68
68
69
69
```bash
70
70
# 1. Create a Google service account and grant it the roles the Spicepod needs
Copy file name to clipboardExpand all lines: website/docs/deployment/read-write-separation.md
+8-8Lines changed: 8 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -87,14 +87,14 @@ It is overkill when one Spice instance is sufficient (start with [Sidecar](archi
87
87
88
88
### The cluster (write tier)
89
89
90
-
The cluster owns every refresh, acceleration, and search index for the datasets in scope. It runs as a standalone Spice deployment — typically a Kubernetes [`Deployment`](deployment/kubernetes/helm) or [`StatefulSet`](https://docs.spice.ai/docs/enterprise/kubernetes-operator/spicepodset), or a managed [Spice Cloud](deployment/cloud) app — and holds the only credentials to the source systems.
90
+
The cluster owns every refresh, acceleration, and search index for the datasets in scope. It runs as a standalone Spice deployment — typically a Kubernetes [`Deployment`](./kubernetes/helm) or [`StatefulSet`](https://docs.spice.ai/docs/enterprise/kubernetes-operator/spicepodset), or a managed [Spice Cloud](./cloud) app — and holds the only credentials to the source systems.
91
91
92
92
Cluster Spicepod responsibilities:
93
93
94
94
- Connect to every source: object stores, OLTP databases, lakehouses, search indices, message queues.
95
95
- Run all refresh schedules, CDC, and stream ingest.
96
96
- Accelerate to file-mode engines (DuckDB or SQLite) so the materialization can be exported as a snapshot.
97
-
- Write [snapshots](features/data-acceleration/snapshots) to a shared object store after each refresh.
97
+
- Write [snapshots](../features/data-acceleration/snapshots) to a shared object store after each refresh.
98
98
99
99
```yaml
100
100
# cluster spicepod.yaml
@@ -138,7 +138,7 @@ datasets:
138
138
duckdb_file: /data/customers.db
139
139
```
140
140
141
-
Snapshots are partitioned by date and dataset (`month=YYYY-MM/day=YYYY-MM-DD/dataset=<name>/...`), so retention is a normal object-store lifecycle rule. See [Snapshots](features/data-acceleration/snapshots) for the full configuration reference.
141
+
Snapshots are partitioned by date and dataset (`month=YYYY-MM/day=YYYY-MM-DD/dataset=<name>/...`), so retention is a normal object-store lifecycle rule. See [Snapshots](../features/data-acceleration/snapshots) for the full configuration reference.
142
142
143
143
### The read instances (read tier)
144
144
@@ -187,7 +187,7 @@ datasets:
187
187
188
188
### Live delegation for the long tail
189
189
190
-
Snapshots cover the working set. For queries that span beyond it — historical analytics, cross-dataset joins, distributed search — read instances delegate to the cluster using a [`spiceai` connector](components/data-connectors/spiceai) entry pointing at the cluster's Arrow Flight endpoint.
190
+
Snapshots cover the working set. For queries that span beyond it — historical analytics, cross-dataset joins, distributed search — read instances delegate to the cluster using a [`spiceai` connector](../components/data-connectors/spiceai) entry pointing at the cluster's Arrow Flight endpoint.
191
191
192
192
```yaml
193
193
# read instance spicepod.yaml (continued)
@@ -251,7 +251,7 @@ Whichever approach is chosen, treat schema changes as backward-compatible by def
251
251
252
252
## Deploy on Kubernetes
253
253
254
-
The reference topology runs the cluster as a `StatefulSet` (or [`SpicepodSet`](https://docs.spice.ai/docs/enterprise/kubernetes-operator/spicepodset) on Spice.ai Enterprise) and the read instances as sidecars in application pods. Both use the same [Spice Helm chart](deployment/kubernetes/helm).
254
+
The reference topology runs the cluster as a `StatefulSet` (or [`SpicepodSet`](https://docs.spice.ai/docs/enterprise/kubernetes-operator/spicepodset) on Spice.ai Enterprise) and the read instances as sidecars in application pods. Both use the same [Spice Helm chart](./kubernetes/helm).
255
255
256
256
### Cluster release
257
257
@@ -362,9 +362,9 @@ A high delegation rate is a signal to expand the materialized working set. A gro
362
362
## Related
363
363
364
364
- [Cluster-Sidecar Architecture](architectures/cluster-sidecar) — the conceptual model and live-delegation pattern.
365
-
- [Snapshots](features/data-acceleration/snapshots) — full reference for snapshot configuration, triggers, and modes.
365
+
- [Snapshots](../features/data-acceleration/snapshots) — full reference for snapshot configuration, triggers, and modes.
366
366
- [Sidecar Architecture](architectures/sidecar) — single-instance precursor to this pattern.
367
367
- [Cluster Architecture](architectures/cluster) — internal scheduler/executor split for the cluster tier (Spice.ai Enterprise).
368
-
- [Kubernetes Deployment Guide](deployment/kubernetes) — Helm, Argo CD, and Flux options for the cluster.
369
-
- [CI/CD](deployment/ci-cd) — automating cluster and read-instance rollouts.
368
+
- [Kubernetes Deployment Guide](./kubernetes) — Helm, Argo CD, and Flux options for the cluster.
369
+
- [CI/CD](./ci-cd) — automating cluster and read-instance rollouts.
370
370
- [Spice.ai Enterprise Kubernetes Operator](https://docs.spice.ai/docs/enterprise/kubernetes-operator/kubernetes) — recommended for production self-hosted deployments.
Copy file name to clipboardExpand all lines: website/src/partials/deployment/architectures/_cluster-sidecar.mdx
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -72,4 +72,4 @@ A multi-tenant SaaS platform where each tenant's application pod includes a Spic
72
72
73
73
**See also**
74
74
75
-
-[Read/Write Separation](../read-write-separation) — production guide for splitting ingest from reads using shared acceleration snapshots, including Spicepod and Helm reference configurations.
75
+
-[Read/Write Separation](https://spiceai.org/docs/deployment/read-write-separation) — production guide for splitting ingest from reads using shared acceleration snapshots, including Spicepod and Helm reference configurations.
0 commit comments