You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: website/docs/components/data-connectors/mongodb.md
+26-35Lines changed: 26 additions & 35 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,41 +27,6 @@ datasets:
27
27
28
28
## Configuration
29
29
30
-
### Real-Time Change Data Capture (CDC) with MongoDB Change Streams
31
-
32
-
Spice supports real-time Change Data Capture (CDC) from MongoDB using native [MongoDB Change Streams](https://www.mongodb.com/docs/manual/changeStreams/). This enables streaming inserts, updates, and deletes from your MongoDB collections directly into Spice accelerators, without requiring Debezium or Kafka.
33
-
34
-
#### Enabling CDC with `refresh_mode: changes`
35
-
36
-
To enable real-time CDC, set `refresh_mode: changes` in your dataset configuration:
37
-
38
-
```yaml
39
-
datasets:
40
-
- from: mongodb:my_collection
41
-
name: my_collection
42
-
params:
43
-
host: my-cluster.mongodb.net
44
-
db: mydb
45
-
acceleration:
46
-
enabled: true
47
-
engine: duckdb
48
-
refresh_mode: changes
49
-
```
50
-
51
-
- `refresh_mode: changes` tells Spice to use MongoDB Change Streams for this dataset.
52
-
- No Debezium or Kafka is required—Spice connects directly to MongoDB.
53
-
- Changes are streamed in real time into the configured accelerator (e.g., DuckDB, Arrow).
54
-
55
-
#### Use Cases
56
-
- Real-time analytics on operational data
57
-
- Low-latency dashboards and event-driven pipelines
58
-
59
-
#### Notes
60
-
- Requires MongoDB 4.0+ and a replica set or sharded cluster.
61
-
- Ensure your MongoDB user has `changeStream` privileges.
62
-
63
-
---
64
-
65
30
### `from`
66
31
67
32
The `from` field takes the form `mongodb:{table_name}` where `table_name` is the table identifer in the MongoDB server to read from.
@@ -300,6 +265,32 @@ datasets:
300
265
mongodb_pool_max: 10
301
266
```
302
267
268
+
### Using MongoDB Change Streams
269
+
270
+
Spice supports real-time Change Data Capture (CDC) from MongoDB using native [MongoDB Change Streams](https://www.mongodb.com/docs/manual/changeStreams/). This enables streaming inserts, updates, and deletes from your MongoDB collections directly into Spice accelerators.
271
+
272
+
To enable real-time CDC, set `refresh_mode: changes` in the dataset's configuration:
273
+
274
+
```yaml
275
+
datasets:
276
+
- from: mongodb:my_collection
277
+
name: my_collection
278
+
params:
279
+
host: my-cluster.mongodb.net
280
+
db: mydb
281
+
acceleration:
282
+
enabled: true
283
+
engine: duckdb
284
+
refresh_mode: changes
285
+
```
286
+
287
+
#### Notes
288
+
- Requires MongoDB 4.0+ and a replica set or sharded cluster.
289
+
- Ensure your MongoDB user has `changeStream` privileges.
290
+
291
+
---
292
+
293
+
303
294
## Secrets
304
295
305
296
Spice integrates with multiple secret stores to help manage sensitive data securely. For detailed information on supported secret stores, refer to the [secret stores documentation](../secret-stores). Additionally, learn how to use referenced secrets in component parameters by visiting the [using referenced secrets guide](../secret-stores#using-secrets).
Copy file name to clipboardExpand all lines: website/docs/features/observability/index.md
-1Lines changed: 0 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,7 +22,6 @@ Spice provides monitoring and observability through three mechanisms:
22
22
-[New Relic](../monitoring/new-relic)
23
23
-[Zipkin](../monitoring/zipkin)
24
24
25
-
26
25
## Prometheus Metrics Endpoint
27
26
28
27
Spice exposes a Prometheus-compatible metrics endpoint that monitoring systems can scrape. The endpoint serves metrics in the [Prometheus exposition format](https://prometheus.io/docs/instrumenting/exposition_formats/), which is supported by most enterprise monitoring platforms including Datadog, New Relic, Chronosphere, Grafana Cloud, and others.
Copy file name to clipboardExpand all lines: website/docs/reference/sql/dml.md
+1Lines changed: 1 addition & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,6 +9,7 @@ Data Manipulation Language (DML) statements are used to insert, update, and dele
9
9
10
10
:::warning[Supported Operations]
11
11
Spice supports `INSERT` for write-capable connectors and `MERGE INTO` for [Spice Cayenne](../../components/data-accelerators/cayenne) catalog tables. `UPDATE` and `DELETE` statements are not yet supported as standalone operations. For data modifications, use `MERGE INTO` or the source database directly.
12
+
:::
12
13
13
14
:::info
14
15
Spice is built on [Apache DataFusion](https://datafusion.apache.org/) and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects.
0 commit comments