Skip to content

Commit 2d5a043

Browse files
committed
again
1 parent 673b56b commit 2d5a043

3 files changed

Lines changed: 27 additions & 36 deletions

File tree

website/docs/components/data-connectors/mongodb.md

Lines changed: 26 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -27,41 +27,6 @@ datasets:
2727
2828
## Configuration
2929
30-
### Real-Time Change Data Capture (CDC) with MongoDB Change Streams
31-
32-
Spice supports real-time Change Data Capture (CDC) from MongoDB using native [MongoDB Change Streams](https://www.mongodb.com/docs/manual/changeStreams/). This enables streaming inserts, updates, and deletes from your MongoDB collections directly into Spice accelerators, without requiring Debezium or Kafka.
33-
34-
#### Enabling CDC with `refresh_mode: changes`
35-
36-
To enable real-time CDC, set `refresh_mode: changes` in your dataset configuration:
37-
38-
```yaml
39-
datasets:
40-
- from: mongodb:my_collection
41-
name: my_collection
42-
params:
43-
host: my-cluster.mongodb.net
44-
db: mydb
45-
acceleration:
46-
enabled: true
47-
engine: duckdb
48-
refresh_mode: changes
49-
```
50-
51-
- `refresh_mode: changes` tells Spice to use MongoDB Change Streams for this dataset.
52-
- No Debezium or Kafka is required—Spice connects directly to MongoDB.
53-
- Changes are streamed in real time into the configured accelerator (e.g., DuckDB, Arrow).
54-
55-
#### Use Cases
56-
- Real-time analytics on operational data
57-
- Low-latency dashboards and event-driven pipelines
58-
59-
#### Notes
60-
- Requires MongoDB 4.0+ and a replica set or sharded cluster.
61-
- Ensure your MongoDB user has `changeStream` privileges.
62-
63-
---
64-
6530
### `from`
6631

6732
The `from` field takes the form `mongodb:{table_name}` where `table_name` is the table identifer in the MongoDB server to read from.
@@ -300,6 +265,32 @@ datasets:
300265
mongodb_pool_max: 10
301266
```
302267

268+
### Using MongoDB Change Streams
269+
270+
Spice supports real-time Change Data Capture (CDC) from MongoDB using native [MongoDB Change Streams](https://www.mongodb.com/docs/manual/changeStreams/). This enables streaming inserts, updates, and deletes from your MongoDB collections directly into Spice accelerators.
271+
272+
To enable real-time CDC, set `refresh_mode: changes` in the dataset's configuration:
273+
274+
```yaml
275+
datasets:
276+
- from: mongodb:my_collection
277+
name: my_collection
278+
params:
279+
host: my-cluster.mongodb.net
280+
db: mydb
281+
acceleration:
282+
enabled: true
283+
engine: duckdb
284+
refresh_mode: changes
285+
```
286+
287+
#### Notes
288+
- Requires MongoDB 4.0+ and a replica set or sharded cluster.
289+
- Ensure your MongoDB user has `changeStream` privileges.
290+
291+
---
292+
293+
303294
## Secrets
304295

305296
Spice integrates with multiple secret stores to help manage sensitive data securely. For detailed information on supported secret stores, refer to the [secret stores documentation](../secret-stores). Additionally, learn how to use referenced secrets in component parameters by visiting the [using referenced secrets guide](../secret-stores#using-secrets).

website/docs/features/observability/index.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,6 @@ Spice provides monitoring and observability through three mechanisms:
2222
- [New Relic](../monitoring/new-relic)
2323
- [Zipkin](../monitoring/zipkin)
2424

25-
2625
## Prometheus Metrics Endpoint
2726

2827
Spice exposes a Prometheus-compatible metrics endpoint that monitoring systems can scrape. The endpoint serves metrics in the [Prometheus exposition format](https://prometheus.io/docs/instrumenting/exposition_formats/), which is supported by most enterprise monitoring platforms including Datadog, New Relic, Chronosphere, Grafana Cloud, and others.

website/docs/reference/sql/dml.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ Data Manipulation Language (DML) statements are used to insert, update, and dele
99

1010
:::warning[Supported Operations]
1111
Spice supports `INSERT` for write-capable connectors and `MERGE INTO` for [Spice Cayenne](../../components/data-accelerators/cayenne) catalog tables. `UPDATE` and `DELETE` statements are not yet supported as standalone operations. For data modifications, use `MERGE INTO` or the source database directly.
12+
:::
1213

1314
:::info
1415
Spice is built on [Apache DataFusion](https://datafusion.apache.org/) and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects.

0 commit comments

Comments
 (0)