Skip to content

Commit 1c85c18

Browse files
authored
Update from readme and acknowledgements (#286)
* update acknowledgements * updte readme
1 parent 6635a03 commit 1c85c18

2 files changed

Lines changed: 53 additions & 18 deletions

File tree

spiceaidocs/docs/acknowledgements/index.md

Lines changed: 32 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -93,21 +93,27 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
9393
- anyhow 1.0.86, Apache-2.0 OR MIT
9494
<br/>https://github.com/dtolnay/anyhow
9595

96-
- arrow 51.0.0, Apache-2.0
96+
- arrow 52.0.0, Apache-2.0
9797
<br/>https://github.com/apache/arrow-rs
9898

99-
- arrow-flight 51.0.0, Apache-2.0
99+
- arrow-flight 52.0.0, Apache-2.0
100100
<br/>https://github.com/apache/arrow-rs
101101

102-
- arrow-ipc 51.0.0, Apache-2.0
102+
- arrow-ipc 52.0.0, Apache-2.0
103103
<br/>https://github.com/apache/arrow-rs
104104

105-
- arrow-json 51.0.0, Apache-2.0
105+
- arrow-json 52.0.0, Apache-2.0
106106
<br/>https://github.com/apache/arrow-rs
107107

108-
- arrow-odbc 9.0.0, MIT
108+
- arrow-odbc 11.1.0, MIT
109109
<br/>https://github.com/pacman82/arrow-odbc
110110

111+
- async-graphql 7.0.5, Apache-2.0 OR MIT
112+
<br/>https://github.com/async-graphql/async-graphql
113+
114+
- async-graphql-axum 7.0.5, Apache-2.0 OR MIT
115+
<br/>https://github.com/async-graphql/async-graphql
116+
111117
- async-openai 0.21.0, MIT
112118
<br/>https://github.com/64bit/async-openai
113119

@@ -183,6 +189,9 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
183189
- chrono-tz 0.8.6, Apache-2.0 OR MIT
184190
<br/>https://github.com/chronotope/chrono-tz
185191

192+
- chrono-tz 0.9.0, Apache-2.0 OR MIT
193+
<br/>https://github.com/chronotope/chrono-tz
194+
186195
- clap 4.5.4, Apache-2.0 OR MIT
187196
<br/>https://github.com/clap-rs/clap
188197

@@ -195,7 +204,7 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
195204
- dashmap 5.5.3, MIT
196205
<br/>https://github.com/xacrimon/dashmap
197206

198-
- datafusion 38.0.0, Apache-2.0
207+
- datafusion 39.0.0, Apache-2.0
199208
<br/>https://github.com/apache/datafusion
200209

201210
- datafusion-federation 0.1.3, Apache-2.0
@@ -204,13 +213,16 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
204213
- datafusion-federation-sql 0.1.3, Apache-2.0
205214
<br/>
206215

207-
- deltalake 0.17.3, Apache-2.0
216+
- deltalake 0.18.0, Apache-2.0
208217
<br/>https://github.com/delta-io/delta.rs
209218

219+
- derive_builder 0.20.0, Apache-2.0 OR MIT
220+
<br/>https://github.com/colin-kiegel/rust-derive-builder
221+
210222
- dirs 5.0.1, Apache-2.0 OR MIT
211223
<br/>https://github.com/soc/dirs-rs
212224

213-
- duckdb 0.10.2, MIT
225+
- duckdb 1.0.0, MIT
214226
<br/>https://github.com/wangfenjin/duckdb-rs
215227

216228
- fundu 2.0.0, MIT
@@ -237,6 +249,9 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
237249
- itertools 0.12.1, Apache-2.0 OR MIT
238250
<br/>https://github.com/rust-itertools/itertools
239251

252+
- itertools 0.13.0, Apache-2.0 OR MIT
253+
<br/>https://github.com/rust-itertools/itertools
254+
240255
- keyring 2.3.2, Apache-2.0 OR MIT
241256
<br/>https://github.com/hwchen/keyring-rs.git
242257

@@ -276,6 +291,9 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
276291
- object_store 0.9.1, Apache-2.0 OR MIT
277292
<br/>https://github.com/apache/arrow-rs/tree/master/object_store
278293

294+
- object_store 0.10.1, Apache-2.0 OR MIT
295+
<br/>https://github.com/apache/arrow-rs/tree/master/object_store
296+
279297
- odbc-api 7.0.0, MIT
280298
<br/>https://github.com/pacman82/odbc-api
281299

@@ -285,7 +303,7 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
285303
- opentelemetry-proto 0.4.0, Apache-2.0
286304
<br/>https://github.com/open-telemetry/opentelemetry-rust/tree/main/opentelemetry-proto
287305

288-
- parquet 51.0.0, Apache-2.0
306+
- parquet 52.0.0, Apache-2.0
289307
<br/>https://github.com/apache/arrow-rs
290308

291309
- pem 1.1.1, MIT
@@ -318,7 +336,10 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
318336
- r2d2 0.8.10, Apache-2.0 OR MIT
319337
<br/>https://github.com/sfackler/r2d2
320338

321-
- regex 1.10.4, Apache-2.0 OR MIT
339+
- rand 0.8.5, Apache-2.0 OR MIT
340+
<br/>https://github.com/rust-random/rand
341+
342+
- regex 1.10.5, Apache-2.0 OR MIT
322343
<br/>https://github.com/rust-lang/regex
323344

324345
- reqwest 0.11.27, Apache-2.0 OR MIT
@@ -366,7 +387,7 @@ gopkg.in/yaml.v3, https://github.com/go-yaml/yaml/blob/v3.0.1/LICENSE, MIT
366387
- snafu 0.8.2, Apache-2.0 OR MIT
367388
<br/>https://github.com/shepmaster/snafu
368389

369-
- snowflake-api 0.8.0, Apache-2.0
390+
- snowflake-api 0.9.0, Apache-2.0
370391
<br/>https://github.com/mycelial/snowflake-rs
371392

372393
- spark-connect-rs 0.0.1-beta.4, Apache-2.0

spiceaidocs/docs/index.md

Lines changed: 21 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -10,27 +10,41 @@ import ThemeBasedImage from '@site/src/components/ThemeBasedImage';
1010

1111
## What is Spice?
1212

13-
**Spice** is a portable runtime providing developers with a unified SQL interface to materialize, accelerate, and query data sourced from any database, data warehouse, or data lake.
13+
**Spice** is a portable runtime offering developers a unified SQL interface to materialize, accelerate, and query data from any database, data warehouse, or data lake.
1414

1515
📣 Read the [Spice.ai OSS announcement blog post](https://blog.spiceai.org/posts/2024/03/28/adding-spice-the-next-generation-of-spice.ai-oss/).
1616

17-
Spice connects, fuses, and delivers data to applications and AI, acting as an application-specific, tier-optimized Database CDN.
17+
Spice connects, fuses, and delivers data to applications, machine-learning models, and AI-backends, functioning as an application-specific, tier-optimized Database CDN.
1818

19-
The Spice runtime is written in Rust and is built-with industry leading technologies like [Apache DataFusion](https://datafusion.apache.org), Apache Arrow, Apache Arrow Flight, SQlite, and DuckDB.
19+
The Spice runtime, written in Rust, is built-with industry leading technologies such as [Apache DataFusion](https://datafusion.apache.org), Apache Arrow, Apache Arrow Flight, SQLite, and DuckDB.
2020

2121
<ThemeBasedImage width="900" alt="OGP" lightSrc="https://github.com/spiceai/spiceai/assets/80174/f71f227d-d7cd-418c-85b9-5c663a728491" darkSrc="https://github.com/spiceai/spiceai/assets/80174/96b5fcef-a550-4ce8-a74a-83931275e83e" />
2222

2323
## Why Spice?
2424

25-
Spice makes querying data by SQL across one or more data sources simple and fast. Easily co-locate a managed working set of data with your application or ML, accelerated with in-memory Arrow, with SQLite/DuckDB, or with attached PostgreSQL for high-performance, low-latency queries. Accelerated engines run tier-native in your infrastructure giving you flexibility and control over cost and performance.
25+
Spice makes it easy and fast to query data from one or more sources using SQL. You can co-locate a managed dataset with your application or machine learning model, and accelerate it with Arrow in-memory, SQLite/DuckDB, or with attached PostgreSQL for fast, high-concurrency, low-latency queries. Accelerated engines give you flexibility and control over query cost and performance.
2626

2727
### How is Spice different?
2828

29-
1. Tier-optimized Acceleration with **both OLAP (Arrow/DuckDB) and OLTP (SQLite/PostgreSQL)** databases at dataset granularity compared to other OLAP only or OLTP only systems.
29+
1. **Application-focused:** Spice is designed to integrate at the application level; 1:1 or 1:N application to Spice mapping, whereas most other data systems are designed for multiple applications to share a single database or data warehouse. It's not uncommon to have many Spice instances, even down to one for each tenant or customer.
3030

31-
2. **Separation of materialization and storage/compute** compared with monolith data systems and data lakes. Keep compute colocated with source data while bringing a materialized working set next to your application, dashboard, or data/ML pipeline.
31+
2. **Dual-Engine Acceleration:** Spice supports both **OLAP** (Arrow/DuckDB) and **OLTP** (SQLite/PostgreSQL) databases at the dataset level, unlike other systems that only support one type.
3232

33-
3. **Edge to cloud native**. Designed to be deployed standalone, as a container sidecar, as a microservice, in a cluster across laptops, the Edge, On-Prem, to a POP, and to all public clouds. Spice instances can also be chained, and deployed distributed across tiers of infrastructure.
33+
3. **Separation of Materialization and Storage/Compute:** Spice separates storage and compute, allowing you to keep data close to its source and bring a materialized working set next to your application, dashboard, or data/ML pipeline.
34+
35+
4. **Edge to Cloud Native**. Spice is designed to be deployed anywhere, from a standalone instance to a Kubernetes container sidecar, microservice, or cluster at the Edge/POP, On-Prem, or in public clouds. You can also chain Spice instances and deploy them across multiple infrastructure tiers.
36+
37+
### How does Spice compare?
38+
39+
| | Spice | Trino/Presto | Dremio | Clickhouse |
40+
| -------------------------- | ---------------------------------- | -------------------------------- | -------------------------------- | ----------------------- |
41+
| Primary Use-Case | Data & AI Applications | Big Data Analytics | Interative Analytics | Real-Time Analytics |
42+
| Typical Deployment | Colocated with application | Cloud Cluster | Cloud Cluster | On-Prem/Cloud Cluster |
43+
| Application-to-Data System | One-to-One/Many | Many-to-One | Many-to-One | Many-to-One |
44+
| Query Federation | Native with query push-down | Supported with push-down | Supported with limited push-down | Limited |
45+
| Materialization | Arrow/SQLite/DuckDB/PostgreSQL | Intermediate Storage | Reflections (Iceberg) | Views & MergeTree |
46+
| Query Result Caching | Supported | Supported | Supported | Supported |
47+
| Typical Configuration | Single-Binary/Sidecar/Microservice | Coodinator+Executor w/ Zookeeper | Coodinator+Executor w/ Zookeeper | Clickhouse Keeper+Nodes |
3448

3549
### Before Spice
3650

0 commit comments

Comments
 (0)