v1.0.0

Spice v1.0-stable (Jan 20, 2025)

🎉 After 47 releases, Spice.ai OSS has reached production readiness with the 1.0-stable milestone!

The core runtime and features such as query federation, query acceleration, catalog integration, search and AI-inference have all graduated to stable status along with key component graduations across data connectors, data accelerators, catalog connectors, and AI model providers.

Highlights in v1.0-stable

• Stable Data Connectors: The following data connectors have graduated to Stable:

  • Delta Lake
  • MySQL
  • Dremio
  • PostgreSQL
  • Databricks (mode: delta_lake)
  • DuckDB
  • S3

• Stable Data Accelerators: The following data accelerators have graduated to Stable:

  • DuckDB
  • Arrow

• Unity Catalog Connector: Graduated to Stable.

• Databricks (mode: spark_connect) Data Connector: Graduated to Beta.

• Beta Catalog Connectors: The Iceberg and Databricks catalog connectors graduated to Beta.

• OpenAI Model & Embeddings Provider: Graduated to Release Candidate (RC).

• Alpha Model Providers: The Anthropic and xAI (Grok) model providers graduated to Alpha.

Breaking Changes

• Default Runtime Version: The CLI will install the GPU accelerated AI-capable Runtime by default, when running spice install or spice run.

• Default OpenAI Model: The default OpenAI model has updated to gpt-4o-mini.

• Identifier Normalization: Unquoted identifiers such as table names are no longer normalized to lowercase. Identifiers will now retain their exact case as provided.

• Sandboxed Docker Image: The Runtime Docker Image now runs the spiced process as the nobody user in a minimal chroot sandbox.

• Insecure S3 and ABFS endpoints: The S3 and ABFS connectors now enforce insecure endpoint checks, preventing HTTP endpoints unless allow_http is explicitly enabled. Refer to the documentation for details.

Dependencies

No major dependency changes.

Upgrading

To upgrade to v1.0.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.0.0 image:

docker pull spiceai/spiceai:1.0.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai

Contributors

• @peasee
• @ewgenius
• @Jeadie
• @Sevenannn
• @lukekim
• @phillipleblanc
• @sgrebnov

What's Changed

• feat: Update load test criteria, testoperator updates by @peasee in spiceai/spiceai#4311
• Update helm for v1.0.0-rc.5 by @ewgenius in spiceai/spiceai#4313
• Update spicepod.schema.json by @github-actions in spiceai/spiceai#4318
• Bump version to v1.0.0, update SECURITY.md by @ewgenius in spiceai/spiceai#4314
• Initial criteria for models, embeddings by @Jeadie in spiceai/spiceai#4223
• Update benchmark snapshots by @github-actions in spiceai/spiceai#4321
• Add dremio param for running load test by @Sevenannn in spiceai/spiceai#4315
• Promote Databricks (mode: delta_lake) connector to stable by @Sevenannn in spiceai/spiceai#4328
• Handle failed query in load test by @Sevenannn in spiceai/spiceai#4327
• feat: Use load test hours for baseline query sets by @peasee in spiceai/spiceai#4334
• Fix typo in 1.0.0-rc.5 release notes by @ewgenius in spiceai/spiceai#4329
• feat: add testoperator data consistency by @peasee in spiceai/spiceai#4319
• docs: Release DuckDB connector stable by @peasee in spiceai/spiceai#4335
• Fix DocumentDB -> DynamoDB by @lukekim in spiceai/spiceai#4339
• Update benchmark snapshots by @github-actions in spiceai/spiceai#4337
• fix: Download hits.parquet from MinIO for benchmark by @peasee in spiceai/spiceai#4338
• Update openapi.json by @github-actions in spiceai/spiceai#4341
• Remove evil averages by @lukekim in spiceai/spiceai#4343
• Don't run builds on non-code changes by @phillipleblanc in spiceai/spiceai#4344
• Remove streaming requirement from Databricks spark Beta and Spark connector Beta by @ewgenius in spiceai/spiceai#4345
• Update s3 tpcds spicepods by @ewgenius in spiceai/spiceai#4346
• Explicitly set required scale factor for throughput and load tests by @ewgenius in spiceai/spiceai#4347
• Fix s3 tpcds dataset name by @ewgenius in spiceai/spiceai#4348
• Promote Iceberg Catalog Connector to Beta by @phillipleblanc in spiceai/spiceai#4350
• Update s3 clickbench benchmark snapshots by @ewgenius in spiceai/spiceai#4351
• fix: DuckDB clickbench on zero results by @peasee in spiceai/spiceai#4349
• Add integration test with snapshots for databricks catalog connector by @Sevenannn in spiceai/spiceai#4353
• refactor: Remove on zero results from benchmarks, add data consistency workflow by @peasee in spiceai/spiceai#4354
• Fix Bug: No field named body_embedding when do vector search with refresh sql containing subset of columns by @sgrebnov in spiceai/spiceai#4297
• docs: Update roadmap by @peasee in spiceai/spiceai#4364
• feat: Release accelerators stable by @peasee in spiceai/spiceai#4361
• Add TPCH/TPCDS test spicepods for MySQL by @phillipleblanc in spiceai/spiceai#4365
• Catch when an insecure (http) S3 and ABFS data connectors endpoint is used without specifying the allow_http parameter by @ewgenius in spiceai/spiceai#4363
• Update ROADMAP - Iceberg catalog alpha for v1.0 by @ewgenius in spiceai/spiceai#4367
• Promote databricks catalog and databricks (spark_connect) connector to beta by @Sevenannn in spiceai/spiceai#4369
• Update Roadmap - Iceberg beta by @ewgenius in spiceai/spiceai#4373
• Build CUDA binaries for Linux by @Jeadie in spiceai/spiceai#4320
• Promote Nvidia NIM as Alpha by @phillipleblanc in spiceai/spiceai#4380
• Promote xai to alpha by @Sevenannn in spiceai/spiceai#4381
• Update stable criteria for object store based connectors by @ewgenius in spiceai/spiceai#4383
• Testoperator: http consistency and overhead tests, fixes and ci by @ewgenius in spiceai/spiceai#4382
• Promote S3 Data Connector to Stable by @ewgenius in spiceai/spiceai#4385
• Download platform-supported CUDA binary version on Linux by @sgrebnov in spiceai/spiceai#4356
• Fix http consistency test workflow, add overhead workflow by @ewgenius in spiceai/spiceai#4387
• feat: Add Postgres test spicepods by @peasee in spiceai/spiceai#4388
• Fix typos + specific in model criteria; Make explicit alpha/beta tests for LLMS in crates/llms/tests. by @Jeadie in spiceai/spiceai#4377
• Fix federation bug for correlated subqueries of deeply nested Dremio tables by @phillipleblanc in spiceai/spiceai#4389
• Fix http overhead workflow by @ewgenius in spiceai/spiceai#4390
• Tweak model tests, fix embedding input by @ewgenius in spiceai/spiceai#4391
• Promote Dremio to Stable quality by @Sevenannn in spiceai/spiceai#4392
• Add beta functionality tests for embedding models. by @Jeadie in spiceai/spiceai#4352
• docs: Release postgres connector stable by @peasee in spiceai/spiceai#4398
• Increase timeout for model response in E2E tests by @sgrebnov in spiceai/spiceai#4399
• Disable ident normalization (i.e. SELECT MyColumn from table works) by @phillipleblanc in spiceai/spiceai#4400
• Preserve schema metadata by @ewgenius in spiceai/spiceai#4402
• Make models integration tests tracing less verbose by @sgrebnov in spiceai/spiceai#4403
• Fix cuda feature build on Windows by @sgrebnov in spiceai/spiceai#4404
• Promote MySQL to Stable by @phillipleblanc in spiceai/spiceai#4406
• docs: Release Delta Lake and Unity catalog by @peasee in spiceai/spiceai#4405
• Use gpt-4o-mini as a default model for openai provider by @ewgenius in spiceai/spiceai#4410
• Fix streaming for Openai and Anthropic by @Jeadie in spiceai/spiceai#4409
• Tweak model loading and missing tool errors messages by @ewgenius in spiceai/spiceai#4412
• Spice CLI: fallback to CPU build for unsupported GPU Compute Capability by @sgrebnov in spiceai/spiceai#4407
• Build Windows CUDA binaries as part of build_and_release workflow by @sgrebnov in spiceai/spiceai#4386
• Update docs link by @phillipleblanc in spiceai/spiceai#4416
• feat: Add CPU models install escape hatch by @peasee in spiceai/spiceai#4419
• Handle OpenAI API Errors by @ewgenius in spiceai/spiceai#4417
• Update spice cli to use GH_TOKEN or GITHUB_TOKEN env variables when calling releases api by @ewgenius in spiceai/spiceai#4175
• Implement secure sandboxing for Docker image by @phillipleblanc in spiceai/spiceai#4411
• Automatically install supported CUDA binary on Windows by @sgrebnov in spiceai/spiceai#4420
• Metrics for LLMs+ embeddings by @Jeadie in spiceai/spiceai#4418
• Jeadie/25 01 17/beta perf by @Jeadie in spiceai/spiceai#4397
• Pass GitHub token to all CI steps calling spice run by @ewgenius in spiceai/spiceai#4423
• Run the models integration tests on PRs by @phillipleblanc in spiceai/spiceai#4421
• Run CUDA builds in a separate workflow by @phillipleblanc in spiceai/spiceai#4430
• Promote OpenAI models and embeddings providers to RC by @ewgenius in spiceai/spiceai#4432
• Update link to retrieval-augmented generation (RAG) details by @sgrebnov in spiceai/spiceai#4433
• Unity catalog should strip parameter prefix before passing parameters to delta lake factory by @Sevenannn in spiceai/spiceai#4436
• Update quickstart traces to match current version by @sgrebnov in spiceai/spiceai#4435
• Update Supported Embeddings Providers Readme section by @sgrebnov in spiceai/spiceai#4434
• Local models can stream tools by @Jeadie in spiceai/spiceai#4429
• fix: Use MetricsCollector::show() for HTTP testoperator commands by @peasee in spiceai/spiceai#4442
• Fix run query action by @ewgenius in spiceai/spiceai#4444
• Default to AI-enabled runtime for spice run/spice install by @phillipleblanc in spiceai/spiceai#4443
• Change no spicepod.yaml log to warning by @phillipleblanc in spiceai/spiceai#4447
• refactor: Update Catalog Connector error messages by @peasee in spiceai/spiceai#4441
• Fix panic when converting OTel metrics by @phillipleblanc in spiceai/spiceai#4449
• refactor: Update model errors by @peasee in spiceai/spiceai#4446
• Update spiceai/mistral.rs to silence metadata logs by @ewgenius in spiceai/spiceai#4452
• fix xAI; don't use openai defaults by @Jeadie in spiceai/spiceai#4450
• Improves the UX of using huggingface models by @phillipleblanc in spiceai/spiceai#4451
• Add GH Workflow to test spice ai runtime installation by @sgrebnov in spiceai/spiceai#4448
• fix: Use specific model errors where available by @peasee in spiceai/spiceai#4454
• Detect and report unsupported embedding column type during dataset registration by @sgrebnov in spiceai/spiceai#4456
• Handle Errors by @Jeadie in spiceai/spiceai#4455
• Catch and report negative openai_temperature error by @Sevenannn in spiceai/spiceai#4453
• Clarify release check error message if it is caused by wrong GH token by @ewgenius in spiceai/spiceai#4458

Full Changelog: spiceai/spiceai@v1.0.0-rc.5...v1.0.0