Add documentation for data generation, ETL pipeline, metrics, telemetry, and system adapters (#166)

* Add documentation for data generation, ETL pipeline, metrics, telemetry, and system adapters

- Introduced `data-generation-and-etl.md` detailing the data generation process, S3 layout, version and table metadata, supported datasets, mutations, and running data generation.
- Created `getting-started.md` to guide users through installation, building, and running SpiceBench, including data generation and ETL pipeline instructions.
- Added `metrics-and-telemetry.md` outlining the metrics collected during benchmarks, their sources, and export pipelines.
- Established `system-adapters.md` to describe the system adapter protocol, transport modes, method specifications, and lifecycle, along with templates for building new adapters.

* docs: update documentation for system adapters, configuration, and future AI-native benchmarks

* docs: update flowchart for SpiceBench run process and metrics collection

* Update system adapter examples with latest SpiceBench changes

* Add documentation for SpiceBench

- Introduced README.md for SpiceBench documentation, outlining architecture, getting started guide, CLI reference, system adapters, data generation & ETL, metrics & telemetry, configuration, and crate reference.
- Created crate-reference.md detailing API overview for all workspace crates, including dependency graph, key modules, defined metrics, and public types for each crate.
- Added data-generation-and-etl.md to explain the two-stage data pipeline for data generation and ETL processes, including S3 layout, version metadata, supported datasets, mutations, and running data generation.
- Developed system-adapters.md to describe the system adapter protocol, current support, transport modes, method specifications, adapter lifecycle, and guidelines for adapter development.

* Add documentation for data generation, ETL pipeline, metrics, telemetry, and system adapters

- Introduced `data-generation-and-etl.md` detailing the data generation process, S3 layout, version and table metadata, supported datasets, mutations, and running data generation.
- Created `getting-started.md` to guide users through installation, building, and running SpiceBench, including data generation and ETL pipeline instructions.
- Added `metrics-and-telemetry.md` outlining the metrics collected during benchmarks, their sources, and export pipelines.
- Established `system-adapters.md` to describe the system adapter protocol, transport modes, method specifications, and lifecycle, along with templates for building new adapters.

* docs: update documentation for system adapters, configuration, and future AI-native benchmarks

* docs: update flowchart for SpiceBench run process and metrics collection

* Add documentation for SpiceBench

- Introduced README.md for SpiceBench documentation, outlining architecture, getting started guide, CLI reference, system adapters, data generation & ETL, metrics & telemetry, configuration, and crate reference.
- Created crate-reference.md detailing API overview for all workspace crates, including dependency graph, key modules, defined metrics, and public types for each crate.
- Added data-generation-and-etl.md to explain the two-stage data pipeline for data generation and ETL processes, including S3 layout, version metadata, supported datasets, mutations, and running data generation.
- Developed system-adapters.md to describe the system adapter protocol, current support, transport modes, method specifications, adapter lifecycle, and guidelines for adapter development.

* feat: add create_tables method to all adapters for dataset management

* Add documentation for data generation, ETL pipeline, metrics, telemetry, and system adapters

- Introduced `data-generation-and-etl.md` detailing the data generation process, S3 layout, version and table metadata, supported datasets, mutations, and running data generation.
- Created `getting-started.md` to guide users through installation, building, and running SpiceBench, including data generation and ETL pipeline instructions.
- Added `metrics-and-telemetry.md` outlining the metrics collected during benchmarks, their sources, and export pipelines.
- Established `system-adapters.md` to describe the system adapter protocol, transport modes, method specifications, and lifecycle, along with templates for building new adapters.

* docs: update documentation for system adapters, configuration, and future AI-native benchmarks

* docs: update flowchart for SpiceBench run process and metrics collection

* Add documentation for SpiceBench

- Introduced README.md for SpiceBench documentation, outlining architecture, getting started guide, CLI reference, system adapters, data generation & ETL, metrics & telemetry, configuration, and crate reference.
- Created crate-reference.md detailing API overview for all workspace crates, including dependency graph, key modules, defined metrics, and public types for each crate.
- Added data-generation-and-etl.md to explain the two-stage data pipeline for data generation and ETL processes, including S3 layout, version metadata, supported datasets, mutations, and running data generation.
- Developed system-adapters.md to describe the system adapter protocol, current support, transport modes, method specifications, adapter lifecycle, and guidelines for adapter development.

* Add documentation for data generation, ETL pipeline, metrics, telemetry, and system adapters

- Introduced `data-generation-and-etl.md` detailing the data generation process, S3 layout, version and table metadata, supported datasets, mutations, and running data generation.
- Created `getting-started.md` to guide users through installation, building, and running SpiceBench, including data generation and ETL pipeline instructions.
- Added `metrics-and-telemetry.md` outlining the metrics collected during benchmarks, their sources, and export pipelines.
- Established `system-adapters.md` to describe the system adapter protocol, transport modes, method specifications, and lifecycle, along with templates for building new adapters.

* docs: update documentation for system adapters, configuration, and future AI-native benchmarks

* Update system adapter examples with latest SpiceBench changes

* Add documentation for SpiceBench

- Introduced README.md for SpiceBench documentation, outlining architecture, getting started guide, CLI reference, system adapters, data generation & ETL, metrics & telemetry, configuration, and crate reference.
- Created crate-reference.md detailing API overview for all workspace crates, including dependency graph, key modules, defined metrics, and public types for each crate.
- Added data-generation-and-etl.md to explain the two-stage data pipeline for data generation and ETL processes, including S3 layout, version metadata, supported datasets, mutations, and running data generation.
- Developed system-adapters.md to describe the system adapter protocol, current support, transport modes, method specifications, adapter lifecycle, and guidelines for adapter development.

* feat: add create_tables method to all adapters for dataset management

* Address PR review comments and align with trunk

- Rewrite architecture.md intro and add Introduction section (wyattwenzel)
- Remove Spicepod-specific sections from configuration.md (phillipleblanc)
- Remove app/spicepod sections from crate-reference.md (phillipleblanc)
- Remove stray Distributed table row from architecture.md (phillipleblanc)
- Update README.md to reference three adapter methods (setup merged create_tables)
- Restore template files to trunk state (remove create_tables method)
- Update docs index descriptions

* feat: add setup-cc action to validation run steps in PR workflow

* fix: source environment variables for ADBC driver installation

Author: lukekim

.claude/skills/system-adapter-builder/SKILL.md

@@ -1,6 +1,6 @@
 ---
 name: system-adapter-builder
-description: Build or update a SpiceBench system adapter with JSON-RPC over stdio and HTTP, including setup/create_tables/teardown/metrics support and template validation.
+description: Build or update a SpiceBench system adapter with JSON-RPC over stdio and HTTP, including setup/teardown/metrics support and template validation.
 ---
 
 # SpiceBench System Adapter Builder

.github/workflows/pr.yml

@@ -102,6 +102,8 @@ jobs:
     steps:
       - uses: actions/checkout@v6
 
+      - uses: ./.github/actions/setup-cc
+
       - uses: ./.github/actions/management-login
         with:
           client-id: ${{ secrets.SPICE_MANAGEMENT_CLIENT_ID }}
@@ -147,6 +149,7 @@ jobs:
       - name: Install ADBC driver
         run: |
           curl -LsSf https://dbc.columnar.tech/install.sh | sh
+          source "$HOME/.local/bin/env"
           dbc install flightsql
 
       - name: Run spicebench