Skip to content

Add SMB and NFS Data Connector Docs#1295

Merged
lukekim merged 7 commits into
release/1.11from
lukim/smb-nfs
Jan 6, 2026
Merged

Add SMB and NFS Data Connector Docs#1295
lukekim merged 7 commits into
release/1.11from
lukim/smb-nfs

Conversation

@lukekim
Copy link
Copy Markdown
Contributor

@lukekim lukekim commented Jan 5, 2026

This pull request significantly improves the documentation for the FTP/SFTP Data Connector and the general data connector file format support. The changes focus on making configuration and usage clearer, adding practical examples, and updating terminology to reflect recent improvements. The documentation now provides a more user-friendly quickstart, detailed configuration instructions, and troubleshooting guidance. Additionally, the supported data connectors and file formats have been updated and clarified.

FTP/SFTP Data Connector Documentation Improvements:

  • Added a comprehensive quickstart section, including YAML and SQL usage examples, to help users get started quickly.
  • Clarified the differences between FTP and SFTP, including a comparison table and security recommendations.
  • Expanded configuration documentation with clearer descriptions, parameter tables, and multiple real-world examples (e.g., single file, directory, custom ports, timeouts, Hive partitioning, acceleration).
  • Added troubleshooting tips for common issues such as timeouts, authentication failures, and file format errors.

General Data Connector and File Format Documentation Updates:

  • Updated the list of supported data connectors to include SMB and NFS, and clarified their alpha status and supported formats.
  • Rewrote the file formats section to clarify when and how to specify file_format, provide status and descriptions of each supported format, and list format-specific parameters.
  • Added documentation for Hive-style partitioning, including configuration and query examples, and explained document format handling and schema.

These changes make the documentation more accessible, actionable, and up-to-date for users working with FTP/SFTP and other file-based data connectors.

@lukekim lukekim added this to the v1.11 milestone Jan 5, 2026
@lukekim lukekim self-assigned this Jan 5, 2026
@lukekim lukekim added documentation Improvements or additions to documentation enhancement New feature or request labels Jan 5, 2026
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 5, 2026

✅ Pull with Spice Passed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ Has at least one of the required labels: area/blog, area/docs, area/cookbook, dependencies
  • ✅ No banned labels detected
  • ✅ Has at least one assignee: lukekim

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 5, 2026

🔍 Pull with Spice Failed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ No banned labels detected
  • ✅ Has at least one assignee: lukekim

Failed checks:

  • ❌ Please select at least one of the required labels for this pull request: area/blog, area/docs, area/cookbook, dependencies

Please address these issues and update your pull request.

1 similar comment
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 5, 2026

🔍 Pull with Spice Failed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ No banned labels detected
  • ✅ Has at least one assignee: lukekim

Failed checks:

  • ❌ Please select at least one of the required labels for this pull request: area/blog, area/docs, area/cookbook, dependencies

Please address these issues and update your pull request.

Comment thread website/docs/components/data-connectors/index.md
Comment thread website/docs/components/data-connectors/smb.md
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 6, 2026

🚀 deployed to https://d243fad4.spiceai-org-website.pages.dev

@lukekim lukekim merged commit 9fb6526 into release/1.11 Jan 6, 2026
3 checks passed
@lukekim lukekim deleted the lukim/smb-nfs branch January 6, 2026 00:19
Jeadie added a commit that referenced this pull request Jan 20, 2026
* Remove OTel ports from docs (#1270)

* Docs for Google (#1286)

Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Luke Kim <80174+lukekim@users.noreply.github.com>

* Parameterized Queries docs (#1298)

* Paramterized Queries docs

* Formatting

* Add SMB and NFS Data Connector Docs (#1295)

* Add SMB & NFS Data Connector docs

* Fixes

* formatting

* Rename "params" key (#1300)

* Fix params (#1301)

* Update Dynamodb Authentication (#1304)

* Update Dynamodb Auth

* Update

* Cayenne: document cayenne_file_path and cayenne_metadata_dir (#1307)

* Update snapshots documentation (#1318)

* Update snapshots documentation

* Fix

* Docs for snapshots_reset_expiry_on_load (#1322)

* Minor fixes for DynamoDB (#1323)

* Minor fixes for DynamoDB

* Minor fix

* Update Distributed Query docs for v1.11 changes (#1326)

* Update Distributed Query docs for v1.11 changes

* Update website/docs/features/distributed-query/index.md

Co-authored-by: Jack Eadie <jack@spice.ai>

---------

Co-authored-by: Jack Eadie <jack@spice.ai>

* ScyllaDB Data Connector docs (#1325)

* Add Arrow Hash Index docs (#1324)

* Add Arrow Hash Index docs

* Formatting

* Add versioning support (#1308)

* Add versioning support

* Fix: empty versions array until release branches exist

* Enable versioned docs for release/1.11 branch

* Fix: resolve git refs with origin/ prefix for CI

* Fix: run git archive from repo root

* Fix: serve current docs at /docs, versioned docs at /docs/v1.11

* fix(versioning): only show unmaintained banner for versions outside maintenance window

* Update to 1

* feat(versioning): add enterprise support note on unmaintained version banner

* feat(versioning): add support for unreleased docs from trunk

- Current docs (trunk) now served at /docs/next with 'unreleased' banner
- Latest release branch served at /docs as the default
- Previous versions continue at /docs/v1.11, etc.

* Move to right

* feat(versioning): auto-detect release branches from git

- Script now auto-detects release/<major>.<minor> branches
- No manual VERSIONS array maintenance required
- Creating a new release branch automatically adds version to docs

* Fix

* fix(versioning): highest version is 'next', second highest is 'latest'

- v1.11.x (highest) → Next (unreleased) at /docs/next
- v1.10.x (second) → Latest (stable) at /docs
- Trunk docs available at /docs/trunk
- Previous versions at /docs/v1.9, etc.

* fix(versioning): warn on broken links for cross-version compatibility

Older release branches may contain absolute links to docs pages that
don't exist in all versions. Setting onBrokenLinks to 'warn' allows
the build to succeed while still reporting these issues.

* Fixes

* Fixes

* Update menu

* Improve SMB docs (#1328)

* Improve copilot instructions

* Improve SMB docs

---------

Co-authored-by: Phillip LeBlanc <phillip@spice.ai>
Co-authored-by: Jack Eadie <jack@spice.ai>
Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Viktor Yershov <viktor@spice.ai>
Co-authored-by: Sergei Grebnov <sergei.grebnov@gmail.com>
Jeadie added a commit that referenced this pull request Jan 26, 2026
* v1.11 Documentation (#1296)

* Remove OTel ports from docs (#1270)

* Docs for Google (#1286)

Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Luke Kim <80174+lukekim@users.noreply.github.com>

* Parameterized Queries docs (#1298)

* Paramterized Queries docs

* Formatting

* Add SMB and NFS Data Connector Docs (#1295)

* Add SMB & NFS Data Connector docs

* Fixes

* formatting

* Rename "params" key (#1300)

* Fix params (#1301)

* Update Dynamodb Authentication (#1304)

* Update Dynamodb Auth

* Update

* Cayenne: document cayenne_file_path and cayenne_metadata_dir (#1307)

* Update snapshots documentation (#1318)

* Update snapshots documentation

* Fix

* Docs for snapshots_reset_expiry_on_load (#1322)

* Minor fixes for DynamoDB (#1323)

* Minor fixes for DynamoDB

* Minor fix

* Update Distributed Query docs for v1.11 changes (#1326)

* Update Distributed Query docs for v1.11 changes

* Update website/docs/features/distributed-query/index.md

Co-authored-by: Jack Eadie <jack@spice.ai>

---------

Co-authored-by: Jack Eadie <jack@spice.ai>

* ScyllaDB Data Connector docs (#1325)

* Add Arrow Hash Index docs (#1324)

* Add Arrow Hash Index docs

* Formatting

* Add versioning support (#1308)

* Add versioning support

* Fix: empty versions array until release branches exist

* Enable versioned docs for release/1.11 branch

* Fix: resolve git refs with origin/ prefix for CI

* Fix: run git archive from repo root

* Fix: serve current docs at /docs, versioned docs at /docs/v1.11

* fix(versioning): only show unmaintained banner for versions outside maintenance window

* Update to 1

* feat(versioning): add enterprise support note on unmaintained version banner

* feat(versioning): add support for unreleased docs from trunk

- Current docs (trunk) now served at /docs/next with 'unreleased' banner
- Latest release branch served at /docs as the default
- Previous versions continue at /docs/v1.11, etc.

* Move to right

* feat(versioning): auto-detect release branches from git

- Script now auto-detects release/<major>.<minor> branches
- No manual VERSIONS array maintenance required
- Creating a new release branch automatically adds version to docs

* Fix

* fix(versioning): highest version is 'next', second highest is 'latest'

- v1.11.x (highest) → Next (unreleased) at /docs/next
- v1.10.x (second) → Latest (stable) at /docs
- Trunk docs available at /docs/trunk
- Previous versions at /docs/v1.9, etc.

* fix(versioning): warn on broken links for cross-version compatibility

Older release branches may contain absolute links to docs pages that
don't exist in all versions. Setting onBrokenLinks to 'warn' allows
the build to succeed while still reporting these issues.

* Fixes

* Fixes

* Update menu

* Improve SMB docs (#1328)

* Improve copilot instructions

* Improve SMB docs

---------

Co-authored-by: Phillip LeBlanc <phillip@spice.ai>
Co-authored-by: Jack Eadie <jack@spice.ai>
Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Viktor Yershov <viktor@spice.ai>
Co-authored-by: Sergei Grebnov <sergei.grebnov@gmail.com>

* Update snapshot storage configuration description

Clarified that the location for snapshots must be an S3 directory instead of a folder.

---------

Co-authored-by: Luke Kim <80174+lukekim@users.noreply.github.com>
Co-authored-by: Phillip LeBlanc <phillip@spice.ai>
Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Viktor Yershov <viktor@spice.ai>
Co-authored-by: Sergei Grebnov <sergei.grebnov@gmail.com>
lukekim added a commit that referenced this pull request Jan 28, 2026
* Remove OTel ports from docs (#1270)

* Docs for Google (#1286)

Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Luke Kim <80174+lukekim@users.noreply.github.com>

* Parameterized Queries docs (#1298)

* Paramterized Queries docs

* Formatting

* Add SMB and NFS Data Connector Docs (#1295)

* Add SMB & NFS Data Connector docs

* Fixes

* formatting

* Rename "params" key (#1300)

* Fix params (#1301)

* Update Dynamodb Authentication (#1304)

* Update Dynamodb Auth

* Update

* Cayenne: document cayenne_file_path and cayenne_metadata_dir (#1307)

* Update snapshots documentation (#1318)

* Update snapshots documentation

* Fix

* Docs for snapshots_reset_expiry_on_load (#1322)

* Minor fixes for DynamoDB (#1323)

* Minor fixes for DynamoDB

* Minor fix

* Update Distributed Query docs for v1.11 changes (#1326)

* Update Distributed Query docs for v1.11 changes

* Update website/docs/features/distributed-query/index.md

Co-authored-by: Jack Eadie <jack@spice.ai>

---------

Co-authored-by: Jack Eadie <jack@spice.ai>

* ScyllaDB Data Connector docs (#1325)

* Add Arrow Hash Index docs (#1324)

* Add Arrow Hash Index docs

* Formatting

* Add versioning support (#1308)

* Add versioning support

* Fix: empty versions array until release branches exist

* Enable versioned docs for release/1.11 branch

* Fix: resolve git refs with origin/ prefix for CI

* Fix: run git archive from repo root

* Fix: serve current docs at /docs, versioned docs at /docs/v1.11

* fix(versioning): only show unmaintained banner for versions outside maintenance window

* Update to 1

* feat(versioning): add enterprise support note on unmaintained version banner

* feat(versioning): add support for unreleased docs from trunk

- Current docs (trunk) now served at /docs/next with 'unreleased' banner
- Latest release branch served at /docs as the default
- Previous versions continue at /docs/v1.11, etc.

* Move to right

* feat(versioning): auto-detect release branches from git

- Script now auto-detects release/<major>.<minor> branches
- No manual VERSIONS array maintenance required
- Creating a new release branch automatically adds version to docs

* Fix

* fix(versioning): highest version is 'next', second highest is 'latest'

- v1.11.x (highest) → Next (unreleased) at /docs/next
- v1.10.x (second) → Latest (stable) at /docs
- Trunk docs available at /docs/trunk
- Previous versions at /docs/v1.9, etc.

* fix(versioning): warn on broken links for cross-version compatibility

Older release branches may contain absolute links to docs pages that
don't exist in all versions. Setting onBrokenLinks to 'warn' allows
the build to succeed while still reporting these issues.

* Fixes

* Fixes

* Update menu

* Improve SMB docs (#1328)

* Improve copilot instructions

* Improve SMB docs

* Docs for snapshots_creation_policy (#1330)

* Improvements (#1333)

* Add High Availability documentation for distributed query clusters (#1334)

* Update kafka/debezium docs

* Update snapshot storage configuration description (#1331)

* v1.11 Documentation (#1296)

* Remove OTel ports from docs (#1270)

* Docs for Google (#1286)

Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Luke Kim <80174+lukekim@users.noreply.github.com>

* Parameterized Queries docs (#1298)

* Paramterized Queries docs

* Formatting

* Add SMB and NFS Data Connector Docs (#1295)

* Add SMB & NFS Data Connector docs

* Fixes

* formatting

* Rename "params" key (#1300)

* Fix params (#1301)

* Update Dynamodb Authentication (#1304)

* Update Dynamodb Auth

* Update

* Cayenne: document cayenne_file_path and cayenne_metadata_dir (#1307)

* Update snapshots documentation (#1318)

* Update snapshots documentation

* Fix

* Docs for snapshots_reset_expiry_on_load (#1322)

* Minor fixes for DynamoDB (#1323)

* Minor fixes for DynamoDB

* Minor fix

* Update Distributed Query docs for v1.11 changes (#1326)

* Update Distributed Query docs for v1.11 changes

* Update website/docs/features/distributed-query/index.md

Co-authored-by: Jack Eadie <jack@spice.ai>

---------

Co-authored-by: Jack Eadie <jack@spice.ai>

* ScyllaDB Data Connector docs (#1325)

* Add Arrow Hash Index docs (#1324)

* Add Arrow Hash Index docs

* Formatting

* Add versioning support (#1308)

* Add versioning support

* Fix: empty versions array until release branches exist

* Enable versioned docs for release/1.11 branch

* Fix: resolve git refs with origin/ prefix for CI

* Fix: run git archive from repo root

* Fix: serve current docs at /docs, versioned docs at /docs/v1.11

* fix(versioning): only show unmaintained banner for versions outside maintenance window

* Update to 1

* feat(versioning): add enterprise support note on unmaintained version banner

* feat(versioning): add support for unreleased docs from trunk

- Current docs (trunk) now served at /docs/next with 'unreleased' banner
- Latest release branch served at /docs as the default
- Previous versions continue at /docs/v1.11, etc.

* Move to right

* feat(versioning): auto-detect release branches from git

- Script now auto-detects release/<major>.<minor> branches
- No manual VERSIONS array maintenance required
- Creating a new release branch automatically adds version to docs

* Fix

* fix(versioning): highest version is 'next', second highest is 'latest'

- v1.11.x (highest) → Next (unreleased) at /docs/next
- v1.10.x (second) → Latest (stable) at /docs
- Trunk docs available at /docs/trunk
- Previous versions at /docs/v1.9, etc.

* fix(versioning): warn on broken links for cross-version compatibility

Older release branches may contain absolute links to docs pages that
don't exist in all versions. Setting onBrokenLinks to 'warn' allows
the build to succeed while still reporting these issues.

* Fixes

* Fixes

* Update menu

* Improve SMB docs (#1328)

* Improve copilot instructions

* Improve SMB docs

---------

Co-authored-by: Phillip LeBlanc <phillip@spice.ai>
Co-authored-by: Jack Eadie <jack@spice.ai>
Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Viktor Yershov <viktor@spice.ai>
Co-authored-by: Sergei Grebnov <sergei.grebnov@gmail.com>

* Update snapshot storage configuration description

Clarified that the location for snapshots must be an S3 directory instead of a folder.

---------

Co-authored-by: Luke Kim <80174+lukekim@users.noreply.github.com>
Co-authored-by: Phillip LeBlanc <phillip@spice.ai>
Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Viktor Yershov <viktor@spice.ai>
Co-authored-by: Sergei Grebnov <sergei.grebnov@gmail.com>

* Update Snowflake data connector docs (#1340)

* fix: convert absolute /docs/ links to relative paths

* Update Cayenne accelerator status from Alpha to Beta (#1341)

* URL tables docs (#1343)

* URL tables docs

* Formatting

* Improve snapshots documentation + retention (#1342)

* Improve snapshots documnetation + retention

* Fix

---------

Co-authored-by: Jack Eadie <jack@spice.ai>

* Fix links

* Formatting

* Update version references in documentation and scripts for v2.1 release

* Handle major versions

* Fix merge conflicts

---------

Co-authored-by: Phillip LeBlanc <phillip@spice.ai>
Co-authored-by: Jack Eadie <jack@spice.ai>
Co-authored-by: Evgenii Khramkov <evgenii@spice.ai>
Co-authored-by: Viktor Yershov <viktor@spice.ai>
Co-authored-by: Sergei Grebnov <sergei.grebnov@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/docs documentation Improvements or additions to documentation enhancement New feature or request release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants