v0.29.0

PyAirbyte v0.29 introduces powerful new features, including MCP tools targeted to LLM use cases, the ability to "preview" data from multiple streams simultaneously, faster connector installs by leveraging the powerful uv tool, and the ability to mix-and-match connectors' Python versions within the same environment.

We're now also actively requesting feedback for the new experimental MCP features. You can share feedback in the GitHub Discussion here and in the #pyairbyte Slack channel.

✨ New Features (PyAirbyte Core)

• feat: add stream previews for sources via Source.print_stream_previews() and Source.get_stream_previews() (#725)
• feat: replace pip with uv for connector installations, resulting in dramatically faster connector installation (#730)
• feat: ability to override which Python versions will be used for installing new connectors with the use_python arg for get_source() and get_destination() (#730)
• feat: support uv-managed Python versions for installing new connectors with the use_python arg, even for Python versions not yet installed on the system (#730)
• feat: add new Cache.run_sql_query() method to run SQL queries directly against cache objects (#734)

🤖 New Built-in PyAirbyte MCP Server (🧪 Experimental)

• feat: add new MCP tools which allow LLMs to call PyAirbyte directly (#734, #738, #736):
  • Connector Management
    • list_connectors - List available Airbyte connectors with optional filtering by type (source/destination), install types (python, yaml, java, docker), or keywords
    • get_connector_info - Get documentation URL and information for a specific connector
    • list_connector_config_secrets - List available config secret names for a given connector
    • validate_connector_config - Validate a connector configuration
  • Source Operations
    • list_source_streams - List all streams available in a source connector
    • get_source_stream_json_schema - Get the JSON schema for a specific stream in a source connector
    • get_stream_previews - Get sample records (previews) from streams in a source connector
    • read_source_stream_records - Read records from a specific source stream
  • Cache Operations
    • describe_default_cache - Describe the currently configured default cache (typically DuckDB)
    • list_cached_streams - List all streams available in the default cache
    • sync_source_to_cache - Run a sync from a source connector to the default DuckDB cache
    • run_sql_query - Run SQL queries against the default cache

🐛 Fixes

• fix: use stderr for log and progress prints (#720)
• fix: fix docker refs for destinations in cli module (#735)

⚙️ Under the Hood

Show/Hide Details

• ci: Update sources with init errors (#718) - Thanks, @yohannj!
• ci: Remove flaky lowcode connector validation tests (#732)
• ci: Add PR welcome message system with uvx installation examples (#721)
• Chore(deps): Bump pyarrow from 17.0.0 to 21.0.0 (#722)
• Chore(deps): Bump chuhlomin/render-template from 1.4 to 1.10 (#723)