Releases: airbytehq/PyAirbyte
Releases · airbytehq/PyAirbyte
v0.12.0
✨ New Features
- Add
install_root
argument forget_source()
, allowing users to override their virtualenv base path (#268) - Thanks, @tqtensor! - Add experimental implementation for running no-code sources (declarative YAML definitions) using
get_source()
. The YAML source definitions can be provided inline or automatically downloaded, with no need for a separate installation of the source connector. (#175) - Add capability to disable the Rich "live view" progress updates with
NO_LIVE_PROGRESS
env variable (#271)
🐛 Fixes
- Add back default schema name
'airbyte_raw'
in PyAirbyte caches (#259)
😮 Other Changes
- Update DuckDB engine from
0.9
to new (stable)v1.x
version (#269)
v0.11.2
v0.11.1
🐛 Fixes
- Improved column and table normalization logic, which resolves errors that would occur when processing stream names or property names containing special characters (#239)
- Resolve error when parsing streams that have "object or string" data typing, specifically "TypeError: unhashable type list" errors (#251)
v0.11.0
✨ New Features
- Add support for running Docker sources, via a new
airbyte.experimental.get_source()
method. (#209, #230) - Thanks, @Tarekk!- Please report any feedback in a GitHub issue or reach out in the
#pyairbyte-public-beta
channel in the Airbyte Slack.
- Please report any feedback in a GitHub issue or reach out in the
⚙️ Under the Hood
- Bump to latest Snowflake client and
cryptography
package. (#234) CatalogManager
refactor: decoupling sql processors, caches, and internal sql backend tables for state and catalog tracking. This also enables us to move some of these classes upstream into the CDK, so they can be used for Python destination connectors. (#220)
🧑🤝🧑 Velocity Improvements
v0.10.5
v0.10.4
v0.10.3
✨ New Features
- Add
fetch_connector_secret()
convenience method onGoogleGSMSecretManager
. (#191)
🐛 Fixes
- Fix GSM secrets retrieval edge cases, and improve GSM CI tests. (#191)
📖 Docs
- Improve docs around
0.10.x
features. (#190)
v0.10.2
v0.10.1
🐛 Fixes
- Resolve failures when loading large dataset by running Snowflake
PUT
queries sequentially (#188) - Thanks, @SebastienN15!
✨ New Features
- Add
parse_json()
convenience method onSecretHandle
class. (#182)
v0.10.0
✨ New Features
This release focuses on broadening the vision of PyAirbyte, adding capabilities for Airbyte Cloud users to orchestrate their syncs using PyAirbyte. Secrets management is also significantly expanded. Lastly, we improve record parsing of problematic records thanks to a community contribution from @SebastienN15.
☁️ Cloud Interop (#143)
- Add ability to run Airbyte Cloud jobs with
CloudWorkspace.run_sync()
, which returns aSyncResult
object. - Add ability to check Airbyte Cloud sync statuses, wait for status, check number of records synced, etc.
- Add ability to get
CachedDataset
objects from completed Airbyte Cloud jobs, and read records from those final tables. (Snowflake and BigQuery only.)
🔐 Secrets Management (#143)
- Add support for "BYO secrets" using
CustomSecretsManager
. - Add a new custom secrets manager for Google GSM:
GoogleGSMSecretsManager
.
🐛 Fixes
- Improve parsing of deeply nested records by adding a fallback
json
parser (#178) - Thanks, @SebastienN15!!