Skip to content

Commit 91ee879

Browse files
authored
Lakebridge Release v0.10.6 Notes (#1897)
# Lakebridge Release v0.10.6 Notes ## Analyzer - **Informatica Workflow Variable Collection** The Informatica analyzer now collects workflow variables, enhancing downstream conversion and mapping flows. ## Converters improvements ## Morpheus - Expanded SQL parser for Snowflake supports full `IF...ELSEIF...ELSE` and `ELSE IF` constructs, recognizes `ELSEIF` as a keyword, and strengthens test coverage. - Improvements in Snowflake `CREATE PROCEDURE` grammar, including: simplified syntax, handling of optional queries, result set variables, and better exception handling. - Support for `TEMPORARY` as an interchangeable keyword for temporary objects in Snowflake parsing. ## BladeBridge - **Enhanced SQL Scripting for Oracle Procedures** Multiple fixes for procedure conversion, including quoted identifiers, Japanese character support, misplaced/duplicated keywords, improved `SELECT INTO`, and more. - **Datastage PXPivot Conversion** Datastage’s vertical pivot (PXPivot) can now be converted to Databricks SQL, broadening ETL migration. - **Synapse and MS SQL Configuration Improvements** - Enhanced fragment breaker for standalone SELECTs - Improved logic and ordering for variable declarations and set operators - Bugfixes for `PROC_FINISH`, WITH statement handling, and universal ETL+SQL testing - **Overrides-file Prompt Update** More descriptive and clear prompt for the ‘overrides-file’ option in CLI and documentation. - **Bug Fixes & Minor Enhancements** - Datastage IF/THEN/ELSE and header row handling improvements - TRY/CATCH and improved `SELECT INTO #table` conversion - Better handling of set operations in SELECT/WITH - Standardized JSON configuration naming: now uses `base_<source>2databricks_<sql|sparksql|pyspark>.json` - DELETE-to-MERGE conversion, more tests, correct semicolon placement, and expanded handling of SQL scripting features ## Documentation - **Significant Improvements:** - Expanded BladeBridge and overall configuration docs, with clear instructions for extending logic, using overrides, managing outputs, and troubleshooting. - Updated guide on reconciling config and leveraging new CLI options. ## General - **Security & Infrastructure Enhancements** - Addressed CVE-2025-7339 (HTTP header manipulation vulnerability) by updating the `on-headers` dependency. - Refined handling of output folders, error files, and configuration management for reliability. - Improved reconcile dashboard deployment reliability—folders without a `dashboard.yml` are no longer deployed. - Suppressed spurious warnings on initial installation; only debug messages are now logged for clean setups. - Improved encoding handling and end-to-end test coverage for non-UTF-8 files and edge-case encodings.
1 parent da6bdc8 commit 91ee879

File tree

2 files changed

+61
-1
lines changed

2 files changed

+61
-1
lines changed

CHANGELOG.md

Lines changed: 60 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,65 @@
11
# Version changelog
22

3+
## # Lakebridge Release v0.10.6 Notes
4+
5+
## Analyzer
6+
7+
- **Informatica Workflow Variable Collection**
8+
The Informatica analyzer now collects workflow variables, enhancing downstream conversion and mapping flows.
9+
## Converters improvements
10+
11+
## Morpheus
12+
13+
- Expanded SQL parser for Snowflake supports full `IF...ELSEIF...ELSE` and `ELSE IF` constructs, recognizes `ELSEIF` as a keyword, and strengthens test coverage.
14+
15+
- Improvements in Snowflake `CREATE PROCEDURE` grammar, including: simplified syntax, handling of optional queries, result set variables, and better exception handling.
16+
17+
- Support for `TEMPORARY` as an interchangeable keyword for temporary objects in Snowflake parsing.
18+
19+
## BladeBridge
20+
21+
- **Enhanced SQL Scripting for Oracle Procedures**
22+
Multiple fixes for procedure conversion, including quoted identifiers, Japanese character support, misplaced/duplicated keywords, improved `SELECT INTO`, and more.
23+
24+
- **Datastage PXPivot Conversion**
25+
Datastage’s vertical pivot (PXPivot) can now be converted to Databricks SQL, broadening ETL migration.
26+
27+
- **Synapse and MS SQL Configuration Improvements**
28+
29+
- Enhanced fragment breaker for standalone SELECTs
30+
- Improved logic and ordering for variable declarations and set operators
31+
- Bugfixes for `PROC_FINISH`, WITH statement handling, and universal ETL+SQL testing
32+
33+
- **Overrides-file Prompt Update**
34+
More descriptive and clear prompt for the ‘overrides-file’ option in CLI and documentation.
35+
36+
- **Bug Fixes & Minor Enhancements**
37+
38+
- Datastage IF/THEN/ELSE and header row handling improvements
39+
- TRY/CATCH and improved `SELECT INTO #table` conversion
40+
- Better handling of set operations in SELECT/WITH
41+
- Standardized JSON configuration naming: now uses `base_<source>2databricks_<sql|sparksql|pyspark>.json`
42+
- DELETE-to-MERGE conversion, more tests, correct semicolon placement, and expanded handling of SQL scripting features
43+
44+
## Documentation
45+
46+
- **Significant Improvements:**
47+
- Expanded BladeBridge and overall configuration docs, with clear instructions for extending logic, using overrides, managing outputs, and troubleshooting.
48+
- Updated guide on reconciling config and leveraging new CLI options.
49+
50+
51+
## General
52+
53+
- **Security & Infrastructure Enhancements**
54+
55+
- Addressed CVE-2025-7339 (HTTP header manipulation vulnerability) by updating the `on-headers` dependency.
56+
- Refined handling of output folders, error files, and configuration management for reliability.
57+
- Improved reconcile dashboard deployment reliability—folders without a `dashboard.yml` are no longer deployed.
58+
- Suppressed spurious warnings on initial installation; only debug messages are now logged for clean setups.
59+
- Improved encoding handling and end-to-end test coverage for non-UTF-8 files and edge-case encodings.
60+
61+
62+
363
## 0.10.5
464

565
## Converters improvements
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
# DO NOT MODIFY THIS FILE
2-
__version__ = "0.10.5"
2+
__version__ = "0.10.6"

0 commit comments

Comments
 (0)