Skip to content

Commit 30c7252

Browse files
vamshikolanuniteshyVamshi Kolanu
authored
1.4 docs (#126)
* Added documentation for incremental * Fixed minor typos * Fixed minor typos * Made Materialization: Incremental Merge for iceberg to true * Updated insert overwrite docs --------- Co-authored-by: niteshy <[email protected]> Co-authored-by: Vamshi Kolanu <[email protected]>
1 parent a7a28b7 commit 30c7252

File tree

1 file changed

+28
-7
lines changed

1 file changed

+28
-7
lines changed

README.md

Lines changed: 28 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -10,12 +10,12 @@ The `dbt-hive` adapter allows you to use [dbt](https://www.getdbt.com/) along wi
1010

1111
### Credits
1212

13-
The initial adapter code was developed by bachng2017 who agreed to transfer the ownership and continute active development.
14-
This code base is now being activiely developed and maintained by Cloudera.
13+
The initial adapter code was developed by bachng2017 who agreed to transfer the ownership and continue active development.
14+
This code base is now being actively developed and maintained by Cloudera.
1515

1616
### Requirements
1717

18-
Current version of dbt-hive use dbt-core 1.4.*. We are actively working on supporting next version of dbt-core 1.5
18+
Current version of dbt-hive use dbt-core 1.4.*. We are actively working on supporting the next version of dbt-core 1.5
1919

2020
Python >= 3.8
2121
dbt-core ~= 1.4.*
@@ -51,9 +51,9 @@ demo_project:
5151
|Materialization: Table with Partitions | Yes | Yes |
5252
|Materialization: Incremental - Append | Yes | Yes|
5353
|Materialization: Incremental - Append with Partitions | Yes | Yes|
54-
|Materialization: Incremental - Insert+Overwrite| Yes | Yes |
55-
|Materialization: Incremental - Insert+Overwrite with Partitions | Yes | Yes |
56-
|Materialization: Incremental - Merge | No | No |
54+
|Materialization: Incremental - Insert+Overwrite| No | No |
55+
|Materialization: Incremental - Insert+Overwrite with Partitions | Yes | No |
56+
|Materialization: Incremental - Merge | No | Yes |
5757
|Materialization: Ephemeral | No | No |
5858
|Seeds | Yes | Yes |
5959
|Tests | Yes | Yes |
@@ -62,7 +62,28 @@ demo_project:
6262
|Authentication: LDAP | Yes | Yes |
6363
|Authentication: Kerberos | Yes | Yes |
6464

65+
### Incremental
66+
67+
Incremental models are explained in [dbt documentation](https://docs.getdbt.com/docs/build/incremental-models). This section covered the details about the incremental strategy supported by the dbt-hive.
6568

69+
| Strategy | ACID Table | Iceberg Table |
70+
|------|------|---------|
71+
| Incremental Full-Refresh | Yes | Yes |
72+
| Incremental Append | Yes | Yes |
73+
| Incremental Append with Partitions | Yes | Yes |
74+
| Incremental Insert Overwrite | No | No|
75+
| Incremental Insert Overwrite with Partitions | Yes | No|
76+
| Incremental Merge | No | Yes |
77+
| Incremental Merge with Partitions | No | Yes |
78+
79+
Support for [On-Schema Change](https://docs.getdbt.com/docs/build/incremental-models#what-if-the-columns-of-my-incremental-model-change) strategy in dbt-hive:
80+
81+
| Strategy | ACID Table | Iceberg Table |
82+
|------|------|---------|
83+
| ignore (default) | Supported | Supported |
84+
| fail | Supported | Supported |
85+
| append_new_columns | Adds new columns | Adds new columns |
86+
| sync_all_columns | Adds new columns and updates datatypes but doesn't remove existing columns | Adds new columns, updates datatypes and removes existing columns |
6687

6788
### Tests Coverage
6889

@@ -85,4 +106,4 @@ demo_project:
85106
|Authentication: LDAP | Yes | Yes |
86107
|Authentication: Kerberos | Yes | Yes |
87108

88-
Note: Kerberos is only qualified on Unix platform.
109+
**Note**: Kerberos is only qualified on Unix platform.

0 commit comments

Comments
 (0)