You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,16 +12,16 @@ The `dbt-dremio` package contains all of the code enabling dbt to work with [Dre
12
12
13
13
The dbt-dremio package supports both Dremio Cloud and Dremio Software (versions 22.0 and later).
14
14
15
-
## dbt-dremio version 1.8.4
15
+
## dbt-dremio version 1.9.0
16
16
17
-
Version 1.8.4 of the dbt-dremio adapter is compatible with dbt-core versions 1.8.*.
17
+
Version 1.9.0 of the dbt-dremio adapter is compatible with dbt-core versions 1.9.*.
18
18
19
19
> Prior to version 1.1.0b, dbt-dremio was created and maintained by [Fabrice Etanchaud](https://github.com/fabrice-etanchaud) on [their GitHub repo](https://github.com/fabrice-etanchaud/dbt-dremio). Code for using Dremio REST APIs was originally authored by [Ryan Murray](https://github.com/rymurr). Contributors in this repo are credited for laying the groundwork and maintaining the adapter till version 1.0.6.5. The dbt-dremio adapter is maintained and distributed by Dremio starting with version 1.1.0b.
-[Option: Use Enterprise Catalog](#option-use-enterprise-catalog-dremio-enterprise-edition-v26)
17
+
-[Option: Use Source & Space](#option-use-source--space)
18
+
-[Threads](#thread)
19
19
-[Customizing Configurations in dbt with Dremio](#customizing-configurations-in-dbt-with-dremio)
20
20
-[Configuring Defaults for a Group of Models in `dbt_project.yml`](#configuring-defaults-for-a-group-of-models-in-dbt_projectyml)
21
21
-[Configuring an Individual Model with the config Function](#configuring-an-individual-model-with-the-config-function)
@@ -95,16 +95,21 @@ Now we can create a new dbt project using the command `dbt init`, this will be b
95
95
-[2] software_with_username_password (if you are self-deploying Dremio like using Docker and want to authenticate using Username/Password)
96
96
-[3] software_with_pat (if you are self-deploying Dremio like using Docker and want to authenticate using Personal Access Token which must be generated with Dremio REST API)
97
97
98
-
#### Connection Settings and Authentication
99
-
4.*software host*: The host part of the url for your Dremio instance, if running on your laptop this would be `localhost` or `127.0.0.1`
100
-
5.*port*: The port Dremio is running on within the host, which should typically be port `9047`
101
-
6.*username*: Your Dremio Username
102
-
7.*password*: Your Dremio Password
103
-
8.*use_ssl*: Whether to use a SSL connection (choose False if working locally)
98
+
#### Storage Options
99
+
100
+
There are currently **two** possible ways to configure the storage locations for your dbt models in Dremio:
101
+
102
+
4. Using an Enterprise Catalog, storing both tables and views in the same location.
103
+
5. Using Source & Space, storing tables and views, respectively.
104
+
105
+
##### Option: Use Enterprise Catalog *[Dremio Enterprise Edition v26+]*
104
106
105
-
#### 9-12: Default View and Table Storage Location
107
+
-`enterprise_catalog_namespace`: The name of the enterprise catalog you want to use.
108
+
-`enterprise_catalog_folder`: The sub path within the enterprise catalog for storing tables and views.
106
109
107
-
###### Materializing Tables Location
110
+
##### Option: Use Source & Space
111
+
112
+
###### Source - Materializing Tables Location
108
113
109
114
-`object_storage_source`: must be a Dremio source where tables can be written (S3, GCP, HDFS, AWS Glue, Polaris, Nessie), if you don't have one of these sources connected to Dremio accept the default `$scratch` option.
110
115
-`object_storage_path`: the sub path for your object_storage_source
@@ -114,7 +119,7 @@ These two settings establish where physical tables are created by default, so if
114
119
-`object_storage_source`: `nessie`
115
120
-`object_storage_path`: `marketing.bronze`
116
121
117
-
###### Creating Views Location
122
+
###### Space - Materializing Views Location
118
123
119
124
-`dremio_space`: This can be any Dremio Source that can track views (Spaces, Arctic Catalog, Nessie, Dremio Catalog) if you don't have any of these select the default option which will use the users homespace (every user gets a "home" space named after their username on Dremio Self-Deployed)
120
125
@@ -125,7 +130,14 @@ If I want views to be create by a default in `default.views` then the values wou
125
130
-`dremio_space`: `default`
126
131
-`dremio_space_folder`: `views`
127
132
128
-
#### 13 Thread
133
+
#### Connection Settings and Authentication
134
+
6.*software host*: The host part of the url for your Dremio instance, if running on your laptop this would be `localhost` or `127.0.0.1`
135
+
7.*port*: The port Dremio is running on within the host, which should typically be port `9047`
136
+
8.*username*: Your Dremio Username
137
+
9.*password*: Your Dremio Password
138
+
10.*use_ssl*: Whether to use a SSL connection (choose False if working locally)
139
+
140
+
#### Thread
129
141
130
142
Just select the default `1` thread unless you want to use more threads.
0 commit comments