Skip to content

Commit 2665652

Browse files
z3z1maz3z1ma
committed
feat!: allow configuring yaml settings inside dbt-osmosis var key
1 parent 2b501fa commit 2665652

File tree

13 files changed

+161
-172
lines changed

13 files changed

+161
-172
lines changed

‎demo_duckdb/dbt_project.yml‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,3 +31,14 @@ seeds:
3131
+dbt-osmosis: "{node.database}/{node.schema}/{node.name}.yml"
3232

3333
flags: {}
34+
35+
vars:
36+
dbt-osmosis:
37+
yaml_settings:
38+
map_indent: 2
39+
sequence_indent: 4
40+
top_level_colon_align: false
41+
brace_single_entry_mapping_in_flow_sequence: true
42+
prefix_colon: " "
43+
explicit_start: true
44+
default_flow_style: ~

‎demo_duckdb/models/jaffle_shop/main/customers.yml‎

Lines changed: 15 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -1,32 +1,21 @@
1+
---
12
version: 2
23
models:
3-
- name: customers
4-
description: This table has basic information about a customer, as well as some derived facts based on a customer's orders
4+
- name : customers
5+
description : This table has basic information about a customer, as well as some derived facts based on a customer's orders
56

6-
columns:
7-
- name: customer_id
8-
description: This is a unique identifier for a customer
9-
tests:
7+
columns :
8+
- name : customer_id
9+
description : This is a unique identifier for a customer
10+
tests :
1011
- unique
1112
- not_null
1213

13-
data_type: INTEGER
14-
- name: first_name
15-
description: Customer's first name. PII.
16-
data_type: VARCHAR
17-
- name: last_name
18-
description: Customer's last name. PII.
19-
data_type: VARCHAR
20-
- name: first_order
21-
description: Date (UTC) of a customer's first order
22-
data_type: DATE
23-
- name: most_recent_order
24-
description: Date (UTC) of a customer's most recent order
25-
data_type: DATE
26-
- name: number_of_orders
27-
description: Count of the number of orders a customer has placed
28-
data_type: BIGINT
29-
- name: customer_lifetime_value
30-
data_type: DOUBLE
31-
- name: customer_average_value
32-
data_type: DECIMAL(18,3)
14+
data_type : INTEGER
15+
- {name : first_name, description : Customer's first name. PII., data_type : VARCHAR}
16+
- {name : last_name, description : Customer's last name. PII., data_type : VARCHAR}
17+
- {name : first_order, description : Date (UTC) of a customer's first order, data_type : DATE}
18+
- {name : most_recent_order, description : Date (UTC) of a customer's most recent order, data_type : DATE}
19+
- {name : number_of_orders, description : Count of the number of orders a customer has placed, data_type : BIGINT}
20+
- {name : customer_lifetime_value, data_type : DOUBLE}
21+
- {name : customer_average_value, data_type : 'DECIMAL(18,3)'}

‎demo_duckdb/models/jaffle_shop/main/orders.yml‎

Lines changed: 42 additions & 43 deletions
Original file line numberDiff line numberDiff line change
@@ -1,59 +1,58 @@
1+
---
12
version: 2
23
models:
3-
- name: orders
4-
description: This table has basic information about orders, as well as some derived facts based on payments
4+
- name : orders
5+
description : This table has basic information about orders, as well as some derived facts based on payments
56

6-
columns:
7-
- name: order_id
8-
tests:
7+
columns :
8+
- name : order_id
9+
tests :
910
- unique
1011
- not_null
11-
description: This is a unique identifier for an order
12-
data_type: INTEGER
13-
- name: customer_id
14-
description: Foreign key to the customers table
15-
tests:
12+
description : This is a unique identifier for an order
13+
data_type : INTEGER
14+
- name : customer_id
15+
description : Foreign key to the customers table
16+
tests :
1617
- not_null
17-
- relationships:
18-
to: ref('customers')
19-
field: customer_id
18+
- relationships :
19+
to : ref('customers')
20+
field : customer_id
2021

21-
data_type: INTEGER
22-
- name: order_date
23-
description: Date (UTC) that the order was placed
24-
data_type: DATE
25-
- name: status
26-
tests:
27-
- accepted_values:
28-
values: ['placed', 'shipped', 'completed', 'return_pending', 'returned']
22+
data_type : INTEGER
23+
- {name : order_date, description : Date (UTC) that the order was placed, data_type : DATE}
24+
- name : status
25+
tests :
26+
- accepted_values :
27+
values : ['placed', 'shipped', 'completed', 'return_pending', 'returned']
2928

30-
description: '{{ doc("orders_status") }}'
31-
data_type: VARCHAR
32-
- name: credit_card_amount
33-
description: Amount of the order (AUD) paid for by credit card
34-
tests:
29+
description : '{{ doc("orders_status") }}'
30+
data_type : VARCHAR
31+
- name : credit_card_amount
32+
description : Amount of the order (AUD) paid for by credit card
33+
tests :
3534
- not_null
3635

37-
data_type: DOUBLE
38-
- name: coupon_amount
39-
description: Amount of the order (AUD) paid for by coupon
40-
tests:
36+
data_type : DOUBLE
37+
- name : coupon_amount
38+
description : Amount of the order (AUD) paid for by coupon
39+
tests :
4140
- not_null
4241

43-
data_type: DOUBLE
44-
- name: bank_transfer_amount
45-
description: Amount of the order (AUD) paid for by bank transfer
46-
tests:
42+
data_type : DOUBLE
43+
- name : bank_transfer_amount
44+
description : Amount of the order (AUD) paid for by bank transfer
45+
tests :
4746
- not_null
4847

49-
data_type: DOUBLE
50-
- name: gift_card_amount
51-
description: Amount of the order (AUD) paid for by gift card
52-
tests:
48+
data_type : DOUBLE
49+
- name : gift_card_amount
50+
description : Amount of the order (AUD) paid for by gift card
51+
tests :
5352
- not_null
54-
data_type: DOUBLE
55-
- name: amount
56-
description: Total amount (AUD) of the order
57-
tests:
53+
data_type : DOUBLE
54+
- name : amount
55+
description : Total amount (AUD) of the order
56+
tests :
5857
- not_null
59-
data_type: DOUBLE
58+
data_type : DOUBLE

‎demo_duckdb/models/jaffle_shop/main/orders_prefix.yml‎

Lines changed: 14 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -1,23 +1,16 @@
1+
---
12
version: 2
23
models:
3-
- name: orders_prefix
4-
columns:
5-
- name: o_order_id
6-
data_type: INTEGER
7-
- name: o_customer_id
8-
data_type: INTEGER
9-
- name: o_order_date
10-
data_type: DATE
11-
- name: o_status
12-
description: '{{ doc("orders_status") }}'
13-
data_type: VARCHAR
14-
- name: o_credit_card_amount
15-
data_type: DOUBLE
16-
- name: o_coupon_amount
17-
data_type: DOUBLE
18-
- name: o_bank_transfer_amount
19-
data_type: DOUBLE
20-
- name: o_gift_card_amount
21-
data_type: DOUBLE
22-
- name: o_amount
23-
data_type: DOUBLE
4+
- name : orders_prefix
5+
columns :
6+
- {name : o_order_id, data_type : INTEGER}
7+
- {name : o_customer_id, data_type : INTEGER}
8+
- {name : o_order_date, data_type : DATE}
9+
- name : o_status
10+
description : '{{ doc("orders_status") }}'
11+
data_type : VARCHAR
12+
- {name : o_credit_card_amount, data_type : DOUBLE}
13+
- {name : o_coupon_amount, data_type : DOUBLE}
14+
- {name : o_bank_transfer_amount, data_type : DOUBLE}
15+
- {name : o_gift_card_amount, data_type : DOUBLE}
16+
- {name : o_amount, data_type : DOUBLE}

‎demo_duckdb/models/staging/jaffle_shop/main/stg_customers.yml‎

Lines changed: 8 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,13 @@
1+
---
12
version: 2
23
models:
3-
- name: stg_customers
4-
columns:
5-
- name: customer_id
6-
tests:
4+
- name : stg_customers
5+
columns :
6+
- name : customer_id
7+
tests :
78
- unique
89
- not_null
910

10-
data_type: INTEGER
11-
- name: first_name
12-
data_type: VARCHAR
13-
- name: last_name
14-
data_type: VARCHAR
11+
data_type : INTEGER
12+
- {name : first_name, data_type : VARCHAR}
13+
- {name : last_name, data_type : VARCHAR}

‎demo_duckdb/models/staging/jaffle_shop/main/stg_orders.yml‎

Lines changed: 14 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,19 @@
1+
---
12
version: 2
23
models:
3-
- name: stg_orders
4-
columns:
5-
- name: order_id
6-
tests:
4+
- name : stg_orders
5+
columns :
6+
- name : order_id
7+
tests :
78
- unique
89
- not_null
9-
data_type: INTEGER
10-
- name: customer_id
11-
data_type: INTEGER
12-
- name: order_date
13-
data_type: DATE
14-
- name: status
15-
tests:
16-
- accepted_values:
17-
values: ['placed', 'shipped', 'completed', 'return_pending', 'returned']
10+
data_type : INTEGER
11+
- {name : customer_id, data_type : INTEGER}
12+
- {name : order_date, data_type : DATE}
13+
- name : status
14+
tests :
15+
- accepted_values :
16+
values : ['placed', 'shipped', 'completed', 'return_pending', 'returned']
1817

19-
data_type: VARCHAR
20-
description: '{{ doc("orders_status") }}'
18+
data_type : VARCHAR
19+
description : '{{ doc("orders_status") }}'

‎demo_duckdb/models/staging/jaffle_shop/main/stg_payments.yml‎

Lines changed: 13 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,17 @@
1+
---
12
version: 2
23
models:
3-
- name: stg_payments
4-
columns:
5-
- name: payment_id
6-
tests:
4+
- name : stg_payments
5+
columns :
6+
- name : payment_id
7+
tests :
78
- unique
89
- not_null
9-
data_type: integer
10-
- name: order_id
11-
data_type: integer
12-
- name: payment_method
13-
tests:
14-
- accepted_values:
15-
values: ["credit_card", "coupon", "bank_transfer", "gift_card"]
16-
data_type: varchar
17-
- name: amount
18-
data_type: double
10+
data_type : integer
11+
- {name : order_id, data_type : integer}
12+
- name : payment_method
13+
tests :
14+
- accepted_values :
15+
values : ["credit_card", "coupon", "bank_transfer", "gift_card"]
16+
data_type : varchar
17+
- {name : amount, data_type : double}

‎demo_duckdb/seeds/jaffle_shop/main/raw_customers.yml‎

Lines changed: 8 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,10 @@
1+
---
12
version: 2
23
seeds:
3-
- name: raw_customers
4-
meta:
5-
foo: bar
6-
columns:
7-
- name: id
8-
data_type: INTEGER
9-
- name: first_name
10-
data_type: VARCHAR
11-
- name: last_name
12-
data_type: VARCHAR
4+
- name : raw_customers
5+
meta :
6+
foo : bar
7+
columns :
8+
- {name : id, data_type : INTEGER}
9+
- {name : first_name, data_type : VARCHAR}
10+
- {name : last_name, data_type : VARCHAR}

‎demo_duckdb/seeds/jaffle_shop/main/raw_orders.yml‎

Lines changed: 9 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,11 @@
1+
---
12
version: 2
23
seeds:
3-
- name: raw_orders
4-
columns:
5-
- name: id
6-
data_type: INTEGER
7-
- name: user_id
8-
data_type: INTEGER
9-
- name: order_date
10-
data_type: DATE
11-
- name: status
12-
description: '{{ doc("orders_status") }}'
13-
data_type: VARCHAR
4+
- name : raw_orders
5+
columns :
6+
- {name : id, data_type : INTEGER}
7+
- {name : user_id, data_type : INTEGER}
8+
- {name : order_date, data_type : DATE}
9+
- name : status
10+
description : '{{ doc("orders_status") }}'
11+
data_type : VARCHAR

‎demo_duckdb/seeds/jaffle_shop/main/raw_payments.yml‎

Lines changed: 7 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,9 @@
1+
---
12
version: 2
23
seeds:
3-
- name: raw_payments
4-
columns:
5-
- name: id
6-
data_type: INTEGER
7-
- name: order_id
8-
data_type: INTEGER
9-
- name: payment_method
10-
data_type: VARCHAR
11-
- name: amount
12-
data_type: INTEGER
4+
- name : raw_payments
5+
columns :
6+
- {name : id, data_type : INTEGER}
7+
- {name : order_id, data_type : INTEGER}
8+
- {name : payment_method, data_type : VARCHAR}
9+
- {name : amount, data_type : INTEGER}

0 commit comments

Comments
 (0)