You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: website/docs/streaming-lakehouse/integrate-data-lakes/lance.md
+12-19Lines changed: 12 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,22 +10,18 @@ To integrate Fluss with Lance, you must enable lakehouse storage and configure L
10
10
11
11
## Introduction
12
12
13
-
When a table is created or altered with the option `'table.datalake.enabled' = 'true'`, Fluss will automatically create a corresponding Lance table with table path `<warehouse_path>/<database_name>/<table_name>.lance`.
13
+
When a table is created or altered with the option `'table.datalake.enabled' = 'true'`, Fluss will automatically create a corresponding Lance table with path `<warehouse_path>/<database_name>/<table_name>.lance`.
14
14
The schema of the Lance table matches that of the Fluss table.
15
15
16
16
```sql title="Flink SQL"
17
17
USE CATALOG fluss_catalog;
18
18
19
19
CREATETABLEfluss_order_with_lake (
20
-
`order_key`BIGINT,
21
-
`cust_key`INTNOT NULL,
22
-
`total_price`DECIMAL(15, 2),
23
-
`order_date`DATE,
24
-
`order_priority` STRING,
25
-
`clerk` STRING,
26
-
`ptime`AS PROCTIME(),
27
-
PRIMARY KEY (`order_key`) NOT ENFORCED
28
-
) WITH (
20
+
`order_id`BIGINT,
21
+
`item_id`BIGINT,
22
+
`amount`INT,
23
+
`address` STRING
24
+
) WITH (
29
25
'table.datalake.enabled'='true',
30
26
'table.datalake.freshness'='30s'
31
27
);
@@ -39,21 +35,18 @@ Since Fluss version 0.7, you can also specify Lance table properties when creati
39
35
40
36
```sql title="Flink SQL"
41
37
CREATETABLEfluss_order_with_lake (
42
-
`order_key`BIGINT,
43
-
`cust_key`INTNOT NULL,
44
-
`total_price`DECIMAL(15, 2),
45
-
`order_date`DATE,
46
-
`order_priority` STRING,
47
-
`clerk` STRING,
48
-
`ptime`AS PROCTIME()
38
+
`order_id`BIGINT,
39
+
`item_id`BIGINT,
40
+
`amount`INT,
41
+
`address` STRING
49
42
) WITH (
50
43
'table.datalake.enabled'='true',
51
44
'table.datalake.freshness'='30s',
52
-
'lance.'='orc'
45
+
'lance.max_row_per_file'='512'
53
46
);
54
47
```
55
48
56
-
For example, you can specify the Lance property `file.format` to change the file format of the Paimon table, or set `deletion-vectors.enabled`to enable or disable deletion vectors for the Paimon table.
49
+
For example, you can specify the property `max_row_per_file` to control the writing behavior when Fluss tiers data to Lance.
0 commit comments