Skip to content

Commit f89bdfb

Browse files
committed
add direct memory usage note
1 parent 2f422b3 commit f89bdfb

File tree

1 file changed

+2
-0
lines changed
  • website/docs/streaming-lakehouse/integrate-data-lakes

1 file changed

+2
-0
lines changed

website/docs/streaming-lakehouse/integrate-data-lakes/lance.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -72,6 +72,8 @@ Additionally, when following the [Start Datalake Tiering Service](maintenance/ti
7272

7373
> **NOTE**: Fluss v0.8 only supports tiering log tables to Lance.
7474
75+
> **NOTE**: The Lance connector leverages the Arrow Java library, which operates on direct memory. So ensure sufficient off-heap memory for the Flink Task Manager by configuring the `taskmanager.memory.task.off-heap.size` parameter in `<FLINK_HOME>/conf/config.yaml`.
76+
7577
Then, the datalake tiering service continuously tiers data from Fluss to Lance. The parameter `table.datalake.freshness` controls the frequency that Fluss writes data to Lance tables. By default, the data freshness is 3 minutes.
7678

7779
You can also specify Lance table properties when creating a datalake-enabled Fluss table by using the `lance.` prefix within the Fluss table properties clause.

0 commit comments

Comments
 (0)