Skip to content

Commit b4a8715

Browse files
committed
improve docs
1 parent d8d9b3a commit b4a8715

File tree

2 files changed

+37
-21
lines changed

2 files changed

+37
-21
lines changed

website/docs/engine-flink/ddl.md

Lines changed: 30 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -221,6 +221,36 @@ DROP TABLE my_table;
221221
This will entirely remove all the data of the table in the Fluss cluster.
222222

223223
## Alter Table
224+
225+
### Add Columns
226+
227+
Fluss allows you to evolve a table's schema by adding new columns. This is a lightweight, metadata-only operation that offers the following benefits:
228+
229+
- **Zero Data Rewrite**: Adding a column does not require rewriting or migrating existing data files.
230+
- **Instant Execution**: The operation completes in milli-seconds, regardless of the table size.
231+
- **Availability**: The table remains online and fully accessible throughout schema evolution, with no disruption to active clients.
232+
233+
Currently, this feature has the following characteristics:
234+
235+
- **Position**: New columns are always appended to the end of the existing column list.
236+
- **Nullability**: Only nullable columns can be added to an existing table to ensure compatibility with existing data.
237+
- **Type Support**: You can add columns of any data type, including complex types such as `ROW`, `MAP`, and `ARRAY`.
238+
- **Nested Fields**: Currently, adding fields within an existing nested `ROW` is not supported. Such operations are categorized as "updating column types" and will be supported in future versions.
239+
240+
You can add a single column or multiple columns using the `ALTER TABLE statement.
241+
242+
```sql title="Flink SQL"
243+
-- Add a single column at the end of the table
244+
ALTER TABLE my_table ADD user_email STRING COMMENT 'User email address';
245+
246+
-- Add multiple columns at the end of the table
247+
ALTER TABLE MyTable ADD (
248+
user_email STRING COMMENT 'User email address',
249+
order_quantity INT
250+
);
251+
```
252+
253+
224254
### SET properties
225255
The SET statement allows users to configure one or more connector options including the [Storage Options](engine-flink/options.md#storage-options) for a specified table. If a particular option is already configured on the table, it will be overridden with the new value.
226256

@@ -247,19 +277,6 @@ The following example illustrates reset the `table.datalake.enabled` option to i
247277
```sql title="Flink SQL"
248278
ALTER TABLE my_table RESET ('table.datalake.enabled');
249279
```
250-
### Add Column At Last
251-
Currently, Fluss only supports adding Nullable columns at the end of the table.
252-
Below are examples demonstrating how to add columns:
253-
```sql title="Flink SQL"
254-
-- Add a single column at the end of the table
255-
ALTER TABLE my_table ADD user_email STRING COMMENT 'User email address';
256-
257-
-- Add multiple columns at the end of the table
258-
ALTER TABLE MyTable ADD (
259-
user_email STRING COMMENT 'User email address',
260-
order_quantity INT
261-
);
262-
```
263280

264281
## Add Partition
265282

website/docs/maintenance/operations/upgrade-notes-0.9.md

Lines changed: 7 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -7,16 +7,15 @@ sidebar_position: 4
77

88
These upgrade notes discuss important aspects, such as configuration, behavior, or dependencies, that changed between Fluss 0.8 and Fluss 0.9. Please read these notes carefully if you are planning to upgrade your Fluss version to 0.9.
99

10-
## Add Column At Last.
11-
If you're only upgrading to Fluss v0.9 without modifying table schemas, you can safely skip this section.
10+
## Adding Columns
1211

13-
However, If you plan to add columns to existing tables, follow these mandatory steps:
14-
1. Upgrade all Fluss servers to v0.9
15-
Ensure complete server infrastructure is running v0.9 before attempting any schema modifications.
16-
2. Restart and upgrade Fluss client to v0.9
17-
Old clients are incompatible with mixed schema versions and cannot properly read data with different schemas. This includes flink job, tier service and java client.
12+
Fluss storage format was designed with schema evolution protocols from day one. Therefore, tables created in v0.8 or earlier can immediately benefit from the `ADD COLUMN` feature after upgrading to v0.9 without dropping and re-creating table.
13+
However, old clients (pre-v0.9) do not recognize the new schema versioning protocol. If an old client attempts to read data from a table that has undergone schema evolution, it may encounter decoding errors or data inaccessibility.
14+
Therefore, it is crucial to ensure that all Fluss servers and all clients interacting with the Fluss cluster are upgraded to v0.9 before performing any schema modifications.
1815

19-
**Skipping these steps when adding columns may result in schema inconsistency issues or data inaccessibility.**
16+
:::warning
17+
Attempting to add columns while older clients (v0.8 or below) are still actively reading from the table will lead to Schema Inconsistency and may crash your streaming pipelines.
18+
:::
2019

2120
## Deprecation / End of Support
2221

0 commit comments

Comments
 (0)