You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To allow for easy adoption, you can use the same configuration keys in Fluss' server.yaml as in Hadoop's `core-site.xml`.
37
-
You can see the configuration keys in Hadoop's [`core-site.xml`](https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/core-default.xml).
38
-
39
-
40
-
41
-
42
-
43
-
34
+
### Configure Hadoop related configurations
35
+
36
+
Sometimes, you may want to configure how Fluss accesses your Hadoop filesystem, Fluss supports three methods for loading Hadoop configuration, listed in order of priority (highest to lowest):
37
+
38
+
1. **Fluss Configuration with `fluss.hadoop.*` Prefix.** Any configuration key prefixed with `fluss.hadoop.` in your `server.yaml` will be passed directly to Hadoop configuration, with the prefix stripped.
39
+
2. **Environment Variables.** The system automatically searches for Hadoop configuration files in these locations:
40
+
- `$HADOOP_CONF_DIR`(if set)
41
+
- `$HADOOP_HOME/conf`(if HADOOP_HOME is set)
42
+
- `$HADOOP_HOME/etc/hadoop`(if HADOOP_HOME is set)
43
+
3. **Classpath Loading.** Configuration files (`core-site.xml`, `hdfs-site.xml`) found in the classpath are loaded automatically.
44
+
45
+
#### Configuration Examples
46
+
Here's an example of setting up the hadoop configuration in server.yaml:
47
+
48
+
```yaml title="conf/server.yaml"
49
+
# The all following hadoop related configurations is just for a demonstration of how
50
+
# to configure hadoop related configurations in `server.yaml`, you may not need configure them
51
+
52
+
# Basic HA Hadoop configuration using fluss.hadoop.* prefix
0 commit comments