Skip to content

Commit 7bed725

Browse files
authored
[filesystem] Not bundle obs & gfs into fluss dist (#1737)
1 parent 640f40c commit 7bed725

File tree

4 files changed

+18
-29
lines changed

4 files changed

+18
-29
lines changed

fluss-dist/pom.xml

Lines changed: 0 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -61,20 +61,6 @@
6161
<scope>provided</scope>
6262
</dependency>
6363

64-
<dependency>
65-
<groupId>org.apache.fluss</groupId>
66-
<artifactId>fluss-fs-gs</artifactId>
67-
<version>${project.version}</version>
68-
<scope>provided</scope>
69-
</dependency>
70-
71-
<dependency>
72-
<groupId>org.apache.fluss</groupId>
73-
<artifactId>fluss-fs-obs</artifactId>
74-
<version>${project.version}</version>
75-
<scope>provided</scope>
76-
</dependency>
77-
7864
<!-- metrics plugin -->
7965
<dependency>
8066
<groupId>org.apache.fluss</groupId>

fluss-dist/src/main/assemblies/plugins.xml

Lines changed: 0 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -45,19 +45,6 @@
4545
<files>
4646
<!-- filesystem -->
4747
<!-- output directory should correspond to the file system *schema* name, i.e., plugins/<schema>/ -->
48-
<file>
49-
<source>../fluss-filesystems/fluss-fs-obs/target/fluss-fs-obs-${project.version}.jar</source>
50-
<outputDirectory>plugins/obs/</outputDirectory>
51-
<destName>fluss-fs-obs-${project.version}.jar</destName>
52-
<fileMode>0644</fileMode>
53-
</file>
54-
<file>
55-
<source>../fluss-filesystems/fluss-fs-gs/target/fluss-fs-gs-${project.version}.jar</source>
56-
<outputDirectory>plugins/gs/</outputDirectory>
57-
<destName>fluss-fs-gs-${project.version}.jar</destName>
58-
<fileMode>0644</fileMode>
59-
</file>
60-
6148
<file>
6249
<source>../fluss-filesystems/fluss-fs-hadoop/target/fluss-fs-hadoop-${project.version}-with-dependencies.jar</source>
6350
<outputDirectory>plugins/hdfs/</outputDirectory>

website/docs/maintenance/filesystems/obs.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,22 @@ sidebar_position: 6
77

88
[HuaweiCloud Object Storage Service](https://www.huaweicloud.com/product/obs.html) (HuaweiCloud OBS) is an enterprise-grade object storage solution delivering industry-leading scalability, data durability, security, and cost-efficiency. Trusted by organizations across finance, healthcare, manufacturing, and media, OBS enables you to securely store, manage, analyze, and protect unlimited data volumes for diverse scenarios like AI training, data lakes, multi-cloud backup, and real-time media processing.
99

10+
## Install OBS Plugin Manually
11+
12+
HuaweiCloud OBS support is not included in the default Fluss distribution. To enable OBS support, you need to manually install the filesystem plugin into Fluss.
13+
14+
1. **Prepare the plugin JAR**:
15+
16+
- Download the `fluss-fs-obs-$FLUSS_VERSION$.jar` from the [Maven Repository](https://repo1.maven.org/maven2/org/apache/fluss/fluss-fs-obs/$FLUSS_VERSION$/fluss-fs-obs-$FLUSS_VERSION$.jar).
17+
18+
2. **Place the plugin**: Place the plugin JAR file in the `${FLUSS_HOME}/plugins/obs/` directory:
19+
```bash
20+
mkdir -p ${FLUSS_HOME}/plugins/obs/
21+
cp fluss-fs-obs-$FLUSS_VERSION$.jar ${FLUSS_HOME}/plugins/obs/
22+
```
23+
24+
3. Restart Fluss if the cluster is already running to ensure the new plugin is loaded.
25+
1026
## Configurations setup
1127

1228
To enabled HuaweiCloud OBS as remote storage, there are some required configurations that must be added to Fluss' `server.yaml`:

website/docs/maintenance/filesystems/overview.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,14 +28,14 @@ Never use local file system as remote storage in production as it is not fault-t
2828
:::
2929
3030
## Pluggable File Systems
31-
The Fluss project supports the following file system:
31+
The Fluss project supports the following file systems:
3232
3333
- **[HDFS](hdfs.md)** is supported by `fluss-fs-hadoop` and registered under the `hdfs://` URI scheme.
3434

3535
- **[Aliyun OSS](oss.md)** is supported by `fluss-fs-oss` and registered under the `oss://` URI scheme.
3636

3737
- **[AWS S3](s3.md)** is supported by `fluss-fs-s3` and registered under the `s3://` URI scheme.
3838

39-
- **[HuaweiCloud OBS](obs.md)** is supported by `fluss-fs-obs` and registered under the `obs://` URI scheme.
39+
- **[HuaweiCloud OBS](obs.md)** is supported by `fluss-fs-obs` and registered under the `obs://` URI scheme. Please make sure to [manually install the OBS plugin](obs.md#install-obs-plugin-manually).
4040

4141
The implementation is based on [Hadoop Project](https://hadoop.apache.org/) but is self-contained with no dependency footprint.

0 commit comments

Comments
 (0)