Skip to content

Commit de84f06

Browse files
committed
docs
1 parent b7f45cf commit de84f06

1 file changed

Lines changed: 11 additions & 0 deletions

File tree

python/hsfs/storage_connector.py

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4608,6 +4608,17 @@ class GlueConnector(StorageConnector):
46084608
`client.region` properties — so the table is registered in the Glue Data
46094609
Catalog while the data stays on S3.
46104610
See [`GlueConnector.catalog_options`][hsfs.storage_connector.GlueConnector.catalog_options].
4611+
4612+
Note: Feature group path is optional when the Glue database has a location.
4613+
When creating a feature group from this connector and the Glue database has a location, the feature group path is generated automatically by appending the new table to that database location, so no path needs to be set.
4614+
Otherwise, the path must be set explicitly on the data source, for example:
4615+
4616+
```python
4617+
ds = fs.get_data_source("glue")
4618+
ds.path = "s3://mybucket/iceberg-warehouse/myglue.db/fg_1/"
4619+
```
4620+
4621+
An explicitly set path always takes precedence over the generated one.
46114622
"""
46124623

46134624
type = StorageConnector.GLUE

0 commit comments

Comments
 (0)