4.8.0

What's Changed

• [FSTORE-1965] shadowing variable fix by @jimdowling in #812
• Prepare for 4.8.0-SNAPSHOT by @robzor92 in #815
• [FSTORE-1717][APPEND] Adding unit tests for fetching PreparedStatements for feature vector retrieval by @manu-sj in #808
• [HWORKS-2233][APPEND] mandatory tags - malformed tags handling by @o-alex in #821
• [HWORKS-2590] Revamp multi-user certificate handling for better backwards compatibility by @robzor92 in #820
• [FSTORE-1778] Unit Testing of Transformation Functions by @manu-sj in #781
• [HWORKS-2011] Improve printed messages in serving_engine.py by @javierdlrm in #823
• [HWORKS-2213] Inform users when registering a model moves the model files by @javierdlrm in #824
• [HWORKS-2340] Validate model name before moving/copying files by @javierdlrm in #825
• [FSTORE-1946] Share Datasets with other projects by @bubriks in #811
• [FSTORE-1943] Test filtering of different data type in feature group by @kennethmhc in #787
• [FSTORE-1963] Unable to set timeout in online_ingestion_options by @bubriks in #829
• HOPSFS-329: Update hops-deltalake to 1.4.0 by @hamidgh09 in #827
• [HWORKS-2391] Dlthub by @gibchikafa in #782
• [FSTORE-1946][APPEND] Allow for empty 'hopsfs_path' in HopsFS connector by @bubriks in #836
• [FSTORE-1979] All previous hudi commits show up as archived by @bubriks in #837
• [FSTORE-1551] Use aliases by @aversey in #788
• Revert "[FSTORE-1551] Use aliases (#788)" by @robzor92 in #839
• [FSTORE-1795] Update api to use data source and deprecate direct storage connector usage by @bubriks in #621
• [FSTORE-1971] Change FG topic after it is created by @bubriks in #830
• [FSTORE-1961] add force delete param to feature view delete api by @dhananjay-mk in #807
• [FSTORE-1551] Use aliases & remove redundant docs by @aversey in #838
• [FSTORE-1946][APPEND] Fix reading training datasets by @bubriks in #844
• [FSTORE-1984] Hopsworks Flink client throws a Null Pointer Error when trying insert into a feature group using Plain text authentication Kafka by @manu-sj in #843
• [FSTORE-1795][APPEND] Fix getting features from JDBC connector for external FG by @bubriks in #849
• [FSTORE-1978] Allow for online ingestion without count by @bubriks in #841
• [HWORKS-2609] Migrate to path-based routing inference by @javierdlrm in #833
• [HWORKS-2648] Bump HopsFS version by @kouzant in #852
• [FSTORE-1977] Fix documentation for default time travel format. by @bubriks in #853
• [FSTORE-1987] fix feature group insert by @bubriks in #854
• Improve the docs by @aversey in #851
• [FSTORE-1980] allow for mysql in addition to postgres connector for sql by @bubriks in #845
• [HWORKS-2658] Support partition scoped writes and append writes in delta FGs by @robzor92 in #856
• [FSTORE-1778][APPEND] Fix accessing features as attributes from an external feature group object by @manu-sj in #857
• [HWORKS-2656] hopsworks.login() should connect to saas by default by @robzor92 in #858
• [HWORKS-2391][APPEND] Dlthub improvements: Add optimisation configs by @gibchikafa in #842
• Add agent docs by @aversey in #866
• [FSTORE-1996] Using hive even when using spark-no-metastore engine by @bubriks in #870
• [FSTORE-1988] Query add limit by @bubriks in #860
• Upgrade deps, add docs CLI by @aversey in #872
• [HWORKS-2618] trino api by @ErmiasG in #865
• Move agent docs by @aversey in #876
• [FSTORE-1961][APPEND] add FV force delete param to java client by @dhananjay-mk in #855
• [HWORKS-2618]-append fix for docs by @ErmiasG in #877
• [FSTORE-1994] Duplicate column error when inserting to a feature group with event_time in the composite primary_key by @manu-sj in #863
• [FSTORE-1954] Parameterize feature group reading with start and end times by @jimdowling in #799
• HOPSFS-339: hops version 3.2.0.19-EE-RC0 by @smkniazi in #881
• [HWORKS-2695] job.run(await_termination=True) should raise an exception if the execution fails by @robzor92 in #883
• [FSTORE-2008] Fix similarity search timezone issue by @bubriks in #885

Full Changelog: 4.7.0...4.8.0

4.7.0

What's Changed

• [FSTORE-1906] Improve online schema validation by @bubriks in #718
• [FSTORE-1900] Insert DataFrame with duplicate in PK in Delta FG leads to row duplication by @kennethmhc in #723
• Use uv by @aversey in #726
• [FSTORE-1906][APPEND] Disable schema validation when writing feature logs by @manu-sj in #725
• [FSTORE-1914] Allow pandas UDF's returning one feature to return it as Pandas DataFrame with one column by @manu-sj in #730
• Prepare for 4.7.0-SNAPSHOT by @robzor92 in #733
• [APPEND][FSTORE-1900] Fix fg.time_travel_format when calling from external feature group by @kennethmhc in #734
• [FSTORE-1870] Add the missing public docs by @aversey in #677
• [FSTORE-1920] Set stream to True if provided by @kennethmhc in #736
• [FSTORE-1922] Save features metadata in delta fg by @kennethmhc in #737
• [FSTORE-1925] delta casting from timestamp exception when precision loss by @bubriks in #739
• [APPEND][FSTORE-1922] Improve no data error message by @kennethmhc in #743
• [FSTORE-1438] support key pair auth for snowflake connector by @dhananjay-mk in #719
• [FSTORE-1907] Enable changeDataFeed by default + support load_cdf for DELTA by @vatj in #721
• [FSTORE-1805][APPEND] Engine.add_file() got an unexpected keyword argument 'distribute' by @bubriks in #751
• [HWORKS-2501] Set upper version bound for fsspec dependency by @robzor92 in #755
• [FSTORE-1867] Do not decode complex feature in spine group by @kennethmhc in #676
• [FSTORE-1921] Improve documentation building process by @aversey in #738
• [FSTORE-1799] Make hopsworks work with flink v1 and flink v2 by @bubriks in #620
• [FSTORE-1799][APPEND] Dont exclude avro from hsfs in spark for Hudi compatibility by @bubriks in #776
• [FSTORE-1917] federated opensearch by @kennethmhc in #766
• [FSTORE-1905] Feature group / feature level sharing between projects by @SirOibaf in #768
• [FSTORE-1905] Fix HQS payload for create_training_data method by @SirOibaf in #780
• [HWORKS-2556] Multiple python clients connecting from the same environment to the same project will overwrite each others certificates by @robzor92 in #789
• [BREWER-145] Move Brewer execute into Hopsworks MCP server by @aversey in #770
• [HWORKS-2390] Support both numpy 1.x and 2.x by @robzor92 in #792
• [HWORKS-2568] Change certificates folder for external clients to a random folder in /tmp and make certificates only readable by user by @robzor92 in #797
• [FSTORE-1950] Add charts from hopsworks API by @bubriks in #796
• [FSTORE-1717] Allow transformation functions to directly read features selected as helper columns instead requiring to pass them manually as request parameters by @manu-sj in #800
• [HWORKS-2390][APPEND] Also allow pandas 1.26.3 so the change can be backported by @robzor92 in #803
• [HWORKS-2232] search by tags and keywords by @o-alex in #724
• HOPSFS-326: Release HopsFS 3.2.0.18 by @smkniazi in #798
• [HWORKS-2502] Add autoscaling configurations to Kserve deployments by @gibchikafa in #775
• [HWORKS-2233] mandatory tags by @o-alex in #810

Full Changelog: 4.6.0...4.7.0

4.6.3

What's Changed

• [HWORKS-2390] Support both numpy 1.x and 2.x (#792) by @robzor92 in #804
• [FSTORE-1717][4.6] Allow transformation functions to directly read features selected as helper columns instead requiring to pass them manually as request parameter by @manu-sj in #805
• [HWORKS-2502] Add autoscaling configurations to Kserve deployments (#… by @gibchikafa in #809
• Release 4.6.3 by @robzor92 in #806

Full Changelog: 4.6.2...4.6.3

4.6.2

What's Changed

• [FSTORE-1905] Revert by @bubriks in #794
• Release 4.6.2 by @robzor92 in #795

Full Changelog: 4.6.1...4.6.2

4.6.1

What's Changed

• [FSTORE-1867] Do not decode complex feature in spine group (4.6) by @kennethmhc in #759
• [FSTORE-1799] Make hopsworks work with flink v1 and flink v2 (#620) by @SirOibaf in #774
• [FSTORE-1799][APPEND] Dont exclude avro from hsfs in spark for Hudi compatibility by @bubriks in #777
• [FSTORE-1917] federated opensearch (4.6) by @kennethmhc in #779
• Revert "[FSTORE-1917] federated opensearch (4.6) (#779)" by @robzor92 in #786
• [FSTORE-1905] Feature group / feature level sharing between projects by @bubriks in #790
• Release 4.6.1 by @robzor92 in #793

Full Changelog: 4.6.0...4.6.1

4.6.0

What's Changed

• [FSTORE-1791] Add method to return strongly typed object from feature vector in java by @bubriks in #595
• Prepare for 4.6.0-SNAPSHOT by @SirOibaf in #611
• [FSTORE-1802] Change regex to enable replacing host dns provided by consul by @vatj in #616
• [FSTORE-1754] enable managed fg on gcs for delta table by @dhananjay-mk in #573
• [FSTORE-1800] Add support for pojo objects in flink client by @SirOibaf in #618
• [FSTORE-1805] Using multiple Kafka connectors from the same Spark session doens't work by @SirOibaf in #623
• [FSTORE-1731] Time-to-Live (TTL) for Feature Group by @bubriks in #622
• Fix Kafka connector when reading data for BYOK by @SirOibaf in #626
• HOPSFS-268: Bump Hops Hadoop Version to 3.2.0.17-EE-RC1 by @smkniazi in #628
• [HWORKS-1810] Add support for reading from Python from S3 compliant s… by @SirOibaf in #630
• Hopsworks mcp by @ErmiasG in #598
• [FSTORE-1816] Fix join_type documentation by @SirOibaf in #636
• HOPSFS-273: pass all fs.s3a.* params to spark hadoop by @smkniazi in #638
• [FSTORE-1805][APPEND] allow multiple calls for kafka connector spark_options by @bubriks in #640
• [FSTORE-1806] FG simple specification if online data stored in memory or disk by @bubriks in #641
• [HWORKS-2139] search api by @ErmiasG in #555
• [FSTORE-1829] Flink applications are not recoverable by @SirOibaf in #645
• [HWORKS-2204][HWORKS-2203] Upgrade to Hudi 1.0.2 and Spark 3.5.5 by @gibchikafa in #582
• [FSTORE-1807] get_feature_vector does not return a pandas dataframe with correct Data Types by @manu-sj in #649
• [FSTORE-1845][HOPSFS-282] Revert Spark session hard kill and upgrade HopsFS version by @vatj in #652
• [FSTORE-1846] Spine feature groups cannot be joined with Delta featur… by @SirOibaf in #653
• [FSTORE-1848] HQS override_hostname doesn't work with custom consul d… by @SirOibaf in #656
• [HOPSFS-282] Bump slf4j in hsfs-parent to match hopsfs 3.2.0.17-EE-RC3 by @vatj in #657
• [HWORKS-2317] Add dataset api list function by @robzor92 in #643
• [FSTORE-1857] Enable get feature vector for spine group by @kennethmhc in #660
• [FSTORE-1617] Integrate delta-rs HopsFS writer to hsfs python client by @kennethmhc in #583
• [FSTORE-1617][APPEND] Integrate delta-rs HopsFS writer to hsfs python client by @kennethmhc in #664
• [FSTORE-1617][APPEND] Integrate delta-rs HopsFS writer to hsfs python client by @kennethmhc in #666
• [HWORKS-2379] Drop python 3.8 client support by @robzor92 in #669
• [FSTORE-1617][APPEND] Fix unable to write in internal python client by @kennethmhc in #667
• [FSTORE-1864] remove reconcile_schema from client reading by @bubriks in #668
• [HWORKS-2347] Run hopsworks api unit tests in python 3.11 and 3.12 by @robzor92 in #648
• [FSTORE-1774] Support python 3.13 by @robzor92 in #671
• [FSTORE-1863] Delta insert triggers FeatureStoreException: 'numTargetRowsInserted' by @bubriks in #665
• [HWORKS-2365] Url encode branch by @gibchikafa in #661
• [FSTORE-1872] Cast float16 to float32 for deltalake input by @kennethmhc in #681
• [HWORKS-2395] Fails to create a pyspark notebook job using the python api by @robzor92 in #678
• [FSTORE-1869] Add stats compute on insertion into delta FG by @vatj in #680
• [FSTORE-1617][APPEND] Fix unable to write to delta s3 by @kennethmhc in #674
• [FSTORE-1863][APPEND] Different fields in spark delta and delta rs by @bubriks in #690
• [FSTORE-1875] Add feature_group_id to connector map to use in cache key for arrowflight by @vatj in #687
• [FSTORE-1877] Add delta catalog to update schema operation by @kennethmhc in #691
• [FSTORE-1874] Exception when snowflake storage connector is missing Schema field by @bubriks in #686
• [FSTORE-1868] HUDI preview is broken after appending columns by @bubriks in #696
• [FSTORE-1882] Improve error message when getting kafka offsets for delta table by @bubriks in #697
• [FSTORE-1617] S3 connector options support path style and use ssl for HQS by @vatj in #698
• [FSTORE-1869][APPEND] Compute statistics in client to avoid starting a job by @vatj in #699
• [HWORKS-1186] Support for model-less deployments by @javierdlrm in #688
• [FSTORE-1871] Feature logging improvements by @manu-sj in #675
• [FSTORE-1885] Reading from a hudi FG with no commits throws confusing error message by @bubriks in #704
• [FSTORE-1869] Statistics fix by @vatj in #706
• [FSTORE-1871][APPEND] Feature logging improvements by @manu-sj in #701
• [FSTORE-1893] Writing using spark to offline stream feature group fails if complex type has all null values by @manu-sj in #702
• [FSTORE-1894] Default to DELTA unless delta-rs/deltalake jar not installed by @vatj in #705
• [FSTORE-1895] On-Demand Transformation functions fails with DELTA feature groups by @manu-sj in #707
• [FSTORE-1824] Spark client ignores user provided options when reading… by @SirOibaf in #642
• Update pypi build image by @robzor92 in #713
• Revert "[FSTORE-1894][REVERT] Default back to HUDI for non-offline python FG by @vatj in #716
• [FSTORE-1894][REVERT-THE-REVERT] Use DELTA as default datalake format by @vatj in #717
• [FSTORE-1897] DELTA materialization Jobs fail if the feature group contains a struct by @manu-sj in #715
• [FSTORE-1894][APPEND] Pin the hops-deltalake version by @vatj in #720
• [FSTORE-1871][APPEND-2] Enable logging using pandas Dataframes in Spark Kernel by @manu-sj in #722
• [FSTORE-1906] Improve online schema validation by @bubriks in #727
• [FSTORE-1900] Insert DataFrame with duplicate in PK in Delta FG leads to row duplication (4.6) by @kennethmhc in #729
• [FSTORE-1906][APPEND][4.6] Disable schema validation when writing feature logs by @manu-sj in #731
• [APPEND][FSTORE-1900] Fix fg.time_travel_format when calling from external feature group (4.6) by @kennethmhc in #735
• [FSTORE-1914][4.6] Allow pandas UDF's returning one feature to return it as Pandas DataFrame with one column by @manu-sj in #732
• [FSTORE-1925] delta casting from timestamp exception when precision loss by @bubriks in #740
• [FSTORE-1870] Add the missing public docs (#677) by @robzor92 in #742
• Delta fixes by @robzor92 in #741
• Cherry pick 4.6 by @robzor92 in #746
• [FSTORE-1805][APPEND] Engine.add_file() got an unexpected keyword argument 'distribute' by @bubriks in #753
• [HWORKS-2501] Set upper ...

4.5.0-RC8

What's Changed

• [HWORKS-2395] Fails to create a pyspark notebook job using the python api (#678) by @robzor92 in #695
• Update pypi build image by @robzor92 in #711
• [FSTORE-1906] Improve online schema validation by @bubriks in #728
• [FSTORE-1867] Do not decode complex feature in spine group (4.5) by @kennethmhc in #750

Full Changelog: 4.5.0-RC7...4.5.0-RC8

4.5.0-RC7

What's Changed

• [FSTORE-1864] remove reconcile_schema from client reading by @bubriks in #670
• [FSTORE-1863] Delta insert triggers FeatureStoreException: 'numTargetRowsInserted' by @bubriks in #672
• Release 4.5.0-RC7 by @SirOibaf in #673

Full Changelog: 4.5.0-RC6...4.5.0-RC7

4.5.0-RC6

What's Changed

• [HWORKS-2317] Add dataset api list function (#643) by @robzor92 in #663

Full Changelog: 4.5.0-RC5...4.5.0-RC6

4.5.0-RC5

What's Changed

• [FSTORE-1857] Enable get feature vector for spine group v4.5 (#660) by @kennethmhc in #662

Full Changelog: https://github.com/logicalclocks/hopsworks-api/commits/4.5.0-RC5