v2.7.0

release v2.7.0

SQL features

• SQL commands:
  • Supports vector index Top-N lookups in streaming queries, enabling MVs and sinks to enrich each row with nearest-neighbor results. #23288
  • Supports ALTER FRAGMENT ... SET PARALLELISM command to alter the parallelism of streaming fragments. #23523
  • Reduces reserved keywords in EXPLAIN options (e.g., BACKFILL, TRACE) by parsing them as identifiers.#23208
  • Adds schema name to name column in the output of SHOW [TABLE|VIEW|SOURCE|SINK|...] commands. #23119
  • When DROP/CANCEL takes longer than slow_ddl_notification_secs (30s), you can run RECOVER for immediate effect. #23613
  • Supports ALTER TABLE ... ADD COLUMN command on tables with incoming sinks.#23766
  • Supports querying vector index in append-only streaming. #23288
• SQL functions & operators:
  • Supports parsing STRUCT< > as empty struct type. #23099
  • Supports rw_cluster_id()  function to return the cluster's unique identifier as a VARCHAR. #23260
• System catalog:
  • Adds system catalog rw_recovery_info to display the database-level recovery state. #23728
  • Adds column parallelism_policy in system catalog rw_fragments. #23524

Connectors

• Breaking change: When decoding Protobuf messages, RisingWave returns NULL for missing optional fields and default values for all other fields. #23120
• Supports using CREATE SOURCE directly for UPSERT-format sources requiring a primary key, without creating a table first. #22856
• File sink now uses UUIDs instead of executor_id in output file names. #23981
• Supports on-demand manual refresh for Iceberg batch tables with position deletes and equity deletes. #23527
• Technical preview: Supports periodic automatic refresh for batch tables with persistent state tracking and improved observability. #23737
• Technical preview: Supports files-with-delete Iceberg compaction and introduces additional compaction parameters. #23660, #23809
• Supports Azure Data Lake Storage Gen2 for Iceberg sink when using REST catalog. #23350
• Supports configuring S3 and Glue with independent credentials for Iceberg connector when using Glue catalog. #23775
• Support assuming IAM roles for S3 and Glue when enable_config_load is enabled for Iceberg connector when using Glue catalog. #23788
• Supports key-pair authentication using RSA private keys for Snowflake sink. #23525
• Supports JDBC sink connector for SQL Server. #23416
• Changes the default value of commit_checkpoint_interval from 10 to 60 for Iceberg sink. #23552
• Supports is_exactly_once for Iceberg sink by default. #23553
• Supports vended credentials for Iceberg connector when using REST catalog. #23567
• Supports configuring postgres.is.aws.rds to specify if the upstream PostgreSQL is hosted on AWS RDS. #23420
• Supports using Base64-encoded JSON strings for BigQuery credentials. #23100
• Supports TLS connections to Redis sink using rediss:// protocol. #23223
• Supports Redis Streams for Redis sink. #23412
• Supports COPY (<query>) TO STDOUT syntax to load data from PostgreSQL tables. #23198
• Supports ack for Pulsar source, enabling control over broker resending of unacknowledged messages. #22158
• Supports force_compaction on sinks to enable buffering and compaction of updates when the stream key is the same as the primary key. #23681

Installation and deployment

• Counts the CPU cores of all nodes (instead of only compute nodes) in the cluster against the cpu_core_limit specified in the license key. #23390
• Changes cpu_core_limit in the license key to rwu_limit to limit both CPU cores and total cluster memory. #23403
• Breaking change: Requires the correct aud claim for authentication. #23155
• Supports LDAP authentication to verify users against an external LDAP directory server. #23150

Cluster configuration changes

• Adds session variable enable_index_selection to control whether to enable index selection for both streaming and batch queries. #23092
• Technical preview: Adds session variable enable_locality_backfill to control locality backfilling, which extends index-based optimizations to the entire backfill pipeline. #23275
• Adds configuration option RW_SSL_ENFORCE to control SSL enforcement for security. #23306

Assets

• Run this version from Docker:
  docker run -it --pull=always -p 4566:4566 -p 5691:5691 risingwavelabs/risingwave:v2.7.0-standalone single_node
• Prebuilt all-in-one library for Linux
• Source code (zip)
• Source code (tar.gz)
• risectl - a CLI tool for managing and accessing RisingWave clusters