Skip to content

K8s: sys_resource revision #1509

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 24 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
be0f779
sys_resource revision
kaitlynmichael May 6, 2025
daca872
Update content/operate/kubernetes/deployment/helm.md
kaitlynmichael May 7, 2025
c344927
Update content/operate/kubernetes/deployment/helm.md
kaitlynmichael May 7, 2025
66ff6a7
K8s: Wisconsin maint 2 release notes (#1500)
kaitlynmichael May 6, 2025
124bfb4
DOC-5201 added release notes for RDI v1.6.7
andy-stark-redis May 6, 2025
6a3443d
DOC-5197 remove mentions of Debezium in RDI config docs
andy-stark-redis May 7, 2025
71c7775
Add docs for CLIENT LIST new input/output stats (#1475)
minchopaskal May 7, 2025
d358802
deleted unused images in /static/images/rc and /static/images/rv
cmilesb May 6, 2025
de5ec64
Handle duplicate images
cmilesb May 6, 2025
d03d7b7
Replace missing images
cmilesb May 6, 2025
aea2cf0
Sizing
cmilesb May 6, 2025
66ff624
Update RQE _index.md
mich-elle-luna May 7, 2025
8ac6c51
DOC-5205 RS: Emphasize upgrade prerequisites (#1512)
rrelledge May 7, 2025
83994fb
K8s: relref fixes (#1517)
kaitlynmichael May 8, 2025
abaaee8
Allow tag with v prefix (#1522)
paoloredis May 8, 2025
07c4acc
RC BYOC: Fix IAM credential steps and relref
cmilesb May 7, 2025
990fc00
Create hugo shortcode for embedding external json files (#1521)
paoloredis May 8, 2025
ad37a33
DEV: (MOD-9575) memory reporting updates (#1508)
dwdougherty May 8, 2025
b81e005
Update index.md (#1526)
nickbouldien May 8, 2025
351e628
DOC-5216 RS: Added bigstore_enabled to node REST API reference (#1527)
rrelledge May 8, 2025
790c761
add alias for link used in redis.io blog (#1518)
kaitlynmichael May 8, 2025
c12ffc5
x86 vs ARM note (#1501)
kaitlynmichael May 8, 2025
2a1c7c0
Fix formatting issue
cmilesb May 8, 2025
233670f
review suggestions
kaitlynmichael May 8, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .github/workflows/redisvl_docs_sync.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ jobs:

# Get latest release
latest_release=$(gh release -R redis/redis-vl-python list --json name,isLatest --jq '.[] | select(.isLatest)|.name')
git checkout "tags/${latest_release}"
git checkout "tags/${latest_release}" || git checkout "tags/v${latest_release}"
pip3 install -e .

popd
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -102,7 +102,7 @@ The `filename` property value can be any file name path which is relative to the
We added a new property `class` which allows you to override the CSS class of the image. Images have by default a `block` display in Tailwind. You can change this by setting the class property to `inline`. The following example shows two images that are in a single line:

```
{{< image filename="/images/rc/icon-database-update-status-pending.png#no-click" alt="Pending database status" class="inline" >}} &nbsp; {{< image filename="/images/rc/icon-database-update-status-active.png#no-click" alt="Active database status" class="inline" >}}
{{< image filename="/images/rc/icon-database-update-status-pending.png#no-click" alt="Pending database status" class="inline" >}} &nbsp; {{< image filename="/images/rc/icon-database-status-active.png#no-click" alt="Active database status" class="inline" >}}
```

### Templating
Expand Down
22 changes: 16 additions & 6 deletions build/image_report.py
Original file line number Diff line number Diff line change
Expand Up @@ -76,12 +76,22 @@ def scan_file(path: str, verbose: bool = True) -> list:
print(f"Checking for images not found in '{args.pathname}' that are in '{args.find_unused[0]}'")

unused_images = []
total_images = 0

for root, dirs, files in os.walk(args.find_unused[0]):
for file in files:
if (file.endswith(".png") or file.endswith(".jpg") or file.endswith(".webp")) and not any(file in img for img in unique_images):
img_filepath = os.path.join(root, file)
print(f" Image '{img_filepath}' not found in '{args.pathname}'")
unused_images.append(img_filepath)

print(f"Found {len(unused_images)} unused images.")
if (file.endswith(".png") or file.endswith(".jpg") or file.endswith(".webp")):
total_images += 1
if not any(file in img for img in unique_images):
img_filepath = os.path.join(root, file)
print(f" Image '{img_filepath}' not found in '{args.pathname}'")
unused_images.append(img_filepath)

print(f"Found {len(unused_images)} unused images out of {total_images} images in '{args.find_unused[0]}.'")

if len(unused_images) > 0:
print("Do you want to remove these images? (y/n) (DO NOT DO ON MAIN BRANCH!)")
if input().lower() == "y":
for img in unused_images:
os.remove(img)
print(f"Removed '{img}'")
2 changes: 1 addition & 1 deletion config.toml
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ rdi_redis_gears_version = "1.2.6"
rdi_debezium_server_version = "2.3.0.Final"
rdi_db_types = "cassandra|mysql|oracle|postgresql|sqlserver"
rdi_cli_latest = "latest"
rdi_current_version = "v1.6.6"
rdi_current_version = "v1.6.7"

[params.clientsConfig]
"Python"={quickstartSlug="redis-py"}
Expand Down
3 changes: 3 additions & 0 deletions content/commands/client-list/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -117,6 +117,9 @@ Here is the meaning of the fields:
* `rbp`: peak size of the client's read buffer since the client connected. Added in Redis 7.0
* `rbs`: current size of the client's read buffer in bytes. Added in Redis 7.0
* `io-thread`: id of I/O thread assigned to the client. Added in Redis 8.0
* `tot-net-in`: total network input bytes read from this client.
* `tot-net-out`: total network output bytes sent to this client.
* `tot-cmds`: total count of commands this client executed.

The client flags can be a combination of:

Expand Down
4 changes: 4 additions & 0 deletions content/commands/json.debug-memory/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,10 @@ title: JSON.DEBUG MEMORY
---
Report a value's memory usage in bytes

{{< warning >}}
The actual total memory consumption by a key could be much lower than the value reported by this command because of an internal JSON string reuse mechanism. For more information, see the [JSON memory usage page]({{< relref "/develop/data-types/json/ram#json-string-reuse-mechanism" >}}).
{{< /warning >}}

[Examples](#examples)

## Required arguments
Expand Down
6 changes: 3 additions & 3 deletions content/commands/spublish/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -52,14 +52,14 @@ title: SPUBLISH
Posts a message to the given shard channel.

In Redis Cluster, shard channels are assigned to slots by the same algorithm used to assign keys to slots.
A shard message must be sent to a node that own the slot the shard channel is hashed to.
The cluster makes sure that published shard messages are forwarded to all the node in the shard, so clients can subscribe to a shard channel by connecting to any one of the nodes in the shard.
A shard message must be sent to a node that owns the slot the shard channel is hashed to.
The cluster makes sure that published shard messages are forwarded to all the nodes in the shard, so clients can subscribe to a shard channel by connecting to any one of the nodes in the shard.

For more information about sharded pubsub, see [Sharded Pubsub]({{< relref "/develop/interact/pubsub#sharded-pubsub" >}}).

## Examples

For example the following command publish to channel `orders` with a subscriber already waiting for message(s).
For example the following command publishes to the `orders` channel with a subscriber already waiting for message(s).

```
> spublish orders hello
Expand Down
9 changes: 9 additions & 0 deletions content/develop/data-types/json/ram.md
Original file line number Diff line number Diff line change
Expand Up @@ -123,3 +123,12 @@ JSON. The _MessagePack_ column is for reference purposes and reflects the length

> Note: In the current version, deleting values from containers **does not** free the container's
allocated memory.

## JSON string reuse mechanism

Redis uses a global string reuse mechanism to reduce memory usage. When a string value appears multiple times, either within the same JSON document
or across different documents on the same node, Redis stores only a single copy of that string and uses references to it.
This approach is especially efficient when many documents share similar structures.

However, the `JSON.DEBUG MEMORY` command reports memory usage as if each string instance is stored independently, even when it's actually reused.
For example, the document `{"foo": ["foo", "foo"]}` reuses the string `"foo"` internally, but the reported memory usage counts the string three times: once for the key and once for each array element.
4 changes: 2 additions & 2 deletions content/develop/interact/search-and-query/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -53,8 +53,8 @@ for full installation instructions.

## License and source code

The Redis Query Engine features of Redis are available under the Source Available License 2.0 (RSALv2) or the Server Side Public License v1 (SSPLv1). Please read the [license file](https://raw.githubusercontent.com/RediSearch/RediSearch/master/LICENSE.txt) for further details. The source code and the [detailed release notes](https://github.com/RediSearch/RediSearch/releases) are available on [GitHub](https://github.com/RediSearch/RediSearch).
The Redis Query Engine features of Redis are available under the Source Available License 2.0 (RSALv2), the Server Side Public License v1 (SSPLv1), or the GNU Affero General Public License version 3 (AGPLv3). Please read the [license file](https://raw.githubusercontent.com/RediSearch/RediSearch/master/LICENSE.txt) for further details. The source code and the [detailed release notes](https://github.com/RediSearch/RediSearch/releases) are available on [GitHub](https://github.com/RediSearch/RediSearch).

Do you have questions? Feel free to ask at the [RediSearch forum](https://forum.redis.com/c/modules/redisearch/).

<br/>
<br/>
2 changes: 1 addition & 1 deletion content/embeds/rc-tags-tag-module.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ After you add your first tag, you can:

- Select **Delete** next to a tag to delete it.

{{<image filename="images/rc/tags-icon-delete.png" alt="Delete button." >}}
{{<image filename="images/rc/icon-delete-teal.png" width="36px" alt="Delete button." >}}

- Select **Add additional tag** to add another tag.

Expand Down
2 changes: 1 addition & 1 deletion content/integrate/amazon-bedrock/set-up-redis.md
Original file line number Diff line number Diff line change
Expand Up @@ -185,7 +185,7 @@ To create your vector index in Redis Insight:

1. In the [Redis Cloud console](https://cloud.redis.io/), in your database's **Configuration** tab, select the **Connect** button next to your database to open the connection wizard.

{{< image filename="/images/rc/connection-wizard-button.png#no-click" alt="Connect button." >}}
{{< image filename="/images/rc/button-connect.png#no-click" alt="Connect button." >}}

1. In the connection wizard, under **Redis Insight Desktop**, select **Public Endpoint**. Select **Open with Redis Insight** to connect to the database with Redis Insight.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ You configure normalization with a `nest` block in the child entities' RDI job,

```yaml
source:
server_name: chinook # Optional. Use the value of `debezium.source.topic.prefix` property in Debezium's `application.properties`
server_name: chinook
schema: public
table: InvoiceLine
output:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -301,8 +301,7 @@ The main sections of these files are:

- `source`: This is a mandatory section that specifies the data items that you want to
use. You can add the following properties here:
- `server_name`: Logical server name (optional). This corresponds to the `debezium.source.topic.prefix`
property specified in the Debezium Server's `application.properties` config file.
- `server_name`: Logical server name (optional).
- `db`: Database name (optional)
- `schema`: Database schema (optional)
- `table`: Database table name. This refers to a table name you supplied in `config.yaml`. The default
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ You can use this installation on [OpenShift](https://docs.openshift.com/) and ot
including cloud providers' K8s managed clusters.

You can pull the RDI images from the
[download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.6.tgz)
[download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.7.tgz)
or from your own [private image registry](#using-a-private-image-registry).

## Before you install
Expand All @@ -51,7 +51,7 @@ Complete the following steps before running Helm:
[Access control]({{< relref "/operate/rs/security/access-control" >}}) for
more information).
- Download the RDI helm chart tar file from the
[download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.6.tgz).
[download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.7.tgz).
- If you want to use a private image registry,
[prepare it with the RDI images](#using-a-private-image-registry).

Expand All @@ -69,7 +69,7 @@ file as described below.
### Using a private image registry

Add the RDI images from the
[download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.6.tgz)
[download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.7.tgz)
to your local registry.
The example below shows how to specify the registry and image pull secret in the
[`values.yaml`](#the-valuesyaml-file) file for the Helm chart:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -154,7 +154,7 @@ ufw allow 9121/tcp # rdi-metric-exporter
Follow the steps below for each of your VMs:

1. Download the RDI installer from the
[Redis download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-installation-1.6.6.tar.gz)
[Redis download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-installation-1.6.7.tar.gz)
(from the *Modules, Tools & Integration* category) and extract it to your preferred installation
folder.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ Follow the steps below to upgrade an existing
of RDI:

1. Download the RDI installer from the
[Redis download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-installation-1.6.6.tar.gz)
[Redis download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-installation-1.6.7.tar.gz)
(in the *Modules, Tools & Integration* category) and extract it to your
preferred installation folder.

Expand Down Expand Up @@ -97,7 +97,7 @@ installation of RDI:
```

1. Download the RDI helm chart tar file from the
[Redis download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.6.tgz).
[Redis download center](https://redis-enterprise-software-downloads.s3.amazonaws.com/redis-di/rdi-1.6.7.tgz).

1. Run the `helm upgrade` command:

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
---
Title: Redis Data Integration release notes 1.6.7 (May 2025)
alwaysopen: false
categories:
- docs
- operate
- rs
description: Installation on Kubernetes with a Helm chart. Improvements for installation on VMs.
linkTitle: 1.6.7 (May 2025)
toc: 'true'
weight: 985
---

> This maintenance release replaces the 1.6.6 release.

RDI’s mission is to help Redis customers sync Redis Enterprise with live data from their slow disk-based databases to:

- Meet the required speed and scale of read queries and provide an excellent and predictable user experience.
- Save resources and time when building pipelines and coding data transformations.
- Reduce the total cost of ownership by saving money on expensive database read replicas.

RDI keeps the Redis cache up to date with changes in the primary database, using a [_Change Data Capture (CDC)_](https://en.wikipedia.org/wiki/Change_data_capture) mechanism.
It also lets you _transform_ the data from relational tables into convenient and fast data structures that match your app's requirements. You specify the transformations using a configuration system, so no coding is required.

## Headlines

- Update the RDI API `/tables` and `/metadata` endpoints to filter the results by schema for MySQL and
MariaDB. Schema and Database are the same for these databases.

## Limitations

RDI can write data to a Redis Active-Active database. However, it doesn't support writing data to two or more Active-Active replicas. Writing data from RDI to several Active-Active replicas could easily harm data integrity as RDI is not synchronous with the source database commits.
4 changes: 2 additions & 2 deletions content/operate/kubernetes/active-active/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ Versions 6.4.2-6 or later fully support the Active-Active controller. Some of th

This setup method includes the following steps:

1. Gather REC credentials and [prepare participating clusters]({{< relref "/operate/kubernetes/active-active/prepare-clusters.md" >}}).
1. Gather REC credentials and [prepare participating clusters]({{< relref "/operate/kubernetes/active-active/prepare-clusters" >}}).
2. Create [`RedisEnterpriseRemoteCluster` (RERC)]({{< relref "/operate/kubernetes/active-active/create-reaadb#create-rerc" >}}) resources.
3. Create [`RedisEnterpriseActiveActiveDatabase` (REAADB)]({{< relref "/operate/kubernetes/active-active/create-reaadb#create-reaadb" >}}) resource.

Expand All @@ -48,7 +48,7 @@ For versions 6.4.2 or earlier, this Active-Active setup method includes the foll

[Active-Active]({{< relref "/operate/rs/databases/active-active/" >}}) databases give you read-and-write access to Redis Enterprise clusters (REC) in different Kubernetes clusters or namespaces. Active-Active deployments managed by the Redis Enterprise operator require two additional custom resources: Redis Enterprise Active-Active database (REAADB) and Redis Enterprise remote cluster (RERC).

To create an Active-Active Redis Enterprise deployment for Kubernetes with these new features, first [prepare participating clusters]({{< relref "/operate/kubernetes/active-active/prepare-clusters.md" >}}) then [create an Active-Active database]({{< relref "/operate/kubernetes/active-active/create-reaadb.md" >}}).
To create an Active-Active Redis Enterprise deployment for Kubernetes with these new features, first [prepare participating clusters]({{< relref "/operate/kubernetes/active-active/prepare-clusters" >}}) then [create an Active-Active database]({{< relref "/operate/kubernetes/active-active/create-reaadb" >}}).

### Preview versions

Expand Down
Loading