Skip to content

Commit 71a10a1

Browse files
ClaudeClaude
authored andcommitted
fix: Add missing DynamoDB parameters to versioned docs
Follow-up to #1507 which added scan_interval, ready_lag, endpoint_url, and lag_exceeds_shard_retention_behavior to the vNext docs but missed the versioned docs. - version-1.11.x: all 4 parameters (verified against v1.11.5 code) - version-1.10.x: 3 parameters — scan_interval, ready_lag, endpoint_url (lag_exceeds_shard_retention_behavior does not exist in v1.10.4)
1 parent ee611de commit 71a10a1

2 files changed

Lines changed: 19 additions & 12 deletions

File tree

  • website/versioned_docs

website/versioned_docs/version-1.10.x/components/data-connectors/dynamodb.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -68,6 +68,9 @@ The DynamoDB data connector supports the following configuration parameters:
6868
| `unnest_depth` | Optional. Maximum nesting depth for unnesting embedded documents into a flattened structure. Higher values expand deeper nested fields. |
6969
| `schema_infer_max_records` | Optional. The number of documents to use to infer the schema. Defaults to 10 |
7070
| `scan_segments` | Optional. Number of segments for `Scan` request. 'auto' by default, which will calculate number of segments based on number of the records in a table |
71+
| `scan_interval` | Optional. Interval between polling for new records in a DynamoDB stream. Default: `0s`. See [Streams](#streams). |
72+
| `ready_lag` | Optional. When using Streams, once the table reaches this lag the dataset will be reported as Ready. Default: `2s`. See [Streams](#streams). |
73+
| `endpoint_url` | Optional. Custom endpoint URL for DynamoDB-compatible services (e.g., DynamoDB Local, ScyllaDB Alternator). |
7174

7275
### Authentication
7376

website/versioned_docs/version-1.11.x/components/data-connectors/dynamodb.md

Lines changed: 16 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -59,18 +59,22 @@ The dataset name cannot be a [reserved keyword](../../reference/spicepod/keyword
5959

6060
The DynamoDB data connector supports the following configuration parameters:
6161

62-
| Parameter Name | Description |
63-
| -------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
64-
| `dynamodb_aws_region` | Required. The AWS region containing the DynamoDB table |
65-
| `dynamodb_aws_access_key_id` | Optional. AWS access key ID for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
66-
| `dynamodb_aws_secret_access_key` | Optional. AWS secret access key for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
67-
| `dynamodb_aws_session_token` | Optional. AWS session token for authentication |
68-
| `dynamodb_aws_auth` | Optional. Authentication method. Use `iam_role` (default) for IAM role-based authentication or `key` for explicit access key credentials. |
69-
| `dynamodb_aws_iam_role_source` | Optional. IAM role credential source (only used when `dynamodb_aws_auth: iam_role`). `auto` (default) uses the default AWS credential chain, `metadata` uses only instance/container metadata (IMDS, ECS, EKS/IRSA), `env` uses only environment variables |
70-
| `unnest_depth` | Optional. Maximum nesting depth for unnesting embedded documents into a flattened structure. Higher values expand deeper nested fields. |
71-
| `schema_infer_max_records` | Optional. The number of documents to use to infer the schema. Defaults to 10 |
72-
| `scan_segments` | Optional. Number of segments for `Scan` request. 'auto' by default, which will calculate number of segments based on number of the records in a table |
73-
| `time_format` | Optional. Go-style time format used for parsing/formatting timestamps. See [Time Format](#time-format) |
62+
| Parameter Name | Description |
63+
| -------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
64+
| `dynamodb_aws_region` | Required. The AWS region containing the DynamoDB table |
65+
| `dynamodb_aws_access_key_id` | Optional. AWS access key ID for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
66+
| `dynamodb_aws_secret_access_key` | Optional. AWS secret access key for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
67+
| `dynamodb_aws_session_token` | Optional. AWS session token for authentication |
68+
| `dynamodb_aws_auth` | Optional. Authentication method. Use `iam_role` (default) for IAM role-based authentication or `key` for explicit access key credentials. |
69+
| `dynamodb_aws_iam_role_source` | Optional. IAM role credential source (only used when `dynamodb_aws_auth: iam_role`). `auto` (default) uses the default AWS credential chain, `metadata` uses only instance/container metadata (IMDS, ECS, EKS/IRSA), `env` uses only environment variables |
70+
| `unnest_depth` | Optional. Maximum nesting depth for unnesting embedded documents into a flattened structure. Higher values expand deeper nested fields. |
71+
| `schema_infer_max_records` | Optional. The number of documents to use to infer the schema. Defaults to 10 |
72+
| `scan_segments` | Optional. Number of segments for `Scan` request. 'auto' by default, which will calculate number of segments based on number of the records in a table |
73+
| `scan_interval` | Optional. Interval between polling for new records in a DynamoDB stream. Default: `0s`. See [Streams](#streams). |
74+
| `ready_lag` | Optional. When using Streams, once the table reaches this lag the dataset will be reported as Ready. Default: `2s`. See [Streams](#streams). |
75+
| `endpoint_url` | Optional. Custom endpoint URL for DynamoDB-compatible services (e.g., DynamoDB Local, ScyllaDB Alternator). |
76+
| `lag_exceeds_shard_retention_behavior` | Optional. Behavior when stream lag exceeds shard retention (24h). One of `error` (default — marks dataset as Error), `ready_before_load` (marks Ready then re-bootstraps), or `ready_after_load` (re-bootstraps then marks Ready). |
77+
| `time_format` | Optional. Go-style time format used for parsing/formatting timestamps. See [Time Format](#time-format) |
7478

7579
### Authentication
7680

0 commit comments

Comments
 (0)