You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fix: Add missing DynamoDB parameters to versioned docs
Follow-up to #1507 which added scan_interval, ready_lag, endpoint_url,
and lag_exceeds_shard_retention_behavior to the vNext docs but missed
the versioned docs.
- version-1.11.x: all 4 parameters (verified against v1.11.5 code)
- version-1.10.x: 3 parameters — scan_interval, ready_lag, endpoint_url
(lag_exceeds_shard_retention_behavior does not exist in v1.10.4)
Copy file name to clipboardExpand all lines: website/versioned_docs/version-1.10.x/components/data-connectors/dynamodb.md
+3Lines changed: 3 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -68,6 +68,9 @@ The DynamoDB data connector supports the following configuration parameters:
68
68
| `unnest_depth` | Optional. Maximum nesting depth for unnesting embedded documents into a flattened structure. Higher values expand deeper nested fields. |
69
69
| `schema_infer_max_records` | Optional. The number of documents to use to infer the schema. Defaults to 10 |
70
70
| `scan_segments` | Optional. Number of segments for `Scan` request. 'auto' by default, which will calculate number of segments based on number of the records in a table |
71
+
| `scan_interval` | Optional. Interval between polling for new records in a DynamoDB stream. Default: `0s`. See [Streams](#streams). |
72
+
| `ready_lag` | Optional. When using Streams, once the table reaches this lag the dataset will be reported as Ready. Default: `2s`. See [Streams](#streams). |
| `dynamodb_aws_region` | Required. The AWS region containing the DynamoDB table |
65
-
| `dynamodb_aws_access_key_id` | Optional. AWS access key ID for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
66
-
| `dynamodb_aws_secret_access_key` | Optional. AWS secret access key for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
67
-
| `dynamodb_aws_session_token` | Optional. AWS session token for authentication |
68
-
| `dynamodb_aws_auth` | Optional. Authentication method. Use `iam_role` (default) for IAM role-based authentication or `key` for explicit access key credentials. |
69
-
| `dynamodb_aws_iam_role_source` | Optional. IAM role credential source (only used when `dynamodb_aws_auth: iam_role`). `auto` (default) uses the default AWS credential chain, `metadata` uses only instance/container metadata (IMDS, ECS, EKS/IRSA), `env` uses only environment variables |
70
-
| `unnest_depth` | Optional. Maximum nesting depth for unnesting embedded documents into a flattened structure. Higher values expand deeper nested fields. |
71
-
| `schema_infer_max_records` | Optional. The number of documents to use to infer the schema. Defaults to 10 |
72
-
| `scan_segments` | Optional. Number of segments for `Scan` request. 'auto' by default, which will calculate number of segments based on number of the records in a table |
73
-
| `time_format` | Optional. Go-style time format used for parsing/formatting timestamps. See [Time Format](#time-format) |
| `dynamodb_aws_region` | Required. The AWS region containing the DynamoDB table |
65
+
| `dynamodb_aws_access_key_id` | Optional. AWS access key ID for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
66
+
| `dynamodb_aws_secret_access_key` | Optional. AWS secret access key for authentication. If not provided, credentials will be loaded from environment variables or IAM roles |
67
+
| `dynamodb_aws_session_token` | Optional. AWS session token for authentication |
68
+
| `dynamodb_aws_auth` | Optional. Authentication method. Use `iam_role` (default) for IAM role-based authentication or `key` for explicit access key credentials. |
69
+
| `dynamodb_aws_iam_role_source` | Optional. IAM role credential source (only used when `dynamodb_aws_auth: iam_role`). `auto` (default) uses the default AWS credential chain, `metadata` uses only instance/container metadata (IMDS, ECS, EKS/IRSA), `env` uses only environment variables |
70
+
| `unnest_depth` | Optional. Maximum nesting depth for unnesting embedded documents into a flattened structure. Higher values expand deeper nested fields. |
71
+
| `schema_infer_max_records` | Optional. The number of documents to use to infer the schema. Defaults to 10 |
72
+
| `scan_segments` | Optional. Number of segments for `Scan` request. 'auto' by default, which will calculate number of segments based on number of the records in a table |
73
+
| `scan_interval` | Optional. Interval between polling for new records in a DynamoDB stream. Default: `0s`. See [Streams](#streams). |
74
+
| `ready_lag` | Optional. When using Streams, once the table reaches this lag the dataset will be reported as Ready. Default: `2s`. See [Streams](#streams). |
| `lag_exceeds_shard_retention_behavior` | Optional. Behavior when stream lag exceeds shard retention (24h). One of `error` (default — marks dataset as Error), `ready_before_load` (marks Ready then re-bootstraps), or `ready_after_load` (re-bootstraps then marks Ready). |
77
+
| `time_format` | Optional. Go-style time format used for parsing/formatting timestamps. See [Time Format](#time-format) |
0 commit comments