You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The configuration value takes precedence over the environment variable. If `memory_limit_in_bytes` is set to a non-zero value in the config, the environment variable is ignored.
33
+
> [!TIP]
34
+
> You can also control memory limit *in bytes* using client config. The client config takes precedence over the environment variable (memory_limit_in_bytes needs to be set to a non-zero value).
If neither is set (config is 0 and environment variable is not set), the client sets a default memory limit based on the target throughput.
42
+
**Default Behavior**:
43
+
If neither is set (config is 0 and environment variable is not set), the client sets a default memory limit based on the target throughput.
47
44
48
-
###### Notes
49
-
* The limit applies per client. If multiple clients created, limit will apply to each separately.
50
-
* The environment variable value must be a valid positive integer representing gigabytes (GiB).
51
-
* The value is converted from GiB to bytes internally (1 GiB = 1024³ bytes).
52
-
* Invalid values or overflow conditions will cause client creation to fail with `AWS_ERROR_INVALID_ARGUMENT`.
45
+
**Notes**:
46
+
* The limit applies per client. If multiple clients created, limit will apply to each separately.
47
+
* The environment variable value must be a valid positive integer representing gigabytes (GiB).
48
+
* The value is converted from GiB to bytes internally (1 GiB = 1024³ bytes).
49
+
* Invalid values or overflow conditions will cause client creation to fail with `AWS_ERROR_INVALID_ARGUMENT`.
53
50
54
-
##### Maximum Parts Pending Read - `AWS_CRT_S3_MAX_PARTS_PENDING_READ`
51
+
2. **Maximum Parts Pending Read - `AWS_CRT_S3_MAX_PARTS_PENDING_READ`**
55
52
56
-
Controls the maximum number of parts that can be pending read from the input stream during a multipart upload. Higher values may improve upload throughput for large files by allowing more parts to be read in parallel, at the cost of higher memory usage.
53
+
Controls the maximum number of parts that can be pending read from the input stream during a multipart upload. Higher values may improve upload throughput for large files by allowing more parts to be read in parallel, at the cost of higher memory usage.
57
54
58
-
Example Usage:
55
+
Example Usage:
59
56
60
-
```bash
57
+
```bash
61
58
export AWS_CRT_S3_MAX_PARTS_PENDING_READ=20
62
-
```
59
+
```
60
+
61
+
**Default Behavior**:
62
+
If not set, the default value is 5.
63
63
64
-
###### Notes
65
-
* Only affects multipart uploads. Small files that fit in a single part are not affected.
66
-
* Setting this too low may introduce delays between reads, as the meta-request waits for the client to schedule more work.
67
-
* Setting this too high may cause a single upload to hog work tokens, starving other concurrent uploads.
68
-
* The value must be a positive integer (1–4294967295). Invalid or zero values are ignored with a warning, and the default is used.
69
-
* The value is read once on first use and cached for the lifetime of the process.
64
+
**Notes**:
65
+
* Only affects multipart uploads. Small files that fit in a single part are not affected.
66
+
* Setting this too low may introduce delays between reads, as the meta-request waits for the client to schedule more work.
67
+
* Setting this too high may cause a single upload to hog work tokens, starving other concurrent uploads.
68
+
* The value must be a positive integer (1–4294967295). Invalid or zero values are ignored with a warning, and the default is used.
69
+
* The value is read once on first use and cached for the lifetime of the process.
70
70
71
-
##### Test Bucket - `CRT_S3_TEST_BUCKET_NAME`
71
+
3.**Test Bucket - `CRT_S3_TEST_BUCKET_NAME`**
72
72
73
-
The S3 bucket name used for running unit tests. See the [test_helper documentation](./tests/test_helper/) for setup instructions.
73
+
The S3 bucket name used for running unit tests. See the [test_helper documentation](./tests/test_helper/) for setup instructions.
0 commit comments