File tree 2 files changed +3
-3
lines changed
examples/common_patterns_for_connectors/parallel_fetching_from_source
2 files changed +3
-3
lines changed Original file line number Diff line number Diff line change @@ -13,15 +13,15 @@ The connector requires the following configuration parameters in `configuration.
13
13
"region_name" : " <YOUR_AWS_REGION_NAME>" ,
14
14
"bucket_name" : " <YOUR_AWS_BUCKET_NAME>" ,
15
15
"prefix" : " <YOUR_AWS_FOLDER_NAME>" ,
16
- "max_workers" : " <NUMBER_OF_PARALLEL_WORKERS >"
16
+ "max_workers" : " <NUMBER_OF_THREADS >"
17
17
}
18
18
```
19
19
20
20
- ` aws_access_key_id ` and ` aws_secret_access_key ` : AWS credentials with read access to your S3 bucket
21
21
- ` region_name ` : AWS region where your bucket is located
22
22
- ` bucket_name ` : Name of the S3 bucket containing your CSV files
23
23
- ` prefix ` : Folder path in the bucket where CSV files are stored (optional, defaults to root "/" if not specified)
24
- - ` max_workers ` : Number of parallel threads to use (optional, defaults to 4 if not specified)
24
+ - ` max_workers ` : Number of threads to use (optional, defaults to 4 if not specified)
25
25
26
26
### Key Functions
27
27
Original file line number Diff line number Diff line change 4
4
"region_name" : " <YOUR_AWS_REGION_NAME>" ,
5
5
"bucket_name" : " <YOUR_AWS_BUCKET_NAME>" ,
6
6
"prefix" : " <YOUR_AWS_FOLDER_NAME>" ,
7
- "max_workers" : " <NUMBER_OF_PARALLEL_WORKERS >"
7
+ "max_workers" : " <NUMBER_OF_THREADS >"
8
8
}
You can’t perform that action at this time.
0 commit comments