Merge pull request #2 from pnadolny13/readme_updates

update readme and sample meltano.yml

Author: pnadolny13

README.md

@@ -26,7 +26,7 @@ Built with the [Meltano Singer SDK](https://sdk.meltano.com).
 | start_date           | True     | None    | The earliest record date to sync |
 | log_group_name       | True     | None    | The log group on which to perform the query. |
 | query                | True     | None    | The query string to use. For more information, see [CloudWatch Logs Insights Query Syntax](https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_QuerySyntax.html). |
-| batch_increment_mins | False    |    1440 | The size of the time window to query by, default 1440 mins (i.e. 1 day). The tap will raise an exception if the result set is greater than the max limit of 10,000 records because it can't be sure that all data is extracted. If this happens you'll need to reduce this batch_increment_mins setting to retrieve a smaller record set per query. |
+| batch_increment_s    | False    |    3600 | The size of the time window to query by, default 3,600 seconds (i.e. 1 hour). If the result set for a batch is greater than the max limit of 10,000 records then the tap will query the same window again where >= the most recent record received. This means that the same data is potentially being scanned >1 times but < 2 times, depending on the amount the results set went over the 10k max. For example a batch window with 15k records would scan the 15k once, receiving 10k results, then scan ~5k again to get the rest. The net result is the same data was scanned ~1.5 times for that batch. To avoid this you should set the batch window to avoid exceeding the 10k limit. |
 | stream_maps          | False    | None    | Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html). |
 | stream_map_config    | False    | None    | User-defined config values to be used within map expressions. |
 | flattening_enabled   | False    | None    | 'True' to enable schema flattening and automatically expand nested properties. |

meltano.yml

@@ -16,7 +16,7 @@ plugins:
     - about
     - stream-maps
     config:
-      start_date: '2010-01-01T00:00:00Z'
+      start_date: '2023-01-01T00:00:00Z'
     settings:
     - name: aws_access_key_id
       kind: password