Commit fcec014
authored
Sync buildkite builds and jobs dynamoDB tables to ClickHouse (#7002)
A follow-up of #6998 and
#7001 to sync these dynamoDB
tables to ClickHouse, I will need to find a permanent home for these
tables instead of using `fortesting`
### Testing
Actually running and ingesting data at the moment (I update the lambda
manually on AWS). Also backfilling the data from DynamoDB as I have run
a debug version of #6998 since
mid July.
```
python dynamo2ch.py --dynamodb-table vllm-buildkite-build-events --clickhouse-table fortesting.vllm_buildkite_builds --stored-data vllm_buildkite_builds.json
```
```
python dynamo2ch.py --dynamodb-table vllm-buildkite-job-events --clickhouse-table fortesting.vllm_buildkite_jobs --stored-data vllm_buildkite_jobs.json
```
---------
Signed-off-by: Huy Do <huydhn@gmail.com>1 parent 01e9114 commit fcec014
1 file changed
Lines changed: 2 additions & 0 deletions
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
| 34 | + | |
| 35 | + | |
34 | 36 | | |
35 | 37 | | |
36 | 38 | | |
| |||
0 commit comments