add benchmarking scripts for parquet loader

[akash-shankaran]

Description

This change adds the scripts used to ingest vector data as parquet files to opensearch, when using JVector engine.

Testing

akashshankaran@parquet-loader>>python3 osbench.py --path 0000.parquet --procs 1

Starting 1 processes over 1 files; batch=8000 bulk_chunk=1000 max_chunk_bytes=10485760
[worker] Missing required column 'embeddings' in batch — available columns: []
[worker] Missing required column 'embeddings' in batch — available columns: [] | 0/1 [00:00<?, ?it/s]
Workers: 100%|███████████████████████████| 1/1 [00:00<00:00, 6.89it/s]
Indexing finished.██████████████████████████| 1/1 [00:00<00:00, 6.90it/s]

Files processed: 1
Approx rows (metadata): 15857
Processes: 1
Successfully indexed: 0
Failed: 0
• retryable (suppressed):0
• critical (shown): 0
Total time: 0.15s

Check List

• New functionality includes testing.
• New functionality has been documented.
• API changes companion pull request created.
• Commits are signed per the DCO using --signoff.
• Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[sam-herman]

@akash-shankaran thank you for the contribution, can you add a testing section in the description with sample of input/output?

[akash-shankaran]

@akash-shankaran thank you for the contribution, can you add a testing section in the description with sample of input/output?

@sam-herman done. I also fixed a bunch of bugs in the script when testing with a new parquet file. (such as parsing columns that didn't exist in original file from Jake :) ).