I-ALiRT - Dynamodb addition

[laspsandoval]

Change Summary

Overview

Add a parallel db table w/ new partition key and sort key.

Updated Files

• ialirt_ingest_lambda_construct.py
  • Add new db table w/ partition key = instrument and sort key = met_in_utc
• ialirt_ingest.py
  • Add new partition key “instrument” to kernel ingest
  • Update the insert function
  • Add capability to insert into new table (after the old table just in case there are any errors)

Testing

• conftest.py
  • Add new database setup
• test_ialirt_ingest_lambda_construct.py
  • test_ialirt_ingest.py

Notes

We will need to update our query apis and also archive api once this is approved and we begin to transition to the new database.

[greglucas]

Nice, I think this is a great approach to do it if I'm understanding correctly! You are creating a new table so that we can be inserting into both side-by-side in production. Then we'll test things out and maybe run a migration of previous items into the new table and only remove the original table if this approach is useful.

One thing that might be nice here is to try and be a bit more restrictive about what we are putting into each partition insert, so picking and choosing the instrument data appropriately based on the table name (the new table doesn't need an APID column for instance and we want mag_hk to be a separate instrument). I'm a bit confused if the HIT instrument insert is going to be inserted at a 4-second cadence or just one item in this new approach.

[laspsandoval]

I made some pretty significant updates to ialirt_ingest.py. The rest is mostly the same (besides responding to the PR comments)

[greglucas]

Sorry for the slow review here. A few more nitpicks / questions, but getting close!