Populate the Dataset table from the harvester

[neilmb]

Feature/what we're after

After definining the Dataset model in #5487, the harvester should start populating that table when it does a harvest.

Anticipated/hypothesized benefits

• Providing data that we can put on the page in the catalog
• Proves out the technology choice that we make

Measurements/metrics

• Number of rows in the Dataset table

References/background

• Two possibilities exist: (1) we can make Dataset be a SQL "view" onto the HarvestRecord table (this makes everything else easy because we don't have to make a "sync" method for our harvest) OR (2) change the harvester to "sync" the harvested records into our Dataset format when we do the harvest (this probably also needs a script to initially populate the Dataset table).
• Don't initially worry about getting all of the information from Harvester into this table. Just some things flowing from the harvest process into Dataset is sufficient.

[FuhuXia]

Also a 3rd possibility, a trigger function got executed upon row insert/update/delete on HarvestRecord table, the function gathers the data and updates another table Dataset.

[rshewitt]

placing back in progress. need to work on this a tad more.

[rshewitt]

db migration has gotten in weird state on dev. deployment was successful but checking in the db and the view wasn't created. this doesn't have to be blocking. I created the view manually (for testing purposes) in the db and it was fine so we can just document that we created a view in the migrations README instead of migrations.

• 2 heads with a branchpoint at dataset table creation. trying to revert back to e0ce1c68aa9f and clean things up.

e0ce1c68aa9f -> 1b4d6bcea65f (head), empty message
e0ce1c68aa9f -> 4c8c5f116577 (head), create dataset materialized view
416319f5e5bb -> e0ce1c68aa9f (branchpoint), Add Dataset table
e75e287e2251 -> 416319f5e5bb, Add parent_identifier to record
5416f9f5f06d -> e75e287e2251, add error and update notification type
3b56c7e46974 -> 5416f9f5f06d, Add constraint for waf-collections
a6aa1afd27b7 -> 3b56c7e46974, Add collection_parent_url and waf-collection type
1800d355e5b9 -> a6aa1afd27b7, remove 'csdgm' from schema_type
cf577d46fccd -> 1800d355e5b9, Add organization_type column with enumerated values
<base> -> cf577d46fccd, New initial base migration