10-25 Curation Workflow Tracking

[aditya-nath-sage]

This ticket tracks curation workflow progression.

Curation and Annotation

• Run Pubmed crawler to generate PublicationView manifest
• Send Amber and Jineta a copy of the PublicationView manifest from latest crawl to review for MC2 Center Newsletter publication highlights
• Send Amber "News from CCKP" for MC2 Center Newsletter
• Annotate publications in PublicationView manifest [In progress]
• Generate ToolView and DatasetView manifests based on PublicationView manifest
• Run the automated curation workflow to upload publications, datasets and tools [This includes splitting manifests, processing and validating manifests, generating target synapse IDs for upload, schema updates, upload to synapse and (in progress) a validation check for uploads)
• Generate UNION tables

QC of staging tables

• Performing automate portal sync to CCKP
• Validate data on the CCKP

Status check [Plan to report numbers for each category following pubmed crawl]:

• Publication upload
• Dataset Upload
• Tool Upload

[aditya-nath-sage]

New Publication manifest: https://docs.google.com/spreadsheets/d/13nVuBTbO4MhyC4ooyK4dWsqZTE5nbaPIsx8GjZlv7Ik/edit?usp=drive_link

[aditya-nath-sage]

Pubs, Datasets, Tools, and Grants manifests manually curated. Will do a portal sync on all 4 by end of the week (10/31)