Module 3B: Advanced Cleaning with Internet Archive Data (Cont'd)
To be able to use our new SKOS-RDF file, we'll need to add another open source extension to Refine. This one can be downloaded here. The same way you added the N-ER extension, add the RDF extension to your local Refine directory.
When you restart Refine, you'll see that another button is now at the top right-hand corner. Click it. Select Add Reconciliation Service > Based on RDF File.
In the window that shows up, select our SKOS RDF file from your local hard drive, and use the following parameters:
- Name: Grateful Data
- File Format: RDF/XML
- Label properties: skos:prefLabel (leave no other ones checked)
We're almost ready. Next, import your Internet Archive data (found in the file IA-Data.csv) to a new project in Refine.
When you import your Internet Archive data, make sure Refine has selected CSV as the interpreter. Otherwise, your data will import in bad ways.
The reconciliation process can take a long time, depending on your version of Refine, your computer specs, and the little magic elves shuttling data from the former to the latter. Because of this. we will test out our Reconciliation process on a small amount of data.
Create a text facet on the Year column of your IA Data project. Click on the entry for 1977, isolating our data to the year that some people consider almost a perfect year for Dead performances. ("It's as close to a flawless Grateful Dead tour as I've ever heard," said archivist David Lemieux.)
Click on the dropdown menu for the Date column and select Reconcile > Start Reconciling. In the 'Reconcile' window, click on the GratefulData RDF file we added. (Refine processing this file may take a minute or two.) When it's ready, be sure that Refine has chosen skos:Concept to reconcile against, and that the box for 'Auto-Match with High Confidence' is checked. Click start.
The reconciliation process may take a while.