Load real UK Biobank data

Load real UK Biobank data

use only the ukbREST Docker image here.

use only disjunctive datasets (unique set of data fields). TRY and see what happens when we do not follow this.

mention ukbconv commands to get csv and html files.

when showing how to run the server, show examples using HTTP Basic auth and SSL using the Docker image of ukbREST.

Codings

Once the loading process finishes, you can get all the data field codings by connecting to the PostgreSQL database and exporting a list of codings:

\copy (select distinct coding from fields where coding is not null)
to /mnt/all_codings.txt (format csv)

The file /mnt/all_codings.txt is just a list of coding numbers, one per line, that you can use to download all coding files using the download_codings.sh script:

$ mkdir /tmp/codings && cd /mnt/codings
$ [...]/misc/download_codings.sh all_codings.txt

Encoding errors with CSV files

1. TODO: Problems with CSV files encodings.
   1. Describe what happens when we found this error.
   2. How to specify different encodings for different files.
   3. the encoding issues could depend on the data fields you have access to in your application.