One liners

Console access to a FIONA system allows users to probe the data structures used to receive, anonymize and forward image data. Here are some one-line linux commands that are useful if you want to more closely observe your system.

How much space is used to store data already transferred to the DAIC?

The FIONA system has about 20TB of internal storage (ZFS with SSD read/write caches, intent log). The system will always keep DICOM data on its drives (/data/site/archive/) but packages that have been forwarded to the DAIC will be purged if the system drives become full (cleanDrive.sh). This purge happens nightly and is applied to data that is sufficiently old (days since forwarded to the DAIC). Use the following command line to see the amount of data that could be deleted if you adjust the number of days (-mtime +100):

find /data/DAIC -name "*.tgz" -type f -mtime +1 -size +0M -print0 | while read -d $'\0' file; do ls -l $file | cut -d' ' -f5; done | awk '{s+=$1} END {print (s/1024/1024/1024/1024)"TB" }'

Run the above and it will show the total size of the TGZ files in /data/DAIC in TB (-mtime +1). Adjust the mtime argument from +100 (default used by cleanDrive.sh) down. Try find a number of days that will free up sufficient memory to have 3TB of free disk space available. Use that number and adjust it in the cleanDrive.sh script (/var/www/html/server/utils/cleanDrive.sh). Using a lower number of days will allow the script to free up more space. The script will stop truncating files in /data/DAIC if the total amount of free disk space reaches 3TB (or 86% on the web-interface).