Description
We will want to provide some support for data that is only accessible behind a data use agreement. The current plan is to have users provide the data themselves after they have signed the DUA, while we provide the nodes and edges for those datasets.
One thought is to assume the data structure as is (downloaded), with specific file path mapping. This will be initialized with the framework, but if called upon, an error is thrown to the user that the data is not available and point them to the resource. This may confuse the users if they are able to see the nodes but not access the resources.
Another thought is to have a mechanism that enables DUA data, which when enabled, will try to add such nodes and edges to the graph if the files are available.
Tasks
Freeform Notes
DUA data will have to already be added to the framework, or users will have to add it themselves either via API or via a YAML file.
Description
We will want to provide some support for data that is only accessible behind a data use agreement. The current plan is to have users provide the data themselves after they have signed the DUA, while we provide the nodes and edges for those datasets.
One thought is to assume the data structure as is (downloaded), with specific file path mapping. This will be initialized with the framework, but if called upon, an error is thrown to the user that the data is not available and point them to the resource. This may confuse the users if they are able to see the nodes but not access the resources.
Another thought is to have a mechanism that enables DUA data, which when enabled, will try to add such nodes and edges to the graph if the files are available.
Tasks
Freeform Notes
DUA data will have to already be added to the framework, or users will have to add it themselves either via API or via a YAML file.