These design notes concern exposing the NBI data (
Jira | ||||||
---|---|---|---|---|---|---|
|
See also Shared data directories
...
Getting the data to Workbench
We 'll need to can initially add the shared directory under gluster to Gluster and transfer or download the data directly.
For this project, the raw data is probably less of a concern than the Mongo data – which poses an interesting question about data sharing.
We could setup a globus endpoint or use Santiago?
- santiago.ncsa.illinois.edu runs a globus endpoint (https://data.share.nationaldataservice.org/)
- The data exposed through santiago could be mounted on Workbench – but it's at NCSA, not SDSC
Import into MongoDB
We will host the raw data under /shared/NBIDATA/ as a read-only volume
...