Yeah! Back to NDS work.
Major goals for Sprint 30:
- SC17 demo = NDS8 demo = SI2 proposal
- Container workshop
Candidate tasks:
- Explore "Zero to HPC" with ROGER team (Yan/Anand)
- Get ROGER account for Mike?
- ROGER dev container (all the things you need to develop for deploy on ROGER)
- Batch submit container: how can we run qsub from a container?
- Oauth (factoring in Zero to HPC – CILogon, Kerberos, etc)
- Batch container cluster (extending BioCADDIE Kubernetes work for WB)
- Revisit /shared data in light of NIB and ThinkChicago examples
- NIB data
- Process for submitting datasets
- Dedicated VM vs PetSet
- Crowd/social stuff
- Export to Docker compose
- Docker commit support (save current image state)
- wget and "docker-compose up" on AWS, GCE, etc.
- Storage issues
- Gluster performance problems in light of ETK
- /var/lib/docker recovery analysis (mv v rsync v tar v) NDS-984
- rsync -W (whole file)
- Work with Nebula/SDSC to benchmark storage options
- Other issues
- Huge log files
- What to do with ELK stack
- Deploy-tools changes for single-node or master+1 w/o Gluster
- What happened with IPv6?
- Fix /media/storage in deploy-tools
- Docker pull problems (NDS-986)
- Single-node load issues (NDS-985)
- 502 error handling
- Adding 503 to deploy-tools, new backend
- Resource "knob"
- Filesystem permissions
- Phone home
- Usage reports/reporting