Yeah! Back to NDS work.
Major goals for Sprint 30:
- SC17 demo = NDS8 demo = SI2 proposal
- WB to HPC: WB as development, visualization environment for HPC.
- WB to Cloud: WB as demo environment, export running configurations and data to move to Cloud.
- Container workshop
Candidate tasks:
- Explore "WB to HPC" with ROGER team (Yan/Anand)
- Get ROGER account for Mike? (NDS-990)
- ROGER dev container (all the things you need to develop for deploy on ROGER)
- Batch submit container: how can we run qsub from a container?
- Explore "WB to Cloud"
- Export config to Docker compose
- wget and "docker-compose up" on AWS, GCE, etc.
- Oauth (factoring in WB to HPC, WB to Cloud – CILogon, Kerberos, AWS?)
- Batch container cluster: extending BioCADDIE Kubernetes work for WB (NDS-991)
- Improved data handling (in light of NBI, ThinkChicago) (NDS-903)
- Nebraska NBI data (NDS-992)
- Process for submitting datasets
- Storage issues
- Gluster performance problems in light of ETK (NDS-860)
- /var/lib/docker recovery analysis (mv v rsync v tar v) (NDS-996)
- rsync -W (whole file)
- Work with Nebula/SDSC to benchmark storage options (NDS-993)
- Huge log files (NDS-995)
- Fix /media/storage in deploy-tools (NDS-994)
- Other issues
- What to do with ELK stack (already have PR)
- Deploy-tools changes for single-node or master+1 w/o Gluster (NDS-984)
- What happened with IPv6?
- Docker pull problems (NDS-986)
- Single-node load issues (NDS-985)
- 502 error handling, Adding 503 to deploy-tools, new backend (NDS-590)
- Resource "knob" (NDS-574)
- Filesystem permissions (NDS-809, NDS-814)
- Phone home
- Usage reports/reporting (NDS-499)
- Crowd/social stuff
- Docker commit support (save current image state) (NDS-750)
- Dedicated VM vs PetSet