Yeah! Back to NDS work.

Major goals for Sprint 30:

• SC17 demo = NDS8 demo = SI2 proposal
  • WB to HPC:  WB as development, visualization environment for HPC.
  • WB to Cloud: WB as demo environment, export running configurations and data to move to Cloud.
• Container workshop

Candidate tasks:

• Explore "WB to HPC" with ROGER team (Yan/Anand)
  • Get ROGER account for Mike? (NDS-990)
  • ROGER dev container (all the things you need to develop for deploy on ROGER)
  • Batch submit container: how can we run qsub from a container?
• Explore "WB to Cloud"
  • Export config to Docker compose
  • wget and "docker-compose up" on AWS, GCE, etc.
• Oauth (factoring in WB to HPC, WB to Cloud – CILogon, Kerberos, AWS?)
• Batch container cluster: extending BioCADDIE Kubernetes work for WB (NDS-991)
• Improved data handling (in light of NBI, ThinkChicago)  (NDS-903)
  • Nebraska NBI data (NDS-992)
  • Process for submitting datasets
• Storage issues
  • Gluster performance problems in light of ETK  (NDS-860)
  • /var/lib/docker recovery analysis (mv v rsync v tar v) (NDS-996)
    • rsync -W (whole file)
  • Work with Nebula/SDSC to benchmark storage options (NDS-993)
  • Huge log files (NDS-995)
  • Fix /media/storage in deploy-tools (NDS-994) 
• Other issues
  • What to do with ELK stack (already have PR)
  • Deploy-tools changes for single-node or master+1 w/o Gluster (NDS-984)
  • What happened with IPv6?
  • Docker pull problems (NDS-986)
  • Single-node load issues (NDS-985)
  • 502 error handling, Adding 503 to deploy-tools, new backend (NDS-590)
  • Resource "knob" (NDS-574)
  • Filesystem permissions (NDS-809, NDS-814)
  • Phone home
  • Usage reports/reporting (NDS-499)
  • Crowd/social stuff
  • Docker commit support (save current image state) (NDS-750)
  • Dedicated VM vs PetSet