You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

Yeah! Back to NDS work.

Major goals for Sprint 30:

  • SC17 demo = NDS8 demo = SI2 proposal
    • WB to HPC:  WB as development, visualization environment for HPC.
    • WB to Cloud: WB as demo environment, export running configurations and data to move to Cloud.
  • Container workshop

Candidate tasks:

  • Explore "WB to HPC" with ROGER team (Yan/Anand)
    • Get ROGER account for Mike?
    • ROGER dev container (all the things you need to develop for deploy on ROGER)
    • Batch submit container: how can we run qsub from a container?
  • Explore "WB to Cloud"
    • Export config to Docker compose
    • wget and "docker-compose up" on AWS, GCE, etc.
  • Oauth (factoring in WB to HPC, WB to Cloud – CILogon, Kerberos, AWS?)
  • Batch container cluster: extending BioCADDIE Kubernetes work for WB
  • Improved data handling (in light of NBI, ThinkChicago)
    • Nebraska NBI data
    • Process for submitting datasets
  • Storage issues
    • Gluster performance problems in light of ETK
    • /var/lib/docker recovery analysis (mv v rsync v tar v) NDS-984
      • rsync -W (whole file)
    • Work with Nebula/SDSC to benchmark storage options
    • Huge log files
    • Fix /media/storage in deploy-tools
  • Other issues
    • What to do with ELK stack
    • Deploy-tools changes for single-node or master+1 w/o Gluster
    • What happened with IPv6?
    • Docker pull problems (NDS-986)
    • Single-node load issues (NDS-985)
    • 502 error handling
    • Adding 503 to deploy-tools, new backend
    • Resource "knob"
    • Filesystem permissions
    • Phone home
    • Usage reports/reporting
    • Crowd/social stuff
    • Docker commit support (save current image state)
    • Dedicated VM vs PetSet
  • No labels