Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

WhoPlanned - MondayAccomplished - Friday
  

Preparing for NCSA Industry demo

Working on Brown Dog Deployment Architecture

Got a nice Zeppelin notebook setup for NCSA Industry.


Got BrownDog deployment mostly working

Reworking PRs to use a more sane branching structure

  • Cover Crop
    • Review work to parse DSSAT output to JSON and update workflow once tool is finished
  • IN-Core
    • Review beta testing results and prepare for final release
    • Continue refactoring v2 hazard-service based on code format rules
    • Work on uploading results to new v2 IN-Core repository API
 
  • Cover Crop
    • Reviewed initial work on parsing DSSAT output to json
  • Ergo/KISTI
    • Reviewed attenuation model status for South Korea, sent question about coefficients.
    • Added a hazard event dataset to define combined attenuation model event
  • IN-Core
    • Continued refactoring hazard service and started working on a scenario earthquake object to encapsulate 1 or more attenuation models for use in damage analyses.
    • Updated building damage analysis to produce a csv output file with guids to join results with original dataset
  • Other
    • Created datawolf landing page
    • Closed all DataWolf 4.1 JIRA issues, should be ready to release next week.

NDS

  • Out T-Th for Bridging Big Data workshop
  • Workbench/Spark integration demo
  • Workbench/ROGER integration demo

TERRA

  • Scale up Kubernetes cluster
  • Scan program metadata handling
  • Reprocesssing
  • Documentation

Whole Tale

  • Getting started

Grr:

  • Nebula outage recovery... 

NDS

  • BBD workshop and demo
  • Workbench/Spark demo

TERRA

  • Kubernetes cluster scaled out
  • PR for scan program snafu
  
  
Gregory Jansen

 
  • Write test files for various components
  • Prepare for next week LSST meeting
 
 

  •  GLM
    • Seabird Parser
  • InCore
    • Front end for maestro service
  • Other
    • Clowder Poster for presentations
  •   GLM
    • Seabird Parser
  • InCore
    • Front end for maestro service
  • Other
    • Clowder Poster for presentations
 
  
  
  
  • PollenImage proposal
  • OSN questions
  • BD ticket review
  • HR
 
  • PollenImage propoal in final stages
  • OSN questions submitted
  • BD ticket review started
  • SSA newsletter drafted
  • HR
 
  •  Vacation
 
  •  Vacation
 
  •  BD
    • Jupyter: pass some knowledge to Yan
  • VBD
    • Copy/run model fortran/system
  • GLTG
    • start distributed system setup
 
  • purge raw data from Clowder, Postgres, ROGER filesystem
  • finish scan handling on full field process
  • queue 2016+2017 full pipeline for stereo camera images
  • Clowder poster prep
 
  • data purge process scripts written & initialized
  • EnvironmentLogger full pipeline started
  • stereo camera images queued (nebula issues delaying start)
  • intern stuff
  1. MDF - continue with the datasets ingestion to the MDF/NIST database
  2. MWRD - Wednesday - VM image delivery
  3. KISTI - introduction
  1. MDF - insert datasets, discuss tasks
  2. MWRD - done
  3. KISTI - start project, study literature
  
 
  •  NDS
     
      • Jira
    Michelle Pitcel
      • server
    General
      • JIRA
  • Pull Requests
    • RNUA Form
    • Online RCR Training

    • Ethics Training

      • columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyNDS-1023
    GLM
    Priority:
      • Jira
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key
    GEOD-965
      • NDS-1026
    • KnowEnG
      • Ask about priorities for SSviz..
        • What features will Charles and Amin need to complete the paper?
    • Crops in Silico
      • Thinking more about the system architecture
      • Present ideas for system architecture/interface at weekly meeting
      • Ask Matt Turk if he's still a fan of NoFlo for composing models
    If Time/Paused:
    •  NDS
      • Jira
        serverJIRA
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyNDS-1042
      • Jira
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key
    GEOD-977
    NDS-1023
  • Jira
    serverJIRA
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
    key
  • GEOD
      • NDS-
    979
      • 1026
  • GLTG 
    • Priority:
    • If Time/Paused:
  • IMLCZOPriority:
    • Crops in Silico
      • Thinking more about the system architecture
      • Present ideas for system architecture/interface at weekly meeting
      • Ask Matt Turk if he's still a fan of NoFlo for composing models
    • Still in Progress
      • Jira
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyKNOW-575
      • Jira
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyKNOW-576
      • Jira
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyKNOW-577
    • General
      • Pull Requests
      • Ethics Training
      • RNUA Form

    • GLM
      • Priority
      IMLCZO-192
    • Re-run Parser for Flux Tower
    • Re-run Parser for Allerton non-Decagon
      • If Time/Paused:
        • Jira
          serverJIRA
          columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
          serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
          keyIMLCZOGEOD-195965
        • Jira
          serverJIRA
          columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
          serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
          key
        • CATS
        • GEOD-
        • 770
    GLM
        • 977
      • If Time/Paused:
        • Jira
    • showSummary
    • false
        • serverJIRA
          columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
          serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
          keyGEOD-
    • 969
        • 979
    • GLTG 
      • Go through Planning Notes and create tasks
    • IMLCZO
      • Priority:
        • Online RCR Training
        • Jira
    • JirashowSummaryfalse
        • serverJIRA
          columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
          serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
          key
    • GEOD-977
        • IMLCZO-192
        • Re-run Parser for Flux Tower
        • Re-run Parser for Allerton non-Decagon
      • If Time/Paused:
        • Jira
          serverJIRA
          columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
          serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
          keyIMLCZO-195
        • Jira
    • JirashowSummaryfalse
        • serverJIRA
          columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
          serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
          key
    • GEOD-978GLTG
        • CATS-770
    • General
      • Pull Requests
      • Ethics Training
      • RNUA Form
      • Met with potential Interns
    • GLM
      • Jira
        showSummaryfalse
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key
    GLGVO
      • GEOD-
    314
      • 965
      • Jira
        showSummaryfalse
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key
    GLGVO
      • GEOD-
    375
      • 977
    • GLM
      • Went through Planning Notes and created some tasks
    IMLCZO
      • Jira
        showSummaryfalse
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key
    IMLCZO
      • GLGVO-
    105
      • 376
      • Jira
        showSummaryfalse
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyGLGVO-377
    • IMLCZO
    -130
      • Online RCR Training
      • Re-ran Parser for Flux Tower
      • Re-ran Parser for Allerton non-Decagon
      • Jira
        showSummaryfalse
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyIMLCZO-
    195
      • 192
      • Jira
        showSummaryfalse
        serverJIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverIdb14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        keyIMLCZO-
    196Meeting polls, etc.
      • 195
     
    • Data Schema Service
    • Ethics Training
    • Beta Testing
    • Ethics Training
    • Beta Testing
    • Interns
    • Python Client Library
    • Started on Data Schema Service
     
     KnowEnG
    • Setup KnowCluster for Knowledge Network (knownet)
    • Autoscaling Dev Envs. on AWS (W.I.P.)
    • Dev Supports
    • Sprint Tasks
     KnowEnG
    • Setup KnowCluster for Knowledge Network (knownet)
    • Autoscaling Dev Envs. on AWS (W.I.P.)
    • Dev Supports
    • Sprint Tasks
     

    •  LSST
      • continuation of planning for next 6 month
    • BD
      • pull requests
    • PEcAn
      • 1.5.1 release
      • rabbitmq/docker prototype
    • Industry
      • clowder deployment
    • NCSA / ISDA
      • software meeting
    • NCSA / ISDA
      • software meeting
     
     

    • BD
      • BDFiddle improvements
    • IARP
      • Develop rest of the endpoints and UI changes for promoted metadata feature
      • Add documentation of new endpoints to swagger
    • CCROP
      • Add new features to web application
      • Integrate Python program if ready
     

     - intern management - I will be bringing a new intern in to the 930 meeting this morning - then we have to find a programmer to shadow for today to give him an idea of what it is like to work for ISDA - volunteers welcome! 
    - GLTG - Phase 4 planning notes 
    - In-Core Testing Summary
    - RCR training won't happen if it is going to take long

     

    • Thank you Everyone for help with interns this week!
    • Phase 4 notes transcribed and placed in appropriate epics
    • In-core testing summary ready for input I will send at end of day on Friday when information is completed
    • RCR training when I return
    • Grace Hopper Conference Tuesday thru Friday!
    • Coordination with office during Conference
    •  pecan-- first checkout lastest code and check all is working fine
    • jupiterhub, cookie
    •   pecan-- first checkout lastest code and check all is working fine – submit a issue
    • jupiterhub, cookie – in review
      
    • Support for INCORE beta testers
    • Finalize ingestion service of the datawolf output to incore file repository
     
    • Incore beta tester support
    • Created the multi-file uploade rest end point for the data repository
    • Created ingestion process for the dataset and other POJOs with Space and file upload information tied.