Page History

Stress test deployment of Kubernetes via Terraform with more exotic configurations.

Figure out how hard it will be to upgrade BD Tool Catalog to the current version of Play.

Advance discussion of Tool Catalog product roadmap

Create wireframe for new BD Cluster-Man

• Cover Crop
  • Status meeting - discuss milestones
  • Open JIRA issues to track features required for prototype to be complete
• Ergo/KISTI
  • Help with KISTI visitors
• IN-Core
  • Review status of v2 demo for semi-annual meeting and prepare what will be shown
  • Setup incore2-datawolf VM and other VMs for v2 demo
• Other
  • BrownDog report

• Cover Crop
  • Status meeting to discuss feature requirements
• Ergo/KISTI
  • Prepared example DataWolf/Ergo analysis
  • Met with KISTI visitors, demo datawolf/ergo analysis, review code
• IN-Core
  • Merged latest repo and fragility PRs, modified Config to read from a java properties file to configure services, updated Mongo clients to use mongodb URIs
  • Created launch scripts to run each service in a jetty container or a single container. Installed the ready services on incore2-services machine.
  • Installed datawolf and supporting libraries on incore2-datawolf machine

• NDS
  • Getting stitching demo working on ROGER
• TERRA
  • Diagnosing performance/scale issues
• Whole Tale
  • Getting deploy process working in terraform with compose

•  NDS
  • Stitching demo now working both on ROGER via qsub and via Agave API
• TERRA
  • Identified network bottleneck, opened ticket with Neteng
  • Rushed redeploy of bin2tif process on ROGER via PBS for current reprocessing initiative.
• Whole Tale
  • Near working end-to-end terraform deployment. Will create PR next week.

•  Review pull request #79
• Work on my tasks BD-1843 and BD-1820

• Reviewed pull request 79, made some remarks
•   BD-1843  Created a pull request, worked with reviewers, made changes after people reviewed and made comments·     
• BD-1823 Worked with reviewers, made some changes, had the pull request approved and merged
• BD-1820 Made progress. Made changes to let admin see possible admin actions (approve, reject, revoke script) from one view template.
  

•  Testing Data_Cleanup_Pipeline and Samples_Clustering_Pipeline using real Uber data

•  Tested 6*6*2 test cases for Data_Cleanup_Pipeline and documented in Google spreadsheet
• Created a memory utilization tool to monitor peak memory usage of running pipelines.
• Modified special docker image for Samples_Clustering_Pipeline

• Service models
• BD extractor materials
• HR

• Good way into service models, needed to estimate Nebula costs first
• HR

• BD
  • PR reviews
  • Report section
• Agri - Data ingestion scripts
• GLM/IMLCZO - PR reviews & release
• Clowder - PR reviews

• BD
  • PR reviews
  • Report section
• Agri
  • Nebula issues
• GLM/IMLCZO - PR reviews & release
• Clowder - PR reviews
• TSC meeting

•  VBD
  • translate fortran model
• GLTG
  • distributed system - postgres

•  VBD
  • some fortran model
  • investigate system setup
• BD
  • report
• GLTG
  • moved postgres to separate VM
  • start moving mongo
• UIUC
  • Ethics

• terra pipeline optimization
  • bin2tif ongoing
  • flir cleaning
• Ag Data Integration conference in Minneapolis Wed → Fri
• resume reviews
• pyclowder development oversight w/ Yogesh

• 70% through bin2tif
• flir cleaning queued & running
• successful conference!

•  MDF
  • VM on Nebula for the endpoint traffic for the last 2 months
  • work on Forge code strings
  • outreach; e-mails out
• KISTI
  
  • Ubuntu VM installation
  • OpenSEES, examples on the Mac, papers

• MDF
  • done
  • learning Globus SDK for auth and transfer
  • started
  • done some, reply from one
• KISTI
  
  • not finished
  • done

• Glossary Training
• Fragility Viewer in Virtual Machine

• • Billing API - AWS cost breakdown (W.I.P.)
  • KnowEnG Platform Ticketing System on HUBZero (W.I.P.)
  • KnowScale-1.0 (Prod)
  • Lightning talk

• • Billing API - AWS cost breakdown (W.I.P.)
  • KnowEnG Platform Ticketing System on HUBZero (W.I.P.)
  • KnowScale-1.0 (Testing)
  • Storage ADS support

•  PEcAn
  • dockerization
• LSST
  • Final checks before big run
• Industry
  • keep eye on clowder
• BrownDog/ISDA
  • mongo cleanup

•  BD
  • LDAP support for Fence
  • Brown Dog Report sections
• IARP
  
  • Add more data and metadata to IARP Clowder instance
• ISDA
  • Ethics training
  • Lightning talk
  • RCR training

• BD
• IARP
•  ISDA
  • RCR training completed
  • Ethics training completed

• PM Brown Dog report
• Finance report
• RCR Training
• In-Core Resilience training
• In-Core Beta Report - finalized
• Follow up on Nebula install
• Finalize In-Core Beta report
• HR tasks - VSL, Resumes, etc.
• PM team meeting

•  BD
  • report
  • bd-jupyterhub authorizarion
• GLM
  • finish authorization for v2

•   BD

• • report
  • bd-jupyterhub authorizarion
• GLM
  • finish authorization for v2
  • initial test for gd3.
  • re-executio for parser scheduler

• Work on Incore v2 demo
• Create necessary VMs for the Incore v2
• Start work on the new project x

• Created VMs for the incore v2
• Created the method for dumping the data from webdab to VM
• Set up the mongodbs in the VMs