Agenda

  • Introduce Craig
  • Weekly updates
WhoPlan for the week (Monday)Accomplished (Friday)
Dora Cai
  • Install MongoDB Scala driver
  • Design the metadata search interface
  • Implement the "and" operator to allow multiple filters in search
  • Met with Luigi and discussed the GUI interface for the new metadata search functions
  • Implemented the View for the new GUI interface
  • Met with David LeBauer and discussed some issues related to data integration and data cross-reference
Rob Kooper

Following notes are not necessarily my tasks but the whole TERRA team

  • Max
    • Work with Danforth to upload data
    • Fix roles in clowder
    • Add ability to specify file by path
    • Cleanup launching VM interface
  • Yan
    • Switch to central RabbitMQ instance for clowder
    • Extract subimage
  • JD/Rob
    • Globus transfer and notification design
    • Mounting ADS/Roger filesystems in VM
  • Scott/Rob
    • Setup betty instances
  • Scott/Max/Rob/David
    • Look at rest api for BETY
  • Dora
    • See above
  • Max
    • Deployed special clowder with upload multi-file and launcher
    • Add ability to name previews shown in Clowder
    • Fix roles
  • Yan
    • Switch to central RabbitMQ
  • JD/Rob
    • Simple design for globus transfer
    • Mount Roger on VM
  • Scott
    • Demo of simple rest get
Kenton McHenry
  • Workshop prep
  • Data Management plan text
  • TAC meeting
  • Workshop prep
  • TAC meeting
  • Exploring how to setup a petral like instance for NDS
Michal Ondrejcek
  • Move data, NDS-67, meeting with Prof. Schleife on Thursday, 2/4, discuss data and collaboration
  • continue with metadata TEM/SEM description with a new log book description, version 2
  • meet with CMM (Center for Microanalysis of Materials) director Mauro Sardela on 2/4
  • Met with Prof. Schleife, data details, related paper for metadata
  • finishing version 2,
  • done, CMM/MRL access, new data sources
David Raila
  • Data vol management strategy - create/scale/manage/understand data vols in k8s and how we
  • can utilize openstack vols cleanly
  • Devstack - fix all issues, update to new k8s test on local docker and openstack as a developer env.
  • Technical therapy - making machine and people happy together - i.e. deep technical helping
  • Tested dynamic volumes as plugin and as sidekick. Needs sidekick even with driver.
  • Extended heat-deploy to do general openstack operations - for volume integration,
  • Discussions on repository reorg - tools vs. containers vs. runtimes
  • Attended k8s community meeting and openstack sig
  • Dataverse architectural design mtgs: partitioning for docker and k8s
  • Evaluated new docker release 1.10
  • Architectural discussions on NDS PaaS service layer on long-running (production) clusters
  • Architectural discussions/plans for clusters: eliminate openstack accounts, utilize k8s namespaces,
  • service levels (stable, dev, experimental)
  • Finished heat deploy with front-end - for admin deploy of k8s clusters, now that tool is for admins not
  • end-users it needs some refinement to make it the base for the IaaS/cluster administration service
  • Software group: talk about docker
  • review/merge PRs 
  • Discussed terratoolsrv refinement with Max, k8s implementation with Mike
  • Reviewed swarm/k8s deployment pattern for simplification of deploy
Sara Lambert
  • Discuss and get past remaining Kubernetes hurdles
    • Networking: External-to-Service
    • OpenStack and Data Volumes
    • NDS-104 - Getting issue details... STATUS
  • Discover more services to containerize / clusterize
    • NDS-105 - Getting issue details... STATUS
  • Track any feedback from the prototype GUI
  • Finished NDS-104 - Getting issue details... STATUS
  • Started NDS-105 - Getting issue details... STATUS
    • ElasticSearch portion is complete!
Kandace Turner
  • Follow-up with Kenton re: possible NDSC5 demos (re: MDF, Dataverse, and SDSC)
  • Start discussions with the team re: schedule for NDSC5 technical day
  • NDSC5 program and logistics planning starts
  • Schedule NDS Core project meeting (confirm that we agreed to a Friday meeting correct?)
  • Schedule individual developer meetings
  • Developer meetings scheduled
  • Did not get the NDS Core weekly meeting scheduled; will do next week
  • NDSC5 planning
  • Per Kenton, a Dataverse demo will replace the MDF demo in our plans
  • Discussion about a possible NDS DIBBs proposal for 2016
Craig Willis

 

  • Have mostly completed NDS-103 (DataVerse). Need to restructure source before committing (based on discussion of repo organization last week).
  • Continued discussions of NDSLabs architecture and steps forward
  • Emailed DataVerse team about preliminary Docker implementation.
  • Sat in on call with ANL about Petrel service (Globus endpoint)
  • No labels