2016-06-06 Stand Up Meeting notes

• Setup the Decagon and Campbell Scientific parsers to ingest datapoints on IMLCZO dev
• Register for CUASHI conference
• Add to Geodashboard the check for metadata definitions
• Out of Office Wednesday
• Begin looking at React + Backbone

• LSST
  • Distribute workflows
• PEcAn
  • Shiny example in PEcAn
  • Fluxcamp issues
• SEAD
  • CATS-500 - Getting issue details... STATUS
• TERRA
  • Increase disk space BETY-7
• ISDA/NCSA
  • Software Meeting

• NCSA/ISDA
  • Software Meeting
• SEAD
  • Finished code for ToS
• TERRA
  • Increased disk storage to 500GB
• LSST
  • Assigned initial workflow systems
  • Added some criteria to review workflow systems

• NIST-CORE
• HR

• NIST-CORE
• HR

• BD: update extractors (4 opencv ones and more steps for OCR when Luigi finishes the dbpedia example); tutorial tasks.
• Earthcube:
  • search clowder data for model: work with Peishi, Yao, Luigi re integration with CSV annotation, RAS.
  • Finish arranging travel for Earthcube All-Hands meeting.
  • Documentation on sw/module installation on the VMs.

• BD: updated opencv faces extractor. Reviewed Inna's simple language dockerization PR, Luigi's pyclowder PR.
• Earthcube:
  • search clowder data for model: proj meeting; added model name and var units in output; added test scripts to automate adding dataset, files and metadata.
  • Finished arranging travel for Earthcube All-Hands meeting.
  • Documented one more sw installation: Emeli-web at here.
  • PR for searching clowder data with temporal and spatial constr merged, and deployed to ecgs-dev.

• BrownDog code reviews
• BrownDog end to end testing
• NDS Interfaces
• HR

• BD Tutorial prep
• Reviewed BD pull requests
• Updates to BD web page
• Workshop proposal
• MBDH Data, Tools, and Services Working Group
• NDS Interfaces
• HR

• Vacation through June 8th, half day June 9th
• General - catch up on email
• NIST - review pull requests

• NIST
  • Reviewed pull requests, merged finished ones
• General
  • Caught up on email, sent follow ups for some ERGO questions

• BD
  • Extractors refactoring
    • dbpedia jsonld cleanup
    • logging cleanup
  • Fix bd-api chunked file upload
• SEAD
  • Develop tree selection widget
  • Update beta
• GLM 
  • update instances
  • Develop search page
• ECGS
  • Develop annotate-csv
• Clowder 1.0

• BD
  • Added registration function to pyclowder and example extractors
  • Resolved the issue with chunked file upload to fence
• SEAD
  • Merges and pull requests
• GLM
  • Calling geostreaming apis from redux flow
• ECGS
  • Added ability to post mapping to geointegration service

• SEAD - work on Beta 2 Sprint 6; CATS-559 - Getting issue details... STATUS , CATS-560 - Getting issue details... STATUS , CATS-548 - Getting issue details... STATUS
• MDF - 2016-06-06+Kickoff, meeting with Dr. Kathy Welsh, Andre's endpoint
• MWRD - finish graphs

• SEAD - work on Beta 2 Sprint 6, some done
• MDF - 2016-06-06+Kickoff, DIBBs meeting Friday

• BD
  • Submit Copyright form for XSEDE paper
  • XSEDE Camera Ready paper preparation
  • Create a VM with everything installed
  • XSEDE Tutorial tasks
  • Follow up with Richard on NAGARA presentation preparation
• SDN
  • Final Poster submission
  • Provide set-up instructions for timing exp to the new Intern
  • Demo of HTB experiments

• BD
  • Submitted the copyrightform for XSEDE paper
  • Revised the XSEDE paper for camera ready submission
  • Continued installing software to the Tutorial VM
  • Added json-ld support to the word count extractor
  • Updated the BD-CLI keys/tokens branch and the branch was merged
  • Ordered and recieved the flash drives for the tutorial
• SDN
  • Prepared and submitted the final poster for the SoSSDN workshop
  • Provided set-up inst. to Lavanya
  • Demoed HTB exp
• HR

• VAT
  • Spaces integration in VAT instances
• DEBOD
  • Extractor for Digital Media Project
• IARP
  • Next tasks
• BD
  • XSEDE tutorial extractor

• VAT
  • Fixed a minor bug
  • Started work on CATS-512 - Getting issue details... STATUS
• DEBOD
  • Implemented basic functionalities of the Digital Media Project Extractor
• IARP
  • Identified next tasks for IARP
• BD
  • Worked on the CSV extractor for the XSEDE tutorial

• Add JsonLD and other necessary code to finish updating the SimpleLanguage extractor
• Make a pull req
• for the XSEDE tutorial - wordcount extractor with grep
• for the XSEDE tutorial - tool catalog

• Pull request - had to make some changes, was approved, for dockerizing the SimpleLanguage extractor
• XSEDE tutorial - Tool Catalog - tutorial created and uploaded to box
• wordcount extractor with grep - done

• GLTG
  • continue work on parsing tennessee data
• GLM
  • look at config name issue
• IARP
  • provide system architecture image for paper
  • reread and edit as needed
• BD
  • Finish speech2text - start sentiment
  • start on vm development
  • start tutorial outline portion

• GLTG
  • work on parsing datapoints - battle with openpyxl
• IARP
  • create system architechure diagram for paper
  • rewrite technical sections for paper
• BD
  • test/fix speech2text on extractor-0017/dts-dev
  • started trying to add jsonld to speech2text - not much success yet
  • meet with Michael Miller about spin student who will use speech2text

Vacation Monday And Tuesday.

GLM

• Work on new Search Page

SEAD

• Update in License on POST request.
• Some updates to the metadata pull request

Vacation Monday And Tuesday.

GLM

• Work on new Search Page

SEAD

• Update in License on POST request.
• Some updates to the metadata pull request

• Finish raster unique, interval, and ramp data style UI

• Worked on aster style set dialog

• Meet with John and Vipin
  • Modify Tornado Scenarios According to their feedback
• Implement Standard Deviation in Tornadoes
• Thrust 2

• Met with John and Vipin
  • Modified RandomAngle according to their feedback
  • Modified Random angle function to use the historical mean and standard deviation.
• Thrust 2
  • Architecture Changes
  • Visualization for similar datasets
  • Visualization of analysis-dataset workflow
• Directional Statistics Review (will send dataset analysis to CSU)

• finish pull request for PyClowder dataset extractor
• Add LogStash stream to Globus monitors for TERRA pipeline
• Adjust Clowder submission process to submit files across multiple threads
• Move SHA512 calculation on files to extractor
• Indexing metadata in elastic search

TERRA

• LogStash config for python monitors
• Fix to FTP Globus file queuing
• planning extractor webinar

PyClowder

• CATS-566 - Getting issue details... STATUS
• CATS-554 - Getting issue details... STATUS
• Added sample dataset extractor
• Continue to improve capabilities

Clowder

• CATS-565 - Getting issue details... STATUS
• CATS-561 - Getting issue details... STATUS
• approve 2 other pull requests

• SEAD
  • SEAD-1004
  • SEAD-1035
• MSC
  • analysis on new image
  • check in code

• SEAD
  • SEAD-1004
  • SEAD-1035
• MSC
  • just get one new image