2015-09-08 Stand-Up Meeting notes

• Add functionality to Clowder to download all files in a dataset.
• Update config files on IMLCZO, SeaGrant and GLTG.
• Get feedback on slider date range designs
• Get feedback on some proposed changes to search page

• MSC
  • AJT Paper 1st draft is ready for comments.
  • Work on refinements to accuracy and usability of Web interface (CRI-91)

• vacation

• vacation

• Traveling for CyberSEES presentation

• BD: docker sprint: Elasticity integration: design.
• Earthcube: project meeting.

• BD:
  • New Nebula account created, logged in, set up firewall rules, uploaded a key pair, launched a VM, sshed in.
  • docker:
    • Scoping analysis for efforts needed for the docker elasticity feature.
    • docker elasticity design.
    • Rebuilt the docker images and pushed them into Docker Hub "NCSA" account. Built a docker VM image and pulled the docker images on to it, tested running a docker OCR/OpenCV container on it, saved a snapshot as a VM image to be used later as the base image for a docker VM – part of implementation.
• Earthcube:
  
  • Had a project meeting. Sent Praveen the IP address of the production machine for DNS redirection. Created wiki accounts for Leslie and Kim, answered Leslie's question on Clowder accounts.
  • Helped Peishi to test running 2 simultaneous test clients against the BMI service, debugged and resolved 1 issue, discussed another issue with him.
  • Per my request, NCSA IT created an earthcube-geosemantics mailing list, verified that it was working.

• Re-organization stuff
• UCAR Leadership followup
• HR Stuff
• BD Sprints

• Re-organization stuff!!!!!!!!!
• UCAR Leadership followup
• HR Stuff

• BD json-ld pull request against develop
• BD ldap user management
• SEAD curation area GUI
• SEAD spaces pull request against develop
• Earthcube json-ld support
• Clowder documentation
• Meeting with Medici Michigan instance
• XSEDE VAT multimedia search bug and speed ups

• Fixed bugs with jsonld code
• Adding ability to list metadata by field instead of chronologically
• Setup an ldap server and tried to get crowd-id (openid) to work (with no avail)
• Reading about key management options for rest api
• SEAD/IMLCZO pull requests
• Finished clowder landing page (still need to modify a few things on it)
• Successful meeting with "chicana por mi raza" group at Michigan
• Way too many meetings and calls

• Traveling for CyberSEES presentation

• Attended GI Venture meeting - software demo to project teams, polished slides/software for demo to the advisers (next day), met with other developers to determine next steps

1. deploy all tools to MWRD VM
2. Finish the Station merge with CSS, JavaScript MWRD-158
3. Finish data ingestion design for Stations, MWRD-114, green design
4. Continue writing general Documentation

1. Yespointing to the Test database
2. Yes
3. SELECT works fine, shows, UPDATE does not work (restMWRD)

• BD - Start working on IEEE Big Data Short paper
• BD - Design experiments for JDIQ paper
• SDN - Continue working on the design document for SDN QoS
• vacation - Thursday and Friday

• BD
  • Created a directory for short paper version and updated all image/section references in the new tex files
  • Started the implementation of DTS landsat extractor. Based on student document, tried to extract the table (earth-sun distance in astronomical units) from the published paper. But found a excel file of the table online. So, Converted the (earth-sun distance) table in excel to csv. Writing a parser to obtain the required field. Then also looked into the parser to parse the MTL file associated with each input scenes for different input parameters.
• SDN
  • Worked on the SDN QoS design document
• Vacation - Thursday and Friday

• Initial discussion and information gathering on Bertillon Cards Analysis project
• BD-741 Continue with design efforts for HPC
• Go through papers / extractors on Census project

• Had meeting with the Bertillon Cards Analysis project team
• Started going through papers from Census project, related literature in word spotting, and our existing extractors for handwritten digit recognition
  
• BD-741 created a rough work flow and architecture diagram. Attached to JIRA task
  

• Census Segmenter - remove jar files from project lib, make sure the correct versions of jars are in Nexus.

• BD
  • continue work on bd.m
• GLTG
  • begin aggregating greon files into a monthly file for raw storage
• IARP
  • further investigate posting problem (stops at ~15000 files)!
    • indexing mongodb did not work

• BD
  • bd.m able to get files to post to clowder - still needs cleanup, but basic requests functions now working
  • should be able to start building library soon
• IARP
  • continued work on posting to clowder issue
    • tried adding indexes, but did not appear to help
    • start testing on desktop with develop branch - much faster - but we'll see
• GLTG
  • changed dataset structure for greon files on gltg-dev (still need to aggregate files)

SEAD:

• Save User Preferences in the Curation Flow
• Keep track of the status of a publication object
• Make Updates to the ORE Map.

CyberSEES:

• Backbone and Underscore Tutorials

SEAD:

• Save User Preferences in the Curation Flow
• Keep track of the status of a publication object
• Update Permission for all steps within Staging Area Flow

CyberSEES:

• Backbone and Underscore Tutorials

• Catch up on email from last week
• MWRD - Contact Chicago office to set up on-site meeting
• BD - Extend sprint 1 week, pull short tasks from backlog as needed
• NIST - Bi-weekly reporting
• GLTG - TBD

• MWRD - tentative dates and timeline set. Need to confirm with Rob when he's back from vacation
• BD - Sprint extended. Update sent. More follow up to do.
• NIST - ethics training, reporting, leads status call
• GLTG - following up with domain scientists for use case to present to CS group for possible collaboration
• NCSA - Submitted recommendations for colloquia speakers. Discussion on-going
• SC15 - tentative schedule for demos waiting approval. Need Rob and Jong to review when they return.

• Finishing touches to Roadway Damage Analysis
• Roadway Restoration Analysis
• Finalize Software Requirements Survey
• Get Laptop Setup

• Finished roadway damage analysis (added the expected damage state)
• Roadway Restoration Analysis (Almost complete)

• Debugging ERGO
• Write a code for road network discretization

• Debugging ERGO (ERGO-275, ERGO-283)
• Write a code for Road Discretization

• MSC
  • TLS detect
• SEAD
  • file metadata of curation object
    
    

• MSC
  • TLS detect – a workflow
• SEAD
  • file metadata of curation object