Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This is a presentation and demo of Brown Dog project and service.

Highlights some XSEDE projects that are use cases of Brown Dog projects - VAT, DEBOD, IARP

How to use Brown Dog Services (1h 30m)

...

  • 20-30 mins environment setup
  • 1 hr for examples hands-on

Hands-on outline

  • 2 problems + 1 optional problem
  • 1 Extraction example -  Given a collection of images with text embedded in it and audio files, extract all  metadata using (face , ocr, speech2text) extractors, index and do content-based retrieval 
  • 1 Conversion example -  Given a collection of old file formats of images and audios, convert to a format which participants can open
  • 1 Combined example - Given an audio format, convert it to a format  *.mp3 and then uses speech2text extractor to obtain the text.
  • 1 Optional combined example - Problem 5

...

  • Participant will use his/her own laptop for this part
  • We will provide a VM with everything pre-installed in it through Nebula. 
    •  Rob Kooper will talk to Doug for this if we can spawn 50 VMs on Nebula for the tutorial session. (DONE) We will get  50 VMs on Nebula.
    •  Smruti Padhy Order 50+ flash drive for back up that will contain the VMs
    •  Smruti PadhyMarcus Slavenas, (who else?) Create a VM with everything installed in it and take a snapshot which will then be deployed within Nebula. Approx. time required - 2 days
    •  Convert the VM created(using Openstack image) to virtualBox format (*vdi) and test the configurations.
    •  Make a list of all softwares required and the directory structure for the tutorial
    •  Write a script for deployment of 50 VMs from the VM snapshot that we created. 
    •  Local installation of fence with local authentication. This is for backup to be provided in the preinstalled VM.
    •  Testing BD service with 50 concurrent users to perform conversion/extractions tasks
    •  Luigi Marini Maximum size of file that can be uploaded to Brown Dog needs to be controlled. This is require to ensure no one uploads any large files.
    •  Not sure of Jetstream yet. 
    • Provide clear instructions as how to access VMs in Nebula with proper credentials.
      •  Clear Instruction of how to access the VMs (e.g., through ssh), from different OSes.
      •  Do we need Need training accounts on nebula. Provide SSH key-pairs to each participant.
    • (Before tutorial - wiki pages with clear instructions) Installs Python/R/MATLAB/cURL to use BD Service along with the library required in case any one interested in using the BD services in future.
      •  Create wiki pages with clear instructions

...