Page History

...

(Gregory Jansen, Rui Liu) Developer downloads BrownDog development environment in docker container (in dockerhub, link on BD webpage)
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-956
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-957
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-958
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-959
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-960
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-1009
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-1017
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-1007
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-1016
- Contains running Clowder instance, Polyglot instance, basic development tools, mabye even an IDE configured and ready to go
- Contains a bare-bones extractor ready to be modified for a new tool (with comments suggesting where to edit, in various languages e.g. python, C++, Java, ..., and docker sample file)
- Contains a bare-bones converter ready to be modified for a new tool (with comments suggesting where to edit, in various languages e.g. bash, bat, ahk, python, ..., and docker sample file)
- (Done) Polyglot changes from redirecting to SS to downloading and serving converted files to users' "/file/" requests, to support 1 Pol + multi SS docker containers on the same VM.
- (Done - Rui provided the files/images.) docker-compose.yml file, docker images for Polyglot server + 2 different SS to work together on the same VM.
(Gregory Jansen, Smruti Padhy) Developer installs tool, creates BrownDog interface script(s)
- Adds sample input file(s)
- Example extractor: imagemagick edge detector
- Example converter: imagemagick jpg to ico converter
(Gregory Jansen, Smruti Padhy)Developer creates dockerfile
- For extractors this should contain only the tool, its dependencies, and the extractor
- For converters this should contain the basic Polyglot setup, ideally only the Software Server, the tool, its dependencies, and the converter interface script
- Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-983
(Rui Liu, Inna Zharnitsky) Developer submits tool to Tools Catalog (using BrownDog account)
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-961
Jira
server JIRA
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key BD-962
- (Done) BrownDog interface script(s), dockerfile, sample input, sample output
- TODO: Documentation on how to add tool to Tools Catalog
- (Done) Through web interface
- Through script in development environment (probably the ideal way) ,
  Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-962
(Inna Zharnitsky, Marcus Slavenas) Admin presses Admin reviews and tests tool by pressing button which deploys tool in a separate Clowder/Polyglot sandbox, passes in the given input file, and checks the obtained output file against what is provided
1. Returns pass/fail
2. (Rui Liu, Inna Zharnitsky) Admin deploys tool by selecting instances to deploy interface on
  Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-916
  Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-954
  Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-733
  (Rui Liu) Admin selects instances to deploy interface on
  - e.g. dts-dev or dts
  - selects minimum number of instances to provision (e.g. 5 instances)
  - presses button to deploy
  - Elasticity backend: deploy docker images
    Jira
    server JIRA
    columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
    key BD-890
    , deploy VM images
    Jira
    server JIRA
    columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
    key BD-930
    , stop
    Jira
    server JIRA
    columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
    key BD-941
    .
  - Tool Catalog UI: BD-733 (deploy), BD-954 (stop).
  - Task: integration testing after the web UI part is done.
    Jira
    server JIRA
    columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
    key BD-975
3. (Sandeep Puthanveetil Satheesan) Admin receives status page showing number of tools deployed and where, load on each tool, etc...
  - No support for this at this time.
  - How to pull this from MongoDB
...
- (Luigi Marini) API Gateway with keys and tokens (uses Crowd credentials)
  - (Not for April 4) Forwarding user credentials to Clowder
  - Clients
    - (Marcus Slavenas) MatlabMatlab
      Jira
      server JIRA
      columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
      key BD-620
      - Working and includes test script: DAP Outputs, DAP Convert, DTS Extract, and Download File
      - Not yet translated from bd.py: index, find, descriptor distance
    - (Smruti Padhy) R R – available
    - (Luigi Marini) curlbash script using curl
      Jira
      server JIRA
      columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
      key BD-984
    - (Luigi Marini) Python – available bd-cli
    - (Smruti Padhy) Windows Windows – Dap is there, for DTS not sure
      Jira
      server JIRA
      columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
      key BD-1004
      Jira
      server JIRA
      columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
      key BD-1005
    - (Smruti Padhy) Bookmarklet -
    - (Smruti Padhy) Chrome Extension
    - Add keys and tokens to all clients
      - Jira
        server JIRA
        serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key BD-986
        Jira
        server JIRA
        serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key BD-987
        Jira
        server JIRA
        serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key BD-988
        Jira
        server JIRA
        serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key BD-988
        Jira
        server JIRA
        serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key BD-989
        Jira
        server JIRA
        serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key BD-990
        Jira
        server JIRA
        serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
        key BD-991
- (Jong Lee, Eugene Roeder) Simple web interface (requires BrownDog account)
  Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-967
  Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-970
  Jira
  server JIRA
  columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
  serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
  key BD-976
  - Web form with field box for file URL or upload
  - Tool selection dropdown box (means of selecting a specific tool)
  - Output select dropdown box (means of allowing system to select tool)
    - Clowder will run all relevant extractors (obtained by selecting "json" as the output)
    - Polyglot will use I/O-graph
  - Suggestions pane will update below
    - REST API performing this same operation
    - Python code in Jupyter lab notebook
    - R code
    - Matlab code
    - curl commands
    - php

Page tree

Versions Compared

Old Version 19

New Version Current

Key