Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Research Data Management Tools

NameDescriptionIn Labs Workbench?
Notes
browndogData transformation service, http

...

...

...

NameDescriptionStatusapacheWeb serve, https://httpd.apache
.org/
  •   
 
clowderData hosting/sharing, https://clowder.ncsa.illinois.edu/
  •   
 
dataoneRepository, https://www.dataone.org/
  •   
 
dataverse
Archive
Repository, http://dataverse.org/
  •   
 
dspace
Archive
Repository, http://www.dspace.org/
  •   
 
eclipse
fedora
IDE
Repository,
https
http://
eclipse
fedorarepository.org/
  •   
 
girderData hosting/sharing, http://girder.readthedocs.org/en/latest/index.html
  •   
 
gitlabSource code management
globusData transfer/publishing, https://
about
www.
gitlab
globus.
com
org/
  •   
globus
 
hubzero
Data
Tool sharing, https://
www
hubzero.
globus.
org/
  •   
 
irodsFederated Archive, http://irods.org/
  •   
jupyter
Electronic notebook, http://jupyter.org/
 
 
kallithea
omeka
Source code management

Repository, https://

kallithea-scm

omeka.org/

  •   
 
 
mediagoblin
scidriveData hosting/sharing
Media publishing
, http://
mediagoblin
scidrive.org/
  •   
mediawikiWiki,
 
zenodoData & software publication, http
https
://
www.mediawiki
zenodo.org
/wiki
/
MediaWiki
  •    
moinmoinWiki, https://moinmo.in/
  •   
mongodbNoSQL database, https://www.mongodb.org/
  •   
 

Data Analysis and Visualization

NameDescriptionIn Labs Workbench?Notes
cyverseData storage/analysis, http
mysqlDatabase, https
://www.
mysql
iplantcollaborative.
com 
org/
  •   
nginxWeb server, http://nginx.org/en/
 
owncloudCloud storage
galaxyData intensive research platform, https://
owncloud
galaxyproject.org/
  •   
 
postgres
jupyter
Database
Electronic notebook, http://
www
jupyter.
postgresql.
org/
  •   
rabbitmq
Distributed messaging bus, http://www.rabbitmq.com/
 
 
rstudioIDE for R, https://www.rstudio.com/
  •   
 
scidriveData hosting/sharing
tworavensStatistical tools, http://
scidrive.org/
datascience.iq.harvard.edu/about-tworavens
  •   
torch
Machine learning, http://torch.ch/
 
 
wekaMachine learning, http://www.cs.waikato.ac.nz/ml/weka/
  •   
 
ytData visualization, http://yt-project.org/
  •   
zenodoData & software publication, http://zenodo.org/
 
 

Containers

Software Development Environments

...

NameDescription
Status

busybox

Busybox provides several stripped-down Unix tools in a single executable file. It is lightweight and portable and is specifically created for embedded operating systems with very limited resources. For instance, you can perform most linux commands on Android with Buysbox instead of installing all required files.

busybox is docker's core image. To get it type:  docker pull busybox

  •   
curldrop

Curldrop is a simple (less than 100 LOC) web application that allows you to upload files straight from your Terminal with curl.

curldrop can be found here: https://github.com/xarthisius/curldrop

  •   
devenv

Development Environment for yt, it's docker image containing everything that's required for yt to run.

  •   
docker-registry-frontend

The front end to enable browse and modify the Docker registry in the web-browser.

docker-registry-frontend, see first line of service file

  •   
docker-registry

Docker registry is used to push Docker images for storage and sharing.

docker-registry: another integral part of docker:
docker pull docker/registry (https://github.com/docker/docker-registry)
We should probably use v2 instead (https://docs.docker.com/registry/deploying/)

  •   
hublaunchHublaunch is basically a devenv designed to either start ipython notebook or run provided python script (usually directly related to yt).
  •   
irods-icatIcat server uses a relational database to organize the content of IRODS zone and to maintain iRODS metadata.
  •   
irods-idrop2A GUI to upload and download files and examine metadata.
  •   
irods-restRest API for irods.
  •   

fuse to irods

(docker image only)

FUSE (Filesystem in Userspace) is an Unix kernel module that allows non-privileged users to create their own file systems without editing the kernel code.
  •   
kallitheakallithea is a software source code management system. It supports two version control system Mercurial and Git.
  •   
keyringsKeyrings is used to store user's login information and it is encrypted with a master password.
  •   
moinmoinMoinMoin is a wiki engine, initially based on the PikiPiki wiki engine.
  •   
nds-explorerNDS UI for managing resources and services.
  •   
nginxNginx is a web server with a strong focus on high concurrency, performance and low memory usage.
  •   
owncloudownCloud provides cloud storage system service. It is pretty much like Dropbox but free and open source.
  •   
postgres-icatA DBMS supported by ICAT database
  •   
postgres-owncloudA DBMS we are going to use on owncloud.
  •   
proxy

A simple wrapper around node-http-proxy that adds a REST API for updating the routing table.

proxy is specifically 'configurable-http-proxy' https://github.com/xarthisius/configurable-http-proxy

  •   
rabbitmqRabbitmq is a messaging broker. It provides applications a common platform to send and receive messages.
  •   
rstudioRstudio is an IDE for R.
  •   
scidrive

Matt/Venkat

OS object store

  •   
torchtorch is scientific framework for luajit. http://torch.ch/
  •   
webserveIt is the template used to launch containers that expose port 80 as a default (most web apps).
  •   
ytwebappIt is used to manage NDS services such as list docker images, run docker containers, list containers, view docker logs, stop containers and transfer data.
  •   
mysqlA DBMS.
  •   
globus endpointGridftp server.  Endpoint for globus, a service to enable grid computing: by connecting computing resources, the data can be freed from its initial source, and made portable.
  •   
DataVerseA web app to share, preserve, cite, explore and analyze research data
  •   
DSpaceDSpace is a repository software package typically used for creating open access repositories for scholarly and published digital content. 
  •   
ZenodoZenodo is a service that enables researchers, scientists, EU projects and institutions to share and showcase multidisciplinary research results.
  •   
Clowder (previously: Medici)Clowder is a web-based content management system that allows users to share, annotate, organize and analyze large collections of datasets. Unlike other CMS, Medici focuses on unstructured data in the form of arbitrary files and structured data in the form of metadata associated with the files. Additional key features being developed include a robust structure for organizing datasets into collections and project spaces, and keying access permissions based on user roles within a given space.
  •   
In Labs Workbench?Notes
cloud9https://github.com/c9
  •   
License?
eclipsehttps://eclipse.org/
  •   
 
eclipse chehttp://www.eclipse.org/che/
  •   
 
ideahttps://www.jetbrains.com/idea/
  •   
 
pycharmshttps://www.jetbrains.com/pycharm/
  •   
     
 
vscodehttps://code.visualstudio.com/
  •   
 

General Services

NameDescriptionIn Labs Workbench?Notes
apacheWeb server, https://httpd.apache.org/
  •   
 
elasticsearchText indexing, https://www.elastic.co/cloud/signup
  •   
 
gitlabSource code management, https://about.gitlab.com/
  •   
 
glassfishJava application server, https://glassfish.java.net/
  •   
 
kallitheaSource code management, https://kallithea-scm.org/ 
  •   
 
mediagoblinMedia publishing, http://mediagoblin.org/
  •   
 
mediawikiWiki, https://www.mediawiki.org/wiki/MediaWiki
  •   
 
moinmoinWiki, https://moinmo.in/
  •   
 
mongodbNoSQL database, https://www.mongodb.org/
  •   
 
mysqlDatabase, https://www.mysql.com/
  •   
 
nginxWeb server, http://nginx.org/en/
  •   
 
owncloudCloud storage, https://owncloud.org/
  •   
 
postgresDatabase, http://www.postgresql.org/
  •   
 
rabbitmqDistributed messaging bus, http://www.rabbitmq.com/
  •   
 
solrSearch, http://lucene.apache.org/solr/
  •   
 
xwikiWiki, http://www.xwiki.org/xwiki/bin/view/Main/WebHome
  •   
 

Previous version can be found here.