NDSC6

Document	Priority	Notes

Assigned to

Assignee	Reviewer	Status	Related Link(s)

Update labsportal WordpressHigh Kenton?

Official NDS Domain

High

Jira
server JIRA
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key NDS-156

Footer:

Move Github so that it's the first link under "NDS Project Resources"

PR/Kandace

What should NDS Provide:

Broken link to NDS Services Diagram (behind protected area in Wiki?)

PR/Kandace

Pilot projects:

Add descriptions for: SBGrid, NIST (materials registry/curation), Pragma projects.

PR/Kandace

Get Involved

Remove Trello link
Move Github to first position

PR/Kandace

Labs:

Implement edits from Revised NDS Labs Content

PR/Kandace

Pilot application

If we are going to maintain both the Workbench registration and pilot application, we'll need to update the pilot application.

Distinguish from Workbench
Remove labsportal link.

PR/Kandace

Open questions/Undecided

"Get Involved" and top menu contain links to page to subscribe to mailing list – including discuss. We need to decide whether "discuss" will continue to be used.
News is really out of date
Do you have to have an approved pilot to access the Workbench? (Open question for TAC/Steering committee)
- Pilots need to use Workbench to come up with the pilot idea
- Workbench is one of the many services offered by NDS Labs
  - 2 cases: explore (pre-pilot test drive), develop (pilot)
  - Pre-pilot = NDSC member, RDA member?
    - We need NDSC developers that are not pilot members to have access to contribute tools
  - Pilots need more resources (e.g., PRAGMA) – outgrow Workbench
  - Workbench has two services: test drive and developer

Labs Portal

High

~~Redirect labsportal requests to http://www.nationaldataservice.org/projects/labs.htm~~

~~Craig~~

~~Done~~

Jira
server JIRA
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key NDS-327

~~Move to Wiki an revise as needed http://labsportal.nationaldataservice.org/accessing-ndslabs/~~

~~Kenton~~

~~Done~~

~~Remove all other content/decommission site~~

~~Craig~~

~~Done~~

NCSA Opensource Confluence

High

The NCSA Opensource confluence will be used primarily for development, project management, and in-progress documentation going forward.

https://opensource.ncsa.illinois.edu/confluence/

Identify and remove duplicate content

See Confluence audit below

Add a note pointing to official NDS Confluence documentation

Craig

Open questions

Q. Should this be migrated to hosted Confluence (e.g., JIRA)
Consider securing NDS space within NCSA Confluence - use this for internal notes

NDS Confluence

High

Review public documentation
Fill out more details on template stubs

https://nationaldataservice.atlassian.net/wiki/

~~NCSA Confluence~~

~~Archive or add note that this is historic~~
~~https://wiki.ncsa.illinois.edu/display/NDS/National+Data+Service+Home~~

~~Craig~~

~~Done~~

~~Added note on front page~~

YouTube Channel

High

Update descriptions
Ensure that videos make sense

https://www.youtube.com/channel/UCWuPo7LDCzsqF3RaKzIQmHw

Google Group

High

Add links to new documentation
Revisit description
Add an FAQ?

Craig

Mike

Ready for review

https://groups.google.com/forum/#!forum/ndslabs

Tutorial repo

readme

with examples

High

~~Needs community information~~

~~Craig~~

Update with new examples?
Make sure old ones still work

Mike

Craig

~~Mike~~

https://github.com/nds-org/

ndslabs~~ndslabs-specs repo readmeHighMike -> Craig: Looks good, I think?Craig/MikeMike/Craig~~

developer-tutorial
FAQ	High	Add contents to the FAQ	Craig			https://nationaldataservice.atlassian.net/wiki/display/NDSC/Frequently+Asked+Questions
User Guide	High	Review	Craig	Mike	Ready for Review	https://nationaldataservice.atlassian.net/wiki/display/NDSC/User%27s+Guide Using Docker Images Adding NDSLabs Services (this is an old draft) https://github.com/docker-library/official-images
Developer Guide	High	Finish filling out Developer Guide Needs more about authoring dockerfiles / builds / etc	Craig +Mike			https://nationaldataservice.atlassian.net/wiki/display/NDSC/Developer%27s+Guide Building Custom Docker Images

~~Done~~

Docker Hub

Medium

Review Automated Builds (see audit table below)

See below

https://hub.docker.com/search/?isAutomated=1&isOfficial=0&page=1&pullCount=0&q=ndslabs&starCount=0

GitHub

Medium

Review READMEs (see audit table below)
Delete unecessary repos
- k8s-ingress
- kubernetes
- contrib?
- invenio
- data-provider
- glopy
- scidrive
Flatten out Service repos
- Remove k8 specs
- Move Dockerfiles to root
Clean-up Clowder

See below

Jira
server JIRA
serverId b14d4ad9-eb00-3a94-88ac-a843fb6fa1ca
key NDS-512
https://github.com/nds-org/ndslabs

-clowder repo readme~~HighCraig: Looks good.MikeCraig~~

~~Ready for review~~

- https://github.com/nds-org/ndslabs

-clowder

clowder/tree/master/dockerfiles

clowder/tree/master/kubernetes~~ndslabs-dataverse readmeHigh~~

Mike -> Craig:
Looks good

~~CraigMikeReady for review~~

dind https://github.com/nds-org/ndslabs-jenkins etc
BitBucket	Medium	Craig to add readme with link to github Unable to actually add readme, but changed project URL	Craig	Mike	To be reviewed	https://bitbucket.org/nds-org/ Unable to actually add readme, but changed project URL.
Other Wikis?	Low	Archive				https://wiki.ncsa.illinois.edu/display/NDS/National+Data+Service+Home
Architecture Docs	Low	Make sure these reflect reality

https://github.com/nds-org/ndslabs

-dataverse~~ndslabs-irods readmeMedMike -> Craig:~~
~~Would it be beneficial to link to irods-federate / dataverse in 'See also'?CraigMikeReady for review~~

~~https://github.com/nds-org/ndslabs-irods~~

/tree/master/docs

Confluence audit

Page	Owner/ Creator	Notes
NDS Labs	Kenton	Archive given new content? https://nationaldataservice.atlassian.net/wiki/display/NDSC/NDS+Labs Kenton: Lets keep this as this is the dev wiki for planning and documenting activities specific to Labs. Perhaps should add a note making this clear. Most of the work here may be in better organizing NDS Labs Design Documentation where most of the material is at.
~~NDS Labs Overview~~	~~Kenton~~	~~Archive?~~ ~~Moved under NDS Labs Design Documentation~~
NDS Labs Architecture	David	Out of date, needs to be updated and should be moved to official Wiki
NDS Labs API	Craig	Out of date, should be archived and a link to the actual API documentation included on official Wiki
~~NDS Labs Web Interface~~	~~Kenton~~	~~Out of date, should be archived~~ ~~Kenton: Moved under NDS Labs Design Documentation~~
~~NDS Labs Examples~~	~~Kenton~~	~~Out of date, should be archived~~ ~~Kenton: Moved under NDS Labs Design Documentation~~
~~NDS Labs Service Specification~~	~~Craig~~	~~Out of date, should be archived, already links to ndslabs-specs repo.~~
NDS Labs Test Cases	Craig	Maybe archive? If already included in Mike's test plans
NDS Labs Design Documentation	All	Keep, still valid. Could be reorganized.
Developer Workflows	Mike	Keep, still valid.
Glossary	Mike	?
Pilot architectures	Craig	TBD. Possibly move to official Wiki. Or maybe this is just useful for me
~~Towards Developer and Development Groups~~	~~David~~	~~Mockups for developer support, should be archived or moved to design~~ ~~Kenton: Moved under NDS Labs Design Documentation~~
~~Concepts for Developer Support~~	~~David~~	~~Mockups for developer support, looks like duplicate~~ ~~Kenton: Moved under NDS Labs Design Documentation~~
Beta Release	Craig	Beta release features, can be archived since this already exists on official Wiki
~~NDS Share~~	~~Kenton~~	~~Keep~~

Repositories and automated builds audit

Git Repo	Docker repo	Dockerhub Build type	Readme	Owner	Notes/What is it used for?.
angular-terminal-test		NA		Mike
core		NA		Mike	Fork of Cloud9 core
data-provider-interface		NA			Legacy - can be deleted
developer-tutorial	https://hub.docker.com/r/ndslabs/cowsay-php/	manual
	https://hub.docker.com/r/ndslabs/cloud9/	manual
	https://hub.docker.com/r/ndslabs/cowsay/	manual
geospatial-search-demo		NA			Legacy - can be deleted
glopy		NA		David?	Fork of Python Globus toolkit
gluster	https://hub.docker.com/r/ndslabs/gluster/	auto	revisit	David	System component. Readme seems out of date.
invenio	https://hub.docker.com/r/ndslabs/invenio/	auto		Craig	Incomplete service should be noted in readme
k8-labels		NA		Mike	Do we still need this?
k8s-ingress-nginx		NA		Craig	Do we still need this?
kubernetes	https://hub.docker.com/r/ndslabs/hyperkube/ https://hub.docker.com/r/ndslabs/kube-controller-manager-amd64/ https://hub.docker.com/r/ndslabs/kube-scheduler-amd64/ https://hub.docker.com/r/ndslabs/hyperkube-amd64/` https://hub.docker.com/r/ndslabs/kube-apiserver-amd64/ https://hub.docker.com/r/ndslabs/kube-proxy-amd64/ https://hub.docker.com/r/ndslabs/kube-proxy-arm/	Manual		David	Do we still need these?
logspout	https://hub.docker.com/r/ndslabs/logspout/	auto	fork	Craig	Used in Labs Workbench
nagios-config		NA	revisit	Craig	Current Nagios configuration repo. Readme is incomplete.
nds-labs-legacy		NA			Legacy noted in description
ndslabs	https://hub.docker.com/r/ndslabs/angular-ui/	auto		Mike
	https://hub.docker.com/r/ndslabs/apiserver/	auto	revisit	Craig	Used in Labs Workbench. Readme is out of date
	https://hub.docker.com/r/ndslabs/ndslabs-gui/	manual		Mike	Retained for 1.0.0 compatibility
ndslabs-all-sources		NA		David	Do we really need this? Does anyone use it?
ndslabs-chisel	https://hub.docker.com/r/ndslabs/chisel/	auto	ok	Craig	Used in Labs Workbench
ndslabs-clowder	https://hub.docker.com/r/ndslabs/clowder/ https://hub.docker.com/r/ndslabs/audio-preview/ https://hub.docker.com/r/ndslabs/image-metadata/ https://hub.docker.com/r/ndslabs/pdf-preview/ https://hub.docker.com/r/ndslabs/speech2text/ https://hub.docker.com/r/ndslabs/image-preview/ https://hub.docker.com/r/ndslabs/video-preview/ https://hub.docker.com/r/ndslabs/plantcv/ https://hub.docker.com/r/ndslabs/image-extractor-base/			Mike
ndslabs-dataverse	https://hub.docker.com/r/ndslabs/dataverse/	auto	revisit	Craig	All components share a single readme, which is out of date (mentions of Kubernetes?)
	https://hub.docker.com/r/ndslabs/dataverse-icat/	auto		Craig
	https://hub.docker.com/r/ndslabs/dataverse-rserve/	auto		Craig
	https://hub.docker.com/r/ndslabs/solr/	auto		Craig	Should be dataverse-solr
	https://hub.docker.com/r/ndslabs/tworavens/	auto		Craig
ndslabs-deploy-tools	https://hub.docker.com/r/ndslabs/deploy-tools/	auto		David
ndslabs-developer-shell	https://hub.docker.com/r/ndslabs/ndsdev/	manual		David
ndslabs-devenvs	https://hub.docker.com/r/ndslabs/cloud9-base/	auto	no	Mike	The devens readme is a stub
	https://hub.docker.com/r/ndslabs/cloud9-cpp/	auto	no	Mike
	https://hub.docker.com/r/ndslabs/cloud9-go/	auto	no	Craig
	https://hub.docker.com/r/ndslabs/cloud9-java/	auto	no	Mike
	https://hub.docker.com/r/ndslabs/cloud9-nodejs/	auto	no	Mike
	https://hub.docker.com/r/ndslabs/cloud9-php/	auto	no	Craig
	https://hub.docker.com/r/ndslabs/novnc-base/	auto	no	Craig
	https://hub.docker.com/r/ndslabs/pycharm-clowder-novnc/	auto	clowder	Craig
	https://hub.docker.com/r/ndslabs/pycharm-clowder-xpra/	auto	clowder	Craig
	https://hub.docker.com/r/ndslabs/pycharm-novnc/	auto	no	Craig
	https://hub.docker.com/r/ndslabs/pycharm-xpra/	auto	no	Craig
	https://hub.docker.com/r/ndslabs/xpra-base/	ato	no	Craig
ndslabs-dind	https://hub.docker.com/r/ndslabs/dind/	auto	basic	Craig
ndslabs-dspace	https://hub.docker.com/r/ndslabs/dspace/	auto	no?	Craig	Dockerhub didn't pick up the github readme?
ndslabs-fedora-commons	https://hub.docker.com/r/ndslabs/fedora-commons/	auto	no	Mike
ndslabs-hydra	https://hub.docker.com/r/ndslabs/hydra/	manual		Craig	Incomplete service should be noted in readme
ndslabs-iqvoc	https://hub.docker.com/r/ndslabs/iqvoc/	auto	basic	Craig
ndslabs-irods	https://hub.docker.com/r/ndslabs/irods-icat/	auto	revisit	Craig	The three components share a readme – it would be worth describing the all in it.
	https://hub.docker.com/r/ndslabs/cloudbrowser/	auto	revisit	Craig
	https://hub.docker.com/r/ndslabs/cloudbrowser-ui/	auto	revisit	Craig
ndslabs-irods-federate			ok	Craig	Component for iRODS
ndslabs-jenkins	https://hub.docker.com/r/ndslabs/jenkins/	auto	revisit	Mike	README says this is an experiment
ndslabs-jupyterlab	https://hub.docker.com/r/ndslabs/jupyterlab/	auto	basic	Craig
ndslabs-kubernetes-contrib				All	Fork is in trouble. Need to decide what to do.
ndslabs-nrpe	https://hub.docker.com/r/ndslabs/nagios-nrpe/	auto	basic	Craig
ndslabs-orront	https://hub.docker.com/r/ndslabs/orront/	manual	revisit	Craig	Incomplete service should be noted in readme
ndslabs-owncloud	https://hub.docker.com/r/ndslabs/postgres-owncloud/	manual		Mike?
	https://hub.docker.com/r/ndslabs/owncloud/	auto	revisit	Mike	Readme seems to be from Developer-tutorial?
ndslabs-pegasus				Craig	Incomplete service should be noted in readme
ndslabs-perf	https://hub.docker.com/r/ndslabs/stress/ https://hub.docker.com/r/ndslabs/systools/	manual		Craig	Poorly documented artifacts from IASSIST load testing.
ndslabs-skosmos	https://hub.docker.com/r/ndslabs/skosmos/	auto	basic	Craig
ndslabs-solr	https://hub.docker.com/r/ndslabs/solr6/	auto	revisit	Craig	Should be renamed to solr before beta
ndslabs-startup			ok	Craig
ndslabs-sufia	https://hub.docker.com/r/ndslabs/sufia/	auto	stub	Craig	Need to add real readme
ndslabs-system-shell	https://hub.docker.com/r/ndslabs/system-shell/	auto	revisit	Mike
ndslabs-tematres				Craig	Incomplete service should be noted in readme
ndslabs-toolmanager	https://hub.docker.com/r/ndslabs/toolmanager/	auto	basic	Craig
	https://hub.docker.com/r/ndslabs/toolserver/	manual		Craig	Delete this?
ndslabs-webprotege	https://hub.docker.com/r/ndslabs/webprotege/	auto	basic	Craig
	https://hub.docker.com/r/ndslabs/latis/	manual	none	Mike?
	https://hub.docker.com/r/ndslabs/master/`	manual		?	Mistake?
	https://hub.docker.com/r/ndslabs/volume-vault/	manual		David?
	https://hub.docker.com/r/ndslabs/rabbitmq-server/	manual		?
	https://hub.docker.com/r/ndslabs/torch/	manual		?
	https://hub.docker.com/r/ndslabs/alpine/	manual		David?
	https://hub.docker.com/r/ndslabs/gluster-srv/	manual		David?
	https://hub.docker.com/r/ndslabs/psi-edge/	manual		David?
	https://hub.docker.com/r/ndslabs/che/	manual		Craig?	Can likely be deleted
	https://hub.docker.com/r/ndslabs/wso2is/	manual		Craig	WSO2IS experiment, needs to be cleaned up.

...

NDSC5

~~ndslabs-irods-federate readme~~

~~MedMike -> Craig:~~
~~A bit sparse.. may need build / run instructions if its much more complicated than 'make' or './build.sh'CraigMikeReady for review~~

~~https://github.com/nds-org/ndslabs-irods-federate~~

ndslabs-system-shell readmeHigh David

https://github.com/nds-org/ndslabs-system-shell

ndslabs-developer-shell readmeMed David

https://github.com/nds-org/ndslabs-developer-shell

ndslabs-deploy-tools readmeLow David

https://github.com/nds-org/ndslabs-deploy-tools

~~ndslabs-all-sources readme~~Low ~~David~~

~~https://github.com/nds-org/ndslabs-all-sources~~

~~nds-labs-legacy readme~~Low

~~https://github.com/nds-org/nds-labs-legacy~~

Tutorial repo with examplesHighMike -> Craig:
all examples should now work

Document	Priority	Notes	Assigned to	Reviewer	Status	Related Link(s)
Update labsportal Wordpress	High		Kenton	?		http://labsportal.nationaldataservice.org/
Tutorial repo with examples	High

Mike	Craig	Ready for review	https://github.com/nds-org/developer-tutorial
Tutorial presentation	High		Craig	Mike/David	2016-03-28 Tutorial planning https://docs.google.com/presentation/d/1Ll0EwFpVXVdZAM44tBeT5q_mq7WXIwBDup4Km7Np37o/edit#slide=id.p
Clowder/Terra demo video	High

Mike -> Craig:
does this need audio?

Need to work with Craig to make sure titles/subtitles consistent	Mike	Craig	Ready for review	https://uofi.app.box.com/files/0/f/5363912561/Videos
Dataverse/iRods demo video	High		Craig	Mike

As good as it's going to be

https://uofi.app.box.com/files/0/f/5363912561/Videos

ELK demo videoLow

ndslabs-system-shell readme

High

Craig

David

Mike

TBA

Dataverse/TwoRavens demoLow

https://github.com/nds-org/ndslabs-system-shell
NDSLabs build/installation instructions	High	Needs consolidation

Craig

Mike

TBA

~~ndslabs repo readme~~

NDSLabs build/installation instructions

~~High~~

~~Needs~~

consolidation

~~community information~~

~~Craig~~

~~Mike~~

still need: API server build instructions

	~~https://github.com/nds-org/ndslabs~~
~~ndslabs-specs repo readme~~	~~High~~	~~Mike -> Craig: Looks good, I think?~~	~~Craig/Mike~~	~~Mike/Craig~~	~~Done~~	~~https://github.com/nds-org/ndslabs-specs~~
~~ndslabs-clowder repo readme~~	~~High~~	~~Craig: Looks good.~~	~~Mike~~	~~Craig~~	~~Ready for review~~	~~https://github.com/nds-org/ndslabs-clowder~~ ~~https://github.com/nds-org/ndslabs-clowder/tree/master/~~

gui

~~dockerfiles~~
~~https://github.com/nds-org/~~

developer-tutorial

Clowder Stack Test Cases

Document apiserver.confMed

~~ndslabs-clowder/tree/master/kubernetes~~
~~ndslabs-dataverse readme~~	~~High~~	Mike -> Craig: Looks good

~~Craig~~

~~Mike~~

~~Ready~~

or

~~for review~~	~~https://github.com/nds-org/ndslabs-dataverse~~
ndslabs

/tree/master/apiserver#configuration

-developer-shell readme	Med		David			https://github.com/nds-org/ndslabs-developer-shell
Best-practices for Dockerfile creation	Med	Needs more best practices / consolidation	Mike	Craig		Using Docker Images Building Custom Docker Images https://github.com/nds-org/developer-tutorial https://docs.docker.com/engine/userguide/eng-image/dockerfile_best-practices/ https://github.com/docker-library/official-images
Best practices for service creation	Med	Needs consolidation	Craig	Mike		Adding NDSLabs Services (this is an old draft) https://github.com/nds-org/developer-tutorial https://docs.docker.com/engine/userguide/eng-image/dockerfile_best-practices/ https://github.com/docker-library/official-images
~~ndslabs-irods readme~~	~~Med~~	~~Mike -> Craig:~~ ~~Would it be beneficial to link to irods-federate / dataverse in 'See also'?~~	~~Craig~~	~~Mike~~	~~Ready for review~~	~~https://github.com/nds-org/ndslabs-irods~~
~~ndslabs-irods-federate readme~~	~~Med~~	~~Mike -> Craig:~~ ~~A bit sparse.. may need build / run instructions if its much more complicated than 'make' or './build.sh'~~	~~Craig~~	~~Mike~~	~~Ready for review~~	~~https://github.com/nds-org/ndslabs-irods-federate~~
~~Document apiserver.conf~~	~~Med~~		~~Craig~~	~~Mike~~	~~Ready or review~~	~~https://github.com/nds-org/ndslabs/tree/master/apiserver#configuration~~
Dockerhub repo documentation?

LOW

Low	If we have time
ELK demo video	Low	Craig	Mike	TBA
Dataverse/TwoRavens demo	Low	Craig	Mike	TBA
ndslabs-deploy-tools readme	Low	David		https://github.com/nds-org/ndslabs-deploy-tools
~~ndslabs-all-sources readme~~	Low	~~David~~		~~https://github.com/nds-org/ndslabs-all-sources~~
~~nds-labs-legacy readme~~	Low			~~https://github.com/nds-org/nds-labs-legacy~~

Space shortcuts

Page tree

Versions Compared

Old Version 30

New Version Current

Key

NDSC6

Confluence audit

Repositories and automated builds audit

NDSC5

Space shortcuts

Page tree

Page History

Versions Compared

Old Version 30

New Version Current

Key

NDSC6

Confluence audit

Repositories and automated builds audit

NDSC5