NDSLabs ops needs to be able to go to a single place to monitor site-wide and container services. We will achieve this in part by enabling the Elasticsearch, Logstash, and Kibana (ELK) stack for NDS labs at the CoreOS, Docker and Kubernetes level. The ELK stack enables centralized logging, monitoring, and analysis to quickly identify problems or potential problems.

This task is specifically for site-wide ops, but we may opt to enable these services for individual NDSLabs projects as well.

This task includes the following

• Understand the ELK stack and how it can be deployed at the NDSLab site level (e.g., NCSA or TACC).
• Understand now ELK fits in with the VM OS (i.e., CoreOS), Docker and Kubernetes
• For this task, there will be one ELK stack for each cluster.
• Take a look at logspout and Docker log.

Output of this task is the infrastructure necessary to easily deploy the ELK stack on the NDSLabs cluster and associated documentation.

Giving 1 week estimate, since this requires ramp up on Kubernetes.