Uploaded image for project: 'National Data Service'
  1. National Data Service
  2. NDS-564

Logstash / LogSpout CrashLoopBackoff

XMLWordPrintableJSON

    • Icon: Bug Bug
    • Resolution: Won't Do
    • Icon: Blocking Blocking
    • Workbench 1.2.0
    • None
    • Backend
    • None

      When starting the ELK stack, Logstash went into CrashLoopBackoff:

      KUBERNETES LOG
      		 
      =====================
      		 
      Reason=SuccessfulCreate, Message=Created pod: sk88d2-logstash-uxz3q
      		 
      Reason=Scheduled, Message=Successfully assigned sk88d2-logstash-uxz3q to 127.0.0.1
      		 
      Reason=Pulling, Message=pulling image "logstash:2.2"
      		 
      Reason=Pulled, Message=Successfully pulled image "logstash:2.2"
      		 
      Reason=Created, Message=Created container with docker id 86cd1d79b54a
      		 
      Reason=Started, Message=Started container with docker id 86cd1d79b54a
      		 
      Reason=Pulling, Message=pulling image "logstash:2.2"
      		 
      Reason=Pulled, Message=Successfully pulled image "logstash:2.2"
      		 
      Reason=Created, Message=Created container with docker id 24ddfb9de07e
      		 
      Reason=Started, Message=Started container with docker id 24ddfb9de07e
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 10s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "logstash:2.2"
      		 
      Reason=Pulled, Message=Successfully pulled image "logstash:2.2"
      		 
      Reason=Created, Message=Created container with docker id 2bb7370e37fe
      		 
      Reason=Started, Message=Started container with docker id 2bb7370e37fe
      		 
      Reason=Error, Message=
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "logstash:2.2"
      		 
      Reason=Pulled, Message=Successfully pulled image "logstash:2.2"
      		 
      Reason=Created, Message=Created container with docker id 6e0c546445a2
      		 
      Reason=Started, Message=Started container with docker id 6e0c546445a2
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "logstash:2.2"
      		 
      Reason=Pulled, Message=Successfully pulled image "logstash:2.2"
      		 
      Reason=Created, Message=Created container with docker id 59a302648350
      		 
      Reason=Started, Message=Started container with docker id 59a302648350
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "logstash:2.2"
      		 
      Reason=Pulled, Message=Successfully pulled image "logstash:2.2"
      		 
      Reason=Created, Message=Created container with docker id 4256a8b86bb6
      		 
      Reason=Started, Message=Started container with docker id 4256a8b86bb6
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "logstash:2.2"
      		 
      Reason=Pulled, Message=Successfully pulled image "logstash:2.2"
      		 
      Reason=Created, Message=Created container with docker id a4cae7e2de02
      		 
      Reason=Started, Message=Started container with docker id a4cae7e2de02
      		 
      Reason=Error, Message=
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logstash" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logstash pod=sk88d2-logstash-uxz3q_lambert8(bfd16c27-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
       
      		 
      SERVICE LOG
      		 
      =====================
      		 
      {:timestamp=>"2016-09-14T17:47:39.259000+0000", :message=>"Error: Expected one of #, { at line 1, column 7 (byte 7) after output", :level=>:error}

      When checking again later, Logstash seemed to be "Ready", but LogSpout was now in a CrashLoopBackoff:

      KUBERNETES LOG
      		 
      =====================
      		 
      Reason=SuccessfulCreate, Message=Created pod: sk88d2-logspout-tfln2
      		 
      Reason=Scheduled, Message=Successfully assigned sk88d2-logspout-tfln2 to 127.0.0.1
      		 
      Reason=Pulling, Message=pulling image "ndslabs/logspout:v4"
      		 
      Reason=Pulled, Message=Successfully pulled image "ndslabs/logspout:v4"
      		 
      Reason=Created, Message=Created container with docker id 5cf0add65709
      		 
      Reason=Started, Message=Started container with docker id 5cf0add65709
      		 
      Reason=Error, Message=
      		 
      Reason=Pulling, Message=pulling image "ndslabs/logspout:v4"
      		 
      Reason=Pulled, Message=Successfully pulled image "ndslabs/logspout:v4"
      		 
      Reason=Created, Message=Created container with docker id b85b43b1b541
      		 
      Reason=Started, Message=Started container with docker id b85b43b1b541
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 10s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "ndslabs/logspout:v4"
      		 
      Reason=Pulled, Message=Successfully pulled image "ndslabs/logspout:v4"
      		 
      Reason=Created, Message=Created container with docker id 02d909079969
      		 
      Reason=Started, Message=Started container with docker id 02d909079969
      		 
      Reason=Error, Message=
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "ndslabs/logspout:v4"
      		 
      Reason=Pulled, Message=Successfully pulled image "ndslabs/logspout:v4"
      		 
      Reason=Created, Message=Created container with docker id 1e907882291f
      		 
      Reason=Started, Message=Started container with docker id 1e907882291f
      		 
      Reason=Error, Message=
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "ndslabs/logspout:v4"
      		 
      Reason=Pulled, Message=Successfully pulled image "ndslabs/logspout:v4"
      		 
      Reason=Created, Message=Created container with docker id 6fb75155e2a7
      		 
      Reason=Started, Message=Started container with docker id 6fb75155e2a7
      		 
      Reason=Error, Message=
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "ndslabs/logspout:v4"
      		 
      Reason=Pulled, Message=Successfully pulled image "ndslabs/logspout:v4"
      		 
      Reason=Created, Message=Created container with docker id 131d7b46890b
      		 
      Reason=Started, Message=Started container with docker id 131d7b46890b
      		 
      Reason=Error, Message=
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=Pulling, Message=pulling image "ndslabs/logspout:v4"
      		 
      Reason=Pulled, Message=Successfully pulled image "ndslabs/logspout:v4"
      		 
      Reason=Created, Message=Created container with docker id f2ecd952e335
      		 
      Reason=Started, Message=Started container with docker id f2ecd952e335
      		 
      Reason=Error, Message=
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
      Reason=BackOff, Message=Back-off restarting failed docker container
      		 
      Reason=FailedSync, Message=Error syncing pod, skipping: failed to "StartContainer" for "logspout" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=logspout pod=sk88d2-logspout-tfln2_lambert8(cc69ca4f-7a9b-11e6-ad7e-fa163e498a3c)"
      		 
       
      		 
       
      		 
      SERVICE LOG
      		 
      =====================
      		 
      # logspout v3.2-dev by gliderlabs
      		 
      # adapters: raw syslog tcp udp tls
      		 
      # options : debug:true persist:/mnt/routes
      		 
      couldn't connect to server, retrying
      		 
      !! dial tcp 10.0.0.9:5000: getsockopt: connection timed out

      This ticket is complete when the ELK stack once again starts up as expected (see NDS-318).

              willis8 Craig Willis
              lambert8 Sara Lambert
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved:

                  Estimated:
                  Original Estimate - 3 hours
                  3h
                  Remaining:
                  Remaining Estimate - 3 hours
                  3h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified