Uploaded image for project: 'Kurator'
  1. Kurator
  2. KURATOR-108

FP-Akka dwca workflow heap overflows with dataset with few taxa and many localities

XMLWordPrintableJSON

      Add akka functionality corresponding to a director for managing
      throttling of throughput between actors in the actors used in FP-Akka
      DwCa workflow, basically handling the hack I put in place for rate
      throttling properly. (We are seeing Marcia's dataset with few taxa
      but many localities having a fast throughput through the rate limited
      csv loader and scientific name validator only to run out of memmory
      with the backlog accumulating behind the georeference validation
      actor) - in essence, can we use Akka's capabilities better for our
      workflow rather than parallelization purposes.

              mole Paul J. Morris
              mole Paul J. Morris
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: