• Icon: Sub-task Sub-task
    • Resolution: Duplicate
    • Icon: Major Major
    • None
    • None
    • None
    • None
    • Kurator Sprint 5

      Example heap space exception at only 9000 records in a small data set.

      $ java -jar /home/mole/workspace/FP-Akka/target/FP-Akka-1.4.2-SNAPSHOT-workflowstarter.jar -w dwca -a COL -i occurrence.csv -o ashnc_mammal.json
      Selected Workflow: dwca
      NewScientificNameValidator authority: COL
      NewScientificNameValidator taxonomicMode: false
      NewScientificNameValidator insertGUID: true
      NewScientificNameValidator will make pull requests to RepointableActorRef
      Read header line of input file as tab separated, found only one field, trying again as comma separated.
      Read initial 30 records.
      Read 1000 records, total 1000
      Read 1000 records, total 2000
      Read 1000 records, total 3000
      Read 1000 records, total 4000
      Read 1000 records, total 5000
      Read 1000 records, total 6000
      Read 1000 records, total 7000
      Read 1000 records, total 8000
      Read 1000 records, total 9000
      Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-4] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
      Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-9] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
      Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-5] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
      Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-2] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
      Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-7] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
      java.lang.OutOfMemoryError: Java heap space
      java.lang.OutOfMemoryError: Java heap space
      at java.util.Arrays.copyOf(Arrays.java:2367)
      at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
      at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
      at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:587)
      at java.lang.StringBuffer.append(StringBuffer.java:332)
      at org.json.simple.JSONValue.escape(JSONValue.java:266)
      at org.json.simple.JSONValue.escape(JSONValue.java:219)
      at org.json.simple.JSONValue.toJSONString(JSONValue.java:176)
      at org.json.simple.JSONObject.toJSONString(JSONObject.java:119)
      at org.json.simple.JSONObject.toJSONString(JSONObject.java:101)
      at org.json.simple.JSONValue.toJSONString(JSONValue.java:202)
      at org.json.simple.JSONArray.toJSONString(JSONArray.java:91)
      at org.json.simple.JSONArray.toJSONString(JSONArray.java:98)
      at org.json.simple.JSONValue.toJSONString(JSONValue.java:199)
      at org.json.simple.JSONObject.toJSONString(JSONObject.java:119)
      at org.json.simple.JSONObject.toJSONString(JSONObject.java:101)
      at org.json.simple.JSONObject.toJSONString(JSONObject.java:108)
      at org.filteredpush.akka.actors.io.MongoSummaryWriter.writeOut(MongoSummaryWriter.java:385)
      at org.filteredpush.akka.actors.io.MongoSummaryWriter.onReceive(MongoSummaryWriter.java:232)
      at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
      at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
      at akka.actor.ActorCell.invoke(ActorCell.scala:386)
      at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
      at akka.dispatch.Mailbox.run(Mailbox.scala:212)
      at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
      at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
      at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
      at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
      at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      java.lang.OutOfMemoryError: Java heap space
      at java.util.Arrays.copyOfRange(Arrays.java:2694)
      at java.lang.String.<init>(String.java:203)
      at java.lang.StringBuffer.toString(StringBuffer.java:561)
      at org.filteredpush.kuration.services.BaseCurationService.getComment(BaseCurationService.java:67)
      at org.filteredpush.akka.actors.InternalDateValidator$InternalDateValidatorInvocation.onReceive(InternalDateValidator.java:246)
      at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
      at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
      at akka.actor.ActorCell.invoke(ActorCell.scala:386)
      at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
      at akka.dispatch.Mailbox.run(Mailbox.scala:212)
      at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
      at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
      at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
      at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
      at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      java.lang.OutOfMemoryError: Java heap space
      at java.util.Arrays.copyOfRange(Arrays.java:2694)
      at java.lang.String.<init>(String.java:203)
      at java.lang.StringBuffer.toString(StringBuffer.java:561)
      at org.filteredpush.kuration.services.BaseCurationService.getComment(BaseCurationService.java:67)
      at org.filteredpush.akka.actors.InternalDateValidator$InternalDateValidatorInvocation.onReceive(InternalDateValidator.java:246)
      at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
      at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
      at akka.actor.ActorCell.invoke(ActorCell.scala:386)
      at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
      at akka.dispatch.Mailbox.run(Mailbox.scala:212)
      at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
      at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
      at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
      at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
      at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      java.lang.OutOfMemoryError: Java heap space
      at org.nocrala.tools.gis.data.esri.shapefile.shape.shapes.AbstractPolyShape.<init>(AbstractPolyShape.java:82)
      at org.nocrala.tools.gis.data.esri.shapefile.shape.shapes.AbstractPolyPlainShape.<init>(AbstractPolyPlainShape.java:21)
      at org.nocrala.tools.gis.data.esri.shapefile.shape.shapes.PolygonShape.<init>(PolygonShape.java:22)
      at org.nocrala.tools.gis.data.esri.shapefile.ShapeFileReader.next(ShapeFileReader.java:205)
      at org.filteredpush.kuration.services.GeoLocate3.ReadLandData(GeoLocate3.java:566)
      at org.filteredpush.kuration.services.GeoLocate3.validateGeoRef(GeoLocate3.java:168)
      at org.filteredpush.akka.actors.GEORefValidator$GEORefValidatorInvocation.onReceive(GEORefValidator.java:226)
      at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
      at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
      at akka.actor.ActorCell.invoke(ActorCell.scala:386)
      at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
      at akka.dispatch.Mailbox.run(Mailbox.scala:212)
      at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
      at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
      at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
      at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
      at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

              mole Paul J. Morris
              mole Paul J. Morris
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: