-
Sub-task
-
Resolution: Duplicate
-
Major
-
None
-
None
-
None
-
None
-
Kurator Sprint 5
Example heap space exception at only 9000 records in a small data set.
$ java -jar /home/mole/workspace/FP-Akka/target/FP-Akka-1.4.2-SNAPSHOT-workflowstarter.jar -w dwca -a COL -i occurrence.csv -o ashnc_mammal.json
Selected Workflow: dwca
NewScientificNameValidator authority: COL
NewScientificNameValidator taxonomicMode: false
NewScientificNameValidator insertGUID: true
NewScientificNameValidator will make pull requests to RepointableActorRef
Read header line of input file as tab separated, found only one field, trying again as comma separated.
Read initial 30 records.
Read 1000 records, total 1000
Read 1000 records, total 2000
Read 1000 records, total 3000
Read 1000 records, total 4000
Read 1000 records, total 5000
Read 1000 records, total 6000
Read 1000 records, total 7000
Read 1000 records, total 8000
Read 1000 records, total 9000
Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-4] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-9] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-5] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-2] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
Uncaught error from thread [FpSystem-akka.actor.default-dispatcher-7] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[FpSystem]
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2367)
at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:587)
at java.lang.StringBuffer.append(StringBuffer.java:332)
at org.json.simple.JSONValue.escape(JSONValue.java:266)
at org.json.simple.JSONValue.escape(JSONValue.java:219)
at org.json.simple.JSONValue.toJSONString(JSONValue.java:176)
at org.json.simple.JSONObject.toJSONString(JSONObject.java:119)
at org.json.simple.JSONObject.toJSONString(JSONObject.java:101)
at org.json.simple.JSONValue.toJSONString(JSONValue.java:202)
at org.json.simple.JSONArray.toJSONString(JSONArray.java:91)
at org.json.simple.JSONArray.toJSONString(JSONArray.java:98)
at org.json.simple.JSONValue.toJSONString(JSONValue.java:199)
at org.json.simple.JSONObject.toJSONString(JSONObject.java:119)
at org.json.simple.JSONObject.toJSONString(JSONObject.java:101)
at org.json.simple.JSONObject.toJSONString(JSONObject.java:108)
at org.filteredpush.akka.actors.io.MongoSummaryWriter.writeOut(MongoSummaryWriter.java:385)
at org.filteredpush.akka.actors.io.MongoSummaryWriter.onReceive(MongoSummaryWriter.java:232)
at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
at akka.actor.ActorCell.invoke(ActorCell.scala:386)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
at akka.dispatch.Mailbox.run(Mailbox.scala:212)
at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:2694)
at java.lang.String.<init>(String.java:203)
at java.lang.StringBuffer.toString(StringBuffer.java:561)
at org.filteredpush.kuration.services.BaseCurationService.getComment(BaseCurationService.java:67)
at org.filteredpush.akka.actors.InternalDateValidator$InternalDateValidatorInvocation.onReceive(InternalDateValidator.java:246)
at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
at akka.actor.ActorCell.invoke(ActorCell.scala:386)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
at akka.dispatch.Mailbox.run(Mailbox.scala:212)
at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:2694)
at java.lang.String.<init>(String.java:203)
at java.lang.StringBuffer.toString(StringBuffer.java:561)
at org.filteredpush.kuration.services.BaseCurationService.getComment(BaseCurationService.java:67)
at org.filteredpush.akka.actors.InternalDateValidator$InternalDateValidatorInvocation.onReceive(InternalDateValidator.java:246)
at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
at akka.actor.ActorCell.invoke(ActorCell.scala:386)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
at akka.dispatch.Mailbox.run(Mailbox.scala:212)
at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
java.lang.OutOfMemoryError: Java heap space
at org.nocrala.tools.gis.data.esri.shapefile.shape.shapes.AbstractPolyShape.<init>(AbstractPolyShape.java:82)
at org.nocrala.tools.gis.data.esri.shapefile.shape.shapes.AbstractPolyPlainShape.<init>(AbstractPolyPlainShape.java:21)
at org.nocrala.tools.gis.data.esri.shapefile.shape.shapes.PolygonShape.<init>(PolygonShape.java:22)
at org.nocrala.tools.gis.data.esri.shapefile.ShapeFileReader.next(ShapeFileReader.java:205)
at org.filteredpush.kuration.services.GeoLocate3.ReadLandData(GeoLocate3.java:566)
at org.filteredpush.kuration.services.GeoLocate3.validateGeoRef(GeoLocate3.java:168)
at org.filteredpush.akka.actors.GEORefValidator$GEORefValidatorInvocation.onReceive(GEORefValidator.java:226)
at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:159)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:425)
at akka.actor.ActorCell.invoke(ActorCell.scala:386)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:230)
at akka.dispatch.Mailbox.run(Mailbox.scala:212)
at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:506)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:262)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1478)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)