Objective
Improve productization of FP-Akka.
Carry out enginnering experiments on capabilities and limitations of Akka and YesWorkflow as they relate to the Kurator project's data curation goals.
Summary of expected deliverables
- FP-Akka release that is able to operate on large datasets without heap overflows.
- FP-Akka release that that is able to operate on inputs from csv files from Symbiota downloads, csv files from iDigBio downloads, and DarwinCore archive files with occurrence cores created by IPT.
- Report on YesWorfkow markup of object oriented code, indicating what can be accomplished now, what is expected to be able to be accomplished with planned features of YesWorkflow, and what is not expected to be able to be accomplshed with YesWorkflow.
- Report on implementation of an Akka workflow that includes actors which operate on data in both streams of records and in bulk operations on a whole dataset outlining capabilities and limitations of Akka for combining these two approaches in a single workflow implementation.