Release Notes - Daffodil - Version 2.0.0 - HTML format

Sub-task

  • [DFDL-150] - Test AC rich expressions, concat function, hiddenGroupRef
  • [DFDL-151] - Test AD hiddenGroupRef, occursCountKind expression
  • [DFDL-154] - Test AG discriminators, group ref
  • [DFDL-155] - Test AH - delete, convert, or combine with AG

Technical task

  • [DFDL-152] - Test AE - delete it
  • [DFDL-163] - Test AO - recursion - delete or revise
  • [DFDL-169] - Test AU - bcd and packed numbers
  • [DFDL-177] - Test BC - text boolean
  • [DFDL-178] - Test BD - binary boolean

Bug

  • [DFDL-460] - LengthUnits = "bits" should not work with Float
  • [DFDL-627] - A couple tests failing with aborts for "Invariant broken"
  • [DFDL-726] - Error undetected: choice branches must not be optional
  • [DFDL-762] - CLI tests cannot run in Eclipse
  • [DFDL-926] - ClassCastException on sequence with complexType
  • [DFDL-930] - Mandatory Text Alignment Broken
  • [DFDL-979] - hexBinary should not require byte alignment
  • [DFDL-996] - Increase max parsable file size for csv
  • [DFDL-1006] - TDML Runner: Add ability to set Tunables
  • [DFDL-1027] - InputValueCalc and outputValueCalc on the same element should produce SDE
  • [DFDL-1028] - InputValueCalc should not be used in dfdl:format
  • [DFDL-1075] - DPath: Cannot reference an entire sequence via a path
  • [DFDL-1078] - Test fails on build server - encoding issue?
  • [DFDL-1143] - Tunables should not be global state, related to save-parser
  • [DFDL-1183] - Resolving URIs and Schema Locations when using Xerces to load/validate - file-relative schema locations issue
  • [DFDL-1185] - Unmanaged dependencies aren't included in the license report
  • [DFDL-1213] - There seems to be an SDE for when a terminator contains %ES; ES should be allowed
  • [DFDL-1233] - DPath: fn:nilled() fails with ClassCastException
  • [DFDL-1285] - 20% performance degradation with delimited files
  • [DFDL-1301] - Unparse: Diagnostic message when array has too many/too few elements unclear
  • [DFDL-1304] - "Unparser not yet Implemented" Error with certain configuration of nillable elements
  • [DFDL-1311] - StringDelimitedUnparser expects node to be simple
  • [DFDL-1313] - Unparsing choices will fail to find an identifying branch in some cases
  • [DFDL-1316] - escapeChar same separator not behaving as expected (parsing)
  • [DFDL-1325] - Unparse Padding when textStringJustification = "center" - extra char added to right instead of left.
  • [DFDL-1327] - Unparse: Data value should be padded to minLength facet, not length expression
  • [DFDL-1329] - Parse namespaceing does not match expected unparser input
  • [DFDL-1333] - TDML Runner RoundTrip: unparse -> parse, errors from parse aren't propagated.
  • [DFDL-1337] - Unparser not implemented error - ConvertTextDecimalPrim
  • [DFDL-1341] - Simple PCAP Performance test (1MB) now failing with IndexOutOfBoundsException: 1000040
  • [DFDL-1342] - Unparse - AlignmentFill not yet implemented
  • [DFDL-1347] - CLI unparsing - abort invariant broken
  • [DFDL-1348] - Unparser (StringFixedLengthInVariableWidthCharacters) is not yet implemented.
  • [DFDL-1350] - Unparsing - Abort: Invariant broken. Must be a DIArray
  • [DFDL-1352] - Discriminator Stack not empty at end of parse
  • [DFDL-1353] - On parse, nilValue of "%WSP*;" not parsing emtpy string as nil.
  • [DFDL-1355] - Optional choice branches - should trigger SDE
  • [DFDL-1356] - Unparsing - NoSuchElementException: Nope.get
  • [DFDL-1357] - Add Test for Java 7 Decoder Bug - Require Java 8
  • [DFDL-1358] - inputValueCalc as root of a choice branch should SDE
  • [DFDL-1359] - CLI Unparse Performance - Memory Issues when running large file sets
  • [DFDL-1361] - Parser Compile/Save/Reload time experienced minor performance hit
  • [DFDL-1366] - General back end parsed-length of children greater than parent.
  • [DFDL-1368] - scalar non-defaultable nillable simple types result in an AltComp parser, which doesn't exist for unparse
  • [DFDL-1369] - Need to remap PUA infoset characters back to their original value when unparsing
  • [DFDL-1372] - License for passera-unsigned library isn't being included in our license info page.
  • [DFDL-1374] - CLI with old version of Java reports "unexpected exception"
  • [DFDL-1375] - Update wiki to reflect upgrade to Java 8, Scala 2.11, Eclipse, Scala-IDE versions
  • [DFDL-1376] - Bamboo fails to build javadoc/scaladoc with java 1.8
  • [DFDL-1378] - Figure out why commas aren't required in input for parsing with textNumberPattern
  • [DFDL-1381] - Unparser (InitiatedContent) is not yet implemented
  • [DFDL-1382] - Bad diagnostic: IndexOutOfBounds: null
  • [DFDL-1385] - ChoiceBranchEvents broken
  • [DFDL-1391] - CLI Performance: Potential Race Condition - StringIndexOutOfBoundsException
  • [DFDL-1393] - Java 8 Compatiblity: MaxPermSize option no longer supported
  • [DFDL-1397] - When escaping block end character during unparse, the next two characters are lost
  • [DFDL-1398] - StatementElementUnparser.unparseBegin assertion thrown
  • [DFDL-1402] - CLI 'info data': Abort when encoding does not specify byte order
  • [DFDL-1403] - CLI Performance: Exceptions when parsing binary files with multiple threads
  • [DFDL-1404] - JUnit --tests flag no longer works for specifying particular tests to run within a suite
  • [DFDL-1405] - Disallow utf-16 without BE/LE suffix since we don't support unicodeByteOrderMark
  • [DFDL-1408] - Namespace caching is not thread-safe
  • [DFDL-1410] - Debugger dump output not correct in some cases
  • [DFDL-1414] - Need error if fixed length element with length > 0 has default value
  • [DFDL-1426] - fillByte value not validated - Abort: Invariant Broken
  • [DFDL-1428] - Deprecation warnings in sbt configuration
  • [DFDL-1429] - XML output should not insert whitespace around simple values
  • [DFDL-1446] - expression path step names not interpreted relative to default namespace of schema
  • [DFDL-1450] - Calabash - mystery jar - need to eliminate or get source code
  • [DFDL-1453] - Performance - Input Layer regression since commit 5ced4fa
  • [DFDL-1455] - dfdl:hexBinary example in spec differs from actual output
  • [DFDL-1467] - change name from us-ascii-7-bit-packed to X-DFDL-US-ASCII-7-BIT-PACKED
  • [DFDL-1468] - decouple bitOrder from byteOrder
  • [DFDL-1470] - Memory issues with unparsing a large number of files with complex textual data
  • [DFDL-1482] - deprecation warnings - 66 of them
  • [DFDL-1483] - CLI performance - Abort: Invariant broken. Pool MarkPool leaked 2 instance(s)
  • [DFDL-1484] - Performance: EvalCache causes drastic performance decrease
  • [DFDL-1489] - Unparser tests expect error fail.
  • [DFDL-1491] - "sbt compile clean compile" causes error in gen-props
  • [DFDL-1495] - Encoder/DecoderEv is not thread-safe
  • [DFDL-1497] - Thread leak in co-routines used by unparser
  • [DFDL-1498] - Content of fixed-format fields not properly preserved.
  • [DFDL-1499] - Improve USASCII 7-bit Encoder
  • [DFDL-1502] - Roundtrip: tests in SimpleTypes.tdml don't round trip
  • [DFDL-1504] - Checker for Infoset to insure only the proper type objects are added to infoset elements.
  • [DFDL-1511] - Update DFDLSchemas github PCAP to match current example with unparsing support.
  • [DFDL-1521] - Encoding incorrectly reset from 7-bit ASCII to 8859-1
  • [DFDL-1532] - Need predicate checking if if the knownEncoding is variable width
  • [DFDL-1538] - RoundTrip: SpecifiedLengthPattern seems incorrect
  • [DFDL-1540] - K02.49 does not round trip correctly
  • [DFDL-1543] - Roundtrip failure: Invariant broken: state.hasInfoset
  • [DFDL-1544] - Roundtrip: textTrimKind and textPadKind missing from many tests
  • [DFDL-1545] - Roundtrip: xs:choice inside hiddenGroup causes failures
  • [DFDL-1546] - Roundtrip: Invariant broken expecting Start(DIArray)
  • [DFDL-1547] - Roundtrip: Tests in Sections 2 & 5
  • [DFDL-1548] - Roundtrip: Tests in Sections 6 & 7
  • [DFDL-1549] - Roundtrip: Tests in sections 8, 10, 11, & 12
  • [DFDL-1550] - Roundtrip: Tests in sections 13 & 14
  • [DFDL-1551] - Roundtrip: Tests in sections 15, 16, 23, and others
  • [DFDL-1552] - Roundtrip: complex element in hidden group ref fails to unparse with error: Invariant: not an array
  • [DFDL-1553] - Roundtrip: unparsed data length is not correct
  • [DFDL-1555] - Roundtrip: complex namespaces result in non-unparsable infosets
  • [DFDL-1557] - RoundTrip: Need to implement the ability to skip bits (ElementUnused region)
  • [DFDL-1558] - RoundTrip: runtime encoding of fillByte
  • [DFDL-1560] - RoundTrip: SpecifiedLengthExplicitCharactersUnparserBase does not work with padding
  • [DFDL-1561] - RoundTrip: PCAP examples do not round trip
  • [DFDL-1566] - TestParseUnparseMode fails to roundtrip or unparse
  • [DFDL-1567] - Implement valueLength
  • [DFDL-1572] - Truncates text numbers. Should be Unparse Error
  • [DFDL-1574] - Add missing copyrights
  • [DFDL-1576] - User test causes error: 'Full' validation not allowed when using a restored parser.
  • [DFDL-1577] - daf:error doesn't accept argument - replace with fn:error(arg, arg, arg)
  • [DFDL-1579] - SimpleTypes - Roundtrip Fail - Padding issue
  • [DFDL-1586] - mil-std-2045 regression
  • [DFDL-1593] - Unparsing with outputValueCalc and escapeScheme gives ArrayIndexOutOfBoundsException
  • [DFDL-1594] - Performance degredation
  • [DFDL-1596] - Need dfdl:valueLength support during parse
  • [DFDL-1599] - StringDelimitedUnparser - contains code to pad/truncate
  • [DFDL-1601] - DFDLSchemas NACHA does not unparse on 2.0.0 branch
  • [DFDL-1603] - Remove aaa_debug variable and related debug variables
  • [DFDL-1606] - Performance: equality operations cause allocation
  • [DFDL-1607] - Should error when dfdl: is used for non dfdl: properties
  • [DFDL-1608] - Create OutputValueCalc torture tests.
  • [DFDL-1609] - OutputValueCalc - byteOrder fails to reverse bytes for LE vs BE
  • [DFDL-1610] - Parse performance degradation decrease due to capture content/value length
  • [DFDL-1611] - Update Calbash Extension to support unparse
  • [DFDL-1613] - Remove println commented blocks from code
  • [DFDL-1614] - Sequence with 7-bit ASCII encoding expecting more bits
  • [DFDL-1615] - Error unparsing with 7-bit encoding
  • [DFDL-1617] - Ambiguity in DFDL expressions when same element appears in sequence
  • [DFDL-1618] - XPath xs:hexBinary equality comparison does not work
  • [DFDL-1620] - IllegalArgumentException with invalid character with 7-Bit encoding
  • [DFDL-1621] - fn:exists with path containing array index causes failed assertion during parse
  • [DFDL-1622] - Daffodil fails to complete test of 4.2MB PNG file, get "Error running test"
  • [DFDL-1624] - PNG schema fails to parse using the CLI performance command
  • [DFDL-1626] - valueLength with lengthUnit 'characters' not implemented
  • [DFDL-1627] - valueLength fails with complex type during parsing
  • [DFDL-1628] - Validation fails if schema is in jar file
  • [DFDL-1631] - Add ability to create a Daffodil RPM with all dependencies packaged
  • [DFDL-1641] - dfdl:length expression that results in a negative value causes Abort
  • [DFDL-1643] - Daffodil with verbose output (-v) prints LengthEv information
  • [DFDL-1644] - xs:unsignedLong does not compare correctly to other types
  • [DFDL-1645] - Debugger: printing infoset can cause abort
  • [DFDL-1647] - NACHA - make portable. Eliminate daffodil-master branch.
  • [DFDL-1648] - Unparse: fn:count() never unblocks if the element does not exist
  • [DFDL-1650] - Unparse: circularly deadlocked due to alignment
  • [DFDL-1653] - Abort: Invariant broken: current.eq(mark)
  • [DFDL-1655] - update xerces and other dependent libraries to more current versions
  • [DFDL-1657] - dfdl:valueLength of element references does not create the necessary capture value length unparsers
  • [DFDL-1660] - Expression with sub paths to not evaluate correctly
  • [DFDL-1661] - Performance: rewrite InfosetCursorFromXMLEventCursor
  • [DFDL-1662] - Runtime SDE in RepParsrs causes MarkPool leaks
  • [DFDL-1664] - dfdl:lengthKind="endOfParent" does not cause a not yet implemented error on complex types
  • [DFDL-1665] - Reduce unparsing memory allocations to improve performance
  • [DFDL-1668] - Wikipedia page for DFDL has damage
  • [DFDL-1669] - DPath expression { x eq 3 } fails when x is unsignedLong
  • [DFDL-1672] - Expression failures lead to MarkPool leak
  • [DFDL-1674] - complex type with lengthKind 'explicit' and discriminator interaction
  • [DFDL-1675] - discriminator expression - infoset element not found is SDE, but should be PE
  • [DFDL-1676] - runtime SDE when validation is on produces abort.
  • [DFDL-1677] - dependencies too hard to maintain for eclipse IDE
  • [DFDL-1682] - Performance imrovements in InfosetCursorFromXMLEventReader
  • [DFDL-1683] - Support unparsing BigInts
  • [DFDL-1684] - Java default file encoding not set to utf-8 causes test failures
  • [DFDL-1688] - Expressions like 90.0 div 1234567.0 creating integer result 0, not a double or decimal.
  • [DFDL-1690] - spurious warning : dfdl:lengthKind 'implicit' is not consistent with dfdl:length specified (as 1). The dfdl:length will be ignored.
  • [DFDL-1692] - when debug/trace is on, suspensions for unparsing fail to copy properly
  • [DFDL-1698] - Remove restriction against having dfdl:outputValueCalc property on nillable elements
  • [DFDL-1700] - class path collisions in DFDL XSD schemaLocation
  • [DFDL-1702] - Add support for math:pow() function
  • [DFDL-1703] - bits unparsed incorrectly
  • [DFDL-1705] - DFDL Expression div/idiv operator broken
  • [DFDL-1706] - Cannot get dfdl:valueLength inside of a complex type inside dfdl:length when parsing
  • [DFDL-1707] - extension to allow hexBinary with lengthUnits="bits"
  • [DFDL-1708] - Tutorial logo link broken
  • [DFDL-1711] - NiFi Processor: Fix LICENSE/NOTICE file to properly lists dependencies and their licenses
  • [DFDL-1712] - Nifi Processor: Remove logger info() calls in onTrigger
  • [DFDL-1715] - xs:boolean( path/to/an/unsignedByte ) fails with SDE - missing conversion
  • [DFDL-1716] - Choice Dispatch discrimination incorrect
  • [DFDL-1718] - Intermittent failure of test_ovc_w_runtime_escape_char
  • [DFDL-1719] - Expressions - literal 0 (zero) should convert to unsignedByte without an SDE
  • [DFDL-1721] - Parser removes more than one NL.
  • [DFDL-1722] - Detect error where dfdl:property doesn't have dfdl:element around it.
  • [DFDL-1723] - expressions - convert from double to unsignedInt fails.
  • [DFDL-1724] - adding annotation documentation to group def - abort
  • [DFDL-1727] - Padding + Alignment + OVC results in a deadlock
  • [DFDL-1728] - remove daffodil-core/doc directory - or at least all the old-stale contents
  • [DFDL-1730] - latest link to DFDL html spec is broken
  • [DFDL-1733] - Unparse performance regression due to putByteArray
  • [DFDL-1750] - unions of 1 must be allowed
  • [DFDL-1756] - No_Namespace showing in parsed xml
  • [DFDL-1764] - PState and Parser in wrong package, right directory
  • [DFDL-1765] - Backtracking doesn't clean up array element
  • [DFDL-1766] - diagnostic if you use the unimplemented newVariableInstance doesn't inform what is wrong.
  • [DFDL-1768] - NACHA spits out tons of warnings - need ability to suppress them.
  • [DFDL-1769] - VMF is broken
  • [DFDL-1770] - Make sbt fail if a version branch is not detected
  • [DFDL-1771] - diagnostic message "Relative path .. past root element" doesn't give context nor expression.
  • [DFDL-1772] - Helloworld.java is broken
  • [DFDL-1775] - Performance - Investigate avoiding compiling non-expressions
  • [DFDL-1777] - dfdl:choiceDispatchKey does not allow spaces
  • [DFDL-1779] - Test with xsi:nil="true" failing to unparse
  • [DFDL-1788] - Performance - Investigate slow InfosetOutputter performance
  • [DFDL-1789] - JDOM unparse performance decreases when unparsing an infoset generated via -I xml
  • [DFDL-1790] - Unparsing infoset file for 1mb jpeg using w3cdom requires 6gb more java memory than other infoset formats
  • [DFDL-1791] - Stackoverflow with if-then-else expressions
  • [DFDL-1792] - Built in variables like dfdl:byteOrder were not declared external
  • [DFDL-1793] - Nightly asterix data format tests fail with a Schema Definition Error (SDE)
  • [DFDL-1795] - w3cdom infoset xml files fail unparsing for "[error] Unparse Error:"
  • [DFDL-1796] - jpeg repository commit b417d355... broke nightly parse test for file IMG_2308.JPG
  • [DFDL-1797] - Daffodil NiFi Processor should error when left over data
  • [DFDL-1798] - Left over data message is confusing when less then one byte is left over
  • [DFDL-1801] - Regression: JPEG data in NITF parses differently
  • [DFDL-1806] - Update Daffodil README and BUILD files
  • [DFDL-1809] - Need MS-Windows Unicode support even just for "sbt test"
  • [DFDL-1812] - NACHA - use suppression-of-warnings to... ah, suppress the warnings
  • [DFDL-1813] - VMF spec scraper - no longer compiles
  • [DFDL-1815] - Calabash - not working
  • [DFDL-1817] - NiFi Wiki page, and link from "using daffodil" pages and front page.
  • [DFDL-1819] - NiFi processor: Add option to enable validation
  • [DFDL-1820] - Validation success/failure is not available in the Java/Scala API
  • [DFDL-1821] - isError returns false even when there are validation errors
  • [DFDL-1822] - Slideshare DFDL presentation doesn't match Java API anymore
  • [DFDL-1824] - Eclipse broken for mil-std-2045
  • [DFDL-1825] - ICU License link is no longer valid
  • [DFDL-1827] - extraEscapeCharacters is ignored when parsing
  • [DFDL-1828] - syslog schema with dfdl:encodingErrorPolicy="error" causes mark pool leak
  • [DFDL-1829] - syslog schema: debugger 'info infoset' command causes abort
  • [DFDL-1830] - PCAP - 50m.pcap and 100m.pcap do not parse on 2.0.0-rc3
  • [DFDL-1832] - schemaLocation with package-style directories for schema files - doesn't work properly
  • [DFDL-1834] - Debugging with syslog schema, executing "info infoset" as the first command to the debugger causes unhandled exception
  • [DFDL-1835] - Test without byteOrder defined fails round trip
  • [DFDL-1836] - Alignment still exists in jp2 schema, causing unparse deadlocks inability to unparse .jp2 files

New Feature

  • [DFDL-200] - Nillability - Literal Character
  • [DFDL-228] - Add Warnings capability to diagnostic messages
  • [DFDL-240] - runtime-valued properties - encoding
  • [DFDL-241] - runtime-valued properties - byteOrder
  • [DFDL-243] - runtime-valued properties - boolean true/false
  • [DFDL-256] - ignoreCase enhancement to delimiters, nilValue, etc.
  • [DFDL-260] - DFDL Entities: Implement Entities for nilValue - Literal Character
  • [DFDL-261] - DFDL Entities: Implement Entities for extraEscapedCharacters
  • [DFDL-437] - lengthUnits="bits" for boolean type binary representation
  • [DFDL-461] - boolean - binary
  • [DFDL-462] - boolean - text
  • [DFDL-578] - Implement contentLength function (parsing)
  • [DFDL-580] - Implement contentLength function (unparsing)
  • [DFDL-581] - Implement valueLength function (parsing)
  • [DFDL-582] - Implement valueLength function (unparsing)
  • [DFDL-591] - Implement Pad/Fill (unparsing aspects of padding)
  • [DFDL-594] - Public slide deck on DFDL & Daffodil
  • [DFDL-629] - Decimal - Binary binaryNumberRep='packed', 'bcd', etc.
  • [DFDL-630] - Decimal - Text - textNumberRep='zoned'
  • [DFDL-631] - xs:integer - Binary - binaryNumberRep 'packed' 'bcd' etc.
  • [DFDL-632] - xs:integer - Text - textNumberRep='zoned'
  • [DFDL-633] - nonNegativeInteger - binary - binaryNumberRep='packed' etc.
  • [DFDL-634] - nonNegativeInteger - text - textNumberRep='zoned'
  • [DFDL-635] - Date, Time, DateTime - Binary - binaryCalendarRep='packed', 'bcd' etc.
  • [DFDL-636] - long, int, short, byte and unsigned versions: binaryNumberRep='packed', 'bcd', etc.
  • [DFDL-637] - long, int, short, byte and unsigned versions: textNumberRep='zoned'
  • [DFDL-641] - choiceBranchKey, choiceDispatchKey - choice direct dispatch
  • [DFDL-927] - runtime-valued property: calendarLanguage
  • [DFDL-929] - delimiter after bit-field - error check needed
  • [DFDL-1210] - Pluggable and efficient infoset input/output
  • [DFDL-1250] - Java API for Unparse
  • [DFDL-1251] - Scala API for Unparse
  • [DFDL-1259] - Defaulting of values for missing required elements
  • [DFDL-1265] - Trace support for unparsing
  • [DFDL-1266] - Expression Unparser - ExpressionEvaluationUnparser
  • [DFDL-1268] - Expression unparser - StatementElementUnparserBase
  • [DFDL-1269] - Expression Unparser - SequenceCombinatorUnparser
  • [DFDL-1270] - OutputValueCalc - evaluation is allowed when infoset is completely built
  • [DFDL-1288] - Add support for 6-bit encoding
  • [DFDL-1296] - Unparser - Arrays with occursCountKind 'expression'
  • [DFDL-1349] - Update Performance Harness for Unparse tests
  • [DFDL-1362] - SpecifiedLengthExplcit unparsers
  • [DFDL-1363] - Disable asserts and discriminators during unparsing
  • [DFDL-1364] - HexBinary unparsers
  • [DFDL-1365] - Binary Number unparsers - fixed size binary number types
  • [DFDL-1367] - Unparse: Text Numbers
  • [DFDL-1371] - Unparsing text date/Time/dateTime
  • [DFDL-1396] - TDML Runner: Specify file to be used as infoset
  • [DFDL-1413] - detect error if fixed length string has a default value
  • [DFDL-1442] - runtime-valued escapeCharacter and escapeEscapeCharacter
  • [DFDL-1445] - TDML Runner needs way to refer to infoset in XML file
  • [DFDL-1501] - Unparser bigInt and binary decimal support (integer, nonNegativeInteger, decimal)
  • [DFDL-1507] - Implement outputValueCalc for elements where length depends on value (alignment related)
  • [DFDL-1508] - Add support for 5-bit encodings needed for MIL-STD-6016
  • [DFDL-1518] - dfdl:contentLength for complexType elements with internal alignment
  • [DFDL-1564] - New property and tunable: parseUnparsePolicy
  • [DFDL-1573] - Unparser fn:exists function - AG000, AG001, AG002
  • [DFDL-1632] - Implement daf:valid feature
  • [DFDL-1634] - simple type unions
  • [DFDL-1635] - Apache NiFi Integration
  • [DFDL-1649] - Enable lengthKind 'pattern' for hexBinary type
  • [DFDL-1666] - Support Jenkins automated build and Artifactory
  • [DFDL-1729] - Enable EBCDIC and other character set (charset) encodings
  • [DFDL-1744] - Create JSON InfosetOutputter
  • [DFDL-1745] - Create JDOM InfosetOutputter
  • [DFDL-1752] - Add w3c DOM InfosetOutputter
  • [DFDL-1755] - preserialization time is still compiling schema
  • [DFDL-1758] - Add XMLTextInfosetInputter
  • [DFDL-1759] - Add JsonInfosetInputter
  • [DFDL-1762] - Add w3c DOM InfosetInputter
  • [DFDL-1831] - Add support for dfdl:encodingErrorPolicy="error"

Task

  • [DFDL-149] - AA-BG tests
  • [DFDL-464] - Create "How to run an example" documentation
  • [DFDL-468] - How to run examples with debugger enabled
  • [DFDL-995] - Find upper limit for pcap file size
  • [DFDL-1058] - Modify performance harness and/or CLI to measure performance when loading a pre-compiled schema
  • [DFDL-1156] - Ensure Daffodil works on Java8
  • [DFDL-1211] - Upgrade to Scala 2.11
  • [DFDL-1280] - CLI: Bad error when schema file can't be found
  • [DFDL-1354] - Update Performance Machine to Java 8
  • [DFDL-1399] - Enter our scala.xml bugs into the GitHub bug tracker
  • [DFDL-1461] - Large amount of Tuple4 allocations related to USASCII7BitDecoder
  • [DFDL-1487] - Convert escape scheme to use Evaluatables
  • [DFDL-1488] - Convert field DFAs to use evaluatables
  • [DFDL-1696] - Explore withParseErrorThrowing uses
  • [DFDL-1776] - Determine if we can model/parse DER encoded X.509 certificates with DFDL/Daffodil
  • [DFDL-1780] - Need way to test all the different infoset inputters/outputters with our full test suite

Improvement

  • [DFDL-372] - Performance: Need state machine for binary vs text state
  • [DFDL-647] - Integrate daffodil into a netbeans plugin for schema development with debugging support
  • [DFDL-648] - Performance: Can eliminate many AlignmentFill parsers with simple optimization
  • [DFDL-649] - Performance: backtracking should preserve char readers for the same bit position if possible
  • [DFDL-872] - Refactor "Delimiter" class
  • [DFDL-933] - Improve PState/InStream/DFDLReader/Reader[Char] stack
  • [DFDL-968] - Replace lengthKindPattern combinator
  • [DFDL-981] - Merge classes CompiledExpression and CacheDynamic
  • [DFDL-1020] - sbt/maven build for ICU libraries
  • [DFDL-1039] - Replace custom java version checking
  • [DFDL-1113] - asLong has a case for java.math.BigInteger. Everything else is scala's BigInt.
  • [DFDL-1150] - CLI: parsing large files takes significant time to print result
  • [DFDL-1242] - Logging performance poor - should use a macro-based logging facility
  • [DFDL-1273] - Unparsing - Optimizing the streaming of arrays to prune infoset
  • [DFDL-1283] - Debugger: Add support for printing the delimiter stacks
  • [DFDL-1312] - Add namedQName to infoset event
  • [DFDL-1319] - TDML Runner - enhance to allow tdml:tutorial element.
  • [DFDL-1330] - TDML Runner - needs feature to make embedded schemas have elementFormDefault unqualified
  • [DFDL-1331] - Duplicated code - should be consolidated.
  • [DFDL-1339] - DFDLDelimParser
  • [DFDL-1340] - Performance: rewrite LiteralNilExplicitLengthInCharsParser
  • [DFDL-1370] - Performance: DFA needs to grab existing data on non-match for diagnostic message purposes
  • [DFDL-1383] - TDML Runner roundTrip: Unable to expect errors midway through trip
  • [DFDL-1390] - Performance: Charset Encoding change using explicit EncodingChange parser/unparser
  • [DFDL-1394] - AlignmentFillParser not being optimized out in obvious case.
  • [DFDL-1411] - PERFORMANCE: Create our own mutable Stack class - scala.collection.mutable.Stack is just a list
  • [DFDL-1415] - Performance: DFA changes that may help
  • [DFDL-1416] - Final Stack Checking
  • [DFDL-1417] - Performance: Eliminate object copying in parser
  • [DFDL-1419] - Decrease number of allocations related to DIComplex
  • [DFDL-1421] - Many char array allocations when performance testing PCAP parsing
  • [DFDL-1423] - Performance: Reduce memory allocations
  • [DFDL-1424] - Need a Maybe for primitive types
  • [DFDL-1425] - Performance: convert to using scala 2.11 macros
  • [DFDL-1439] - Binary Number Parser needs refactoring
  • [DFDL-1452] - Performance - Unparser - when infoset comes from tree in memory
  • [DFDL-1456] - Code Style - Maintainability and Correctness Issues
  • [DFDL-1459] - Re-enable assertions in byte buffer data input streams
  • [DFDL-1460] - Need macros for schemaDefinitionUnless
  • [DFDL-1463] - possible change to coroutine library - maintainability - maybe performance
  • [DFDL-1464] - Remove slot complex state allocation
  • [DFDL-1465] - Unnecesssary Mark allocations in StatementElementCombinator
  • [DFDL-1466] - Fix withBitLengthLimit macro to not require passing extra awkward arg
  • [DFDL-1469] - Maintainability: eliminate TypeConversions object - too many kinds of conversions around.
  • [DFDL-1471] - Regression tests producing too much noise output
  • [DFDL-1472] - Change use of Long to an unsigned java.lang.Long (e.g., UJLong)
  • [DFDL-1485] - Replace delimiters (separator, initiator, terminator) with Evaluatables
  • [DFDL-1496] - Remove withParseErrorThrowing
  • [DFDL-1529] - Missing Unit tests for putBitBuffer
  • [DFDL-1534] - Improve OutputValueCalcStaticLength comments/documentation
  • [DFDL-1536] - Scrutinize/add comments for SuspendableExpressions and coroutines
  • [DFDL-1562] - eclipse validation broken - xml catalog - out of date with file tree, etc.
  • [DFDL-1568] - Streaming Unparser: Evaluate outputValueCalc before the end of unparsing
  • [DFDL-1575] - daffodil-extras does not work
  • [DFDL-1581] - Get rid of "Statement" prefix on StatementElement...
  • [DFDL-1591] - unparser performance
  • [DFDL-1600] - StringOfSpecifiedLengthUnparser - rename since it only truncates now
  • [DFDL-1604] - review CII best practices for open source
  • [DFDL-1637] - wiki -redundant pages
  • [DFDL-1658] - Wiki page for "how to report a bug" needs update for unparse/round-trip
  • [DFDL-1687] - tunable to suppress schema definition warnings
  • [DFDL-1689] - remove distracting warnings from tests
  • [DFDL-1691] - div/idiv is broken. Has no tests
  • [DFDL-1693] - We're missing a final check that the PState stacks are empty.
  • [DFDL-1694] - Examples in releases should be marked as %doc in RPM, or remove daffodil-examples completely?
  • [DFDL-1695] - TDML runner - take XML infoset for unparsing or parse-test comparsison from a file specified per test case
  • [DFDL-1699] - withParseErrorThrowing has non-thread-safe flag
  • [DFDL-1713] - NiFi Processor: Improve documentation
  • [DFDL-1726] - Update all DFDL Schema projects to use standard directory tree layout
  • [DFDL-1731] - Performance Report: Add parse time measure with XML conversion (current is without)
  • [DFDL-1737] - Consider replacing ByteBufferDataInputStream LongConverter's with getByteArray
  • [DFDL-1743] - Replace Infoset toWriter with an InfosetOutputter
  • [DFDL-1746] - Modify parse() API to accept InfosetOutputter
  • [DFDL-1751] - dfdl:nilValue and dfdl:nilKind are not allow on simple types
  • [DFDL-1753] - Performance regression due to new parse API()
  • [DFDL-1757] - Create InfosetInputter API
  • [DFDL-1760] - Improve ScalaXMLInfosetInputter performance
  • [DFDL-1761] - Improve JDOMInfosetInputter performance
  • [DFDL-1802] - Correct Tutorials to properly display appropriate schema for the example
  • [DFDL-1804] - daf:trace fails on complex element

Edit/Copy Release Notes

The text area below allows the project release notes to be edited and copied to another document.