Uploaded image for project: 'Daffodil'
  1. Daffodil
  2. DFDL-1735

BLOB/CLOB - large object handles

    XMLWordPrintableJSON

    Details

      Description

      Binary large object, and character large object (aka BLOB/CLOB) support is needed.

      Rather than transforming a large binary object into hexBinary or string, instead one annotates the DFDL schema to specify that a BLOB/CLOB handle is preferred. The Infoset then contains not the data, but a token/object that can be fed to an "open" API to access a stream of the data. The token/object is a small sized thing. This allows data formats like JPEG 2000 where payloads are often gigabytes.

      Note: implementing this requires revising our ByteBufferDataInputStream layer into one that does not require the input data to fit in memory.

      See article on Wiki about large objects:

      https://opensource.ncsa.illinois.edu/confluence/pages/viewpage.action?pageId=54427836

        Gliffy Diagrams

          Attachments

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              mbeckerle.dfdl Mike Beckerle
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:

                  Tasks