Uploaded image for project: 'Daffodil'
  1. Daffodil
  2. DFDL-1774

Performance - Investigate expression compilation speed

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Normal
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: deferred
    • Component/s: Front End, Middle "End"
    • Labels:
      None

      Description

      Expression compilation is incredibly slow right now, even for incredibly small schemas.

      We should profiling just expression compilation and see if there is any low hanging fruit that could easily be sped up. One potential place is the type converter, which is a just match case. This is probably very slow when the match is at the bottom of this list. We likely want to use a hash lookup for this.

      Additionally, there have been some reports that the scala parser combinator library is fairly poor (both slow and memory inefficient), so it may be worth looking into alternatives. The [https://github.com/lihaoyi/fastparse|fastparse] library might be a good alternative, though it does not appear to be a drop in replacement for our needs.

        Gliffy Diagrams

          Attachments

            Activity

              People

              Assignee:
              slawrence Steve Lawrence
              Reporter:
              slawrence Steve Lawrence
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:

                  Tasks