Obtain Source Code

The source code is available from the NCSA opensource Git repository:

  git clone https://opensource.ncsa.illinois.edu/fisheye/git/dfdl.git

we are currently working (collectively) on the master branch.

Requirements & Building from Source

Daffodil requires Java 1.6 or higher. All scripts provided for running and testing are written in bash and tested in GNU Linux. Those scripts are not required though, so Daffodil should be able to run in other platforms as long as Java is installed

SBT is required for building, and depedency management.  See the README and BUILD files in the root of your local clone of the git repository.  In short, you need to download and put the correct SBT Launcher in your path.  Daffodil is currently using version 0.11.3 of SBT.  The correct launcher can be downloaded from http://xsbt.org/.

Daffodil is written in Scala 2.9, which also must be installed in order to run Daffodil.

Note: You will likely need to set available JVM memory for ant larger. For example, on a 64-bit Linux system, I have this in my .bashrc:

export JAVA_OPTS="-XX:MaxPermSize=512m -Xmx6000m -Xms40m -Xss2m"

This might seem generous (6Gig!), and the more critical thing is the MaxPermSize, which defaults to much too small.

Compiling in eclipse

There are IDE's and eclipse plug-ins that can be used to build daffodil. See:


Some time-dependent information: The As of November 2011, the Eclipse Indigo IDE (also known as version 3.7) and the current Scala plug-in for it (release 29, 2.0.0-beta, with this Eclipse update site: http://download.scala-ide.org/releases-29/2.0.0-beta), work for daffodil. They are robust enough to be useful, though there are some bugs still, and one must occasionally exit and re-enter Eclipse.

Tricks/Tips: You must increase the memory available, and specifically, the stack-size that Eclipse's JVM will use. This is done by editing eclipse.ini in the eclipse install directory. Below is an example of an eclipse.ini that works.

The first line "-clean" slows down starting Eclipse, but seems to be helpful given the current state of the Scala plug-in. Your mileage  may vary. The key changes are the last 3 lines. These set the minimum, maximum, and stack size to more reasonable values than the defaults. You need quite a bit of memory to use this IDE with Scala for Daffodil.

It is also very helpful when dealing with XML files to load the XML and XML-schema tools that are available in Eclipse.


Eclipse XML Setup

Getting eclipse to validate DFDL Schemas using its XML validation capabilities requires some configuration. Without this you will get hundreds (at least) of XML and XML Schema validation errors from the daffodil code base.

There are two files of interest to this

The eclipse-xml-catalog is imported into Eclipse via File->Import->XML->XML Catalog.

The eclipse-settings zip file contains a .settings directory to be restored in your Eclipse workspace's ".metadata/.plugins/org.eclipse.core.runtime/.settings" directory.

These settings and catalog will change the configuration of eclipse substantially, and may not be suitable for projects other than Daffodil, so save your existing eclipse install directory and workspace's .metadata/.plugins/org.eclipse.core.runtime/.settings directory, if you are trying to share it across more than just Daffodil. You'll likely need to split out into two distinct workspaces and two distinct copies of eclipse.

With the settings and XML Catalog above, you can edit DFDL Schemas, and get support from Eclipse.

For example,


Eclipse Unicode Setup

On Linux, UTF-8 and good unicode fonts are the default.

On Windows, a US install normally doesn't default to a Unicode friendly environment. One of the features of the Scala programming language is that it is completely unicode aware.

But, to make a USA windows default install of Windows itself, and Eclipse unicode friendly, you have to take a few steps.

These are described in the solution to this issue: https://opensource.ncsa.illinois.edu/jira/browse/DFDL-81. See the comments at the bottom for the settings.