Data Access Proxy (DAP)| Anchor |
|---|
dap | dap | : Clowder: The Brown Dog web service component responsible for file format conversionsextracting novel, often higher level, data from file contents (e.g. metadata, tags, signatures, and other derived products). Built on top of Polyglot, utilizing Software Servers and Daffodil, the DAP Clowder (formerly Medici 2.0) and utilizing Versus for content based comparisons the DTS is a highly distributed and extensible service which brings together and manages conversion capabilities, both the needed computation and data movement, from other software, tools, and services under extracts from data information by which to index, compare, and further analyze collections of data through a broadly accessible REST API.
...
Data Extraction: A transformation that creates new data from the given data. An example in the case of Brown Dog would be the execution of analysis code on an image file's contents to determine if a particular species of plant is present. We utilize extraction to automatically generate metadata and/or signatures from a file's contents and provide users with means of finding, relating, and utilizing data that may be difficult otherwise.
Data Tilling Transformation Service (DTS): An internet service
Metadata
dtsdts | : The Brown Dog web service responsible for extracting novel, often higher level, data from file contents : Simply data about data (e.g.
metadata, tags, signatures, and other derived products). Built on top of Clowder (formerly Medici 2.0) and utilizing Versus for content based comparisons the DTS tags or keywords).Polyglot: The Brown Dog component responsible for file format conversions. Utilizing Software Servers and Daffodil, the Polyglot is a highly distributed and extensible service which extracts from data information by which to index, compare, and further analyze collections of data through brings together and manages conversion capabilities, both the needed computation and data movement, from other software, tools, and services under a broadly accessible REST API.Metadata| Anchor |
|---|
metadata | metadata | : Simply data about data (e.g. tags or keywords).
Uncurated Data
: Think of a dump of some random hard drive. Without meaningful file names and a meaningful directory structure it will be difficult to find information without examining each and every file. File formats, in particular old and/or proprietary file formats, hinder the situation further by making it difficult to open a given file without the needed software to open it installed on your machine. Metadata is another way of providing insight as to the contents of a file. Consider a document tagged with keywords "paper, large dynamic groups" indicating a paper submission for a social science study looking into the behavior of large groups of people. Curated data is data that has been stored and diligently named, organized, and tagged so that others, both today and long in the future, can utilize the data. Uncurated data on the other hand doesn't have much of this and is essentially a big mess for others to go through. A significant amount of digital data, if not most, is uncurated. In the scientific world this is sometimes referred to as "long tail" data, suggesting this is linked with the tail of the distribution of project sizes, with the vast majority of smaller projects not having the resources to properly manage the data they produce. The bottom line is that curation is a cumbersome process and creating new data is both faster and more rewarding, at least in the short term, than going back and organizing old data. As science hinges on reproducibility and building on past results, however, these problems must be addressed.
...