Versions Compared
Key
- This line was added.
- This line was removed.
- Formatting was changed.
With growing and diverse collections of data becoming part of modern scientific workflows, many research projects today begin with a process of data wrangling, i.e. finding, manipulating, indexing, cleaning, and bringing together needed datasets. DIBBs Brown Dog aims to alleviate some of the overhead and heterogeneity in the processes involved in this step which tends to otherwise hinder scientific progress and reproducibility. Through a REST API Brown Dog provides data transformations such as format conversions (leveraging Polyglot) and content based extractions (leveraging Clowder) as a service which supports diverse usage through various clients and programming languages. Further, Brown Dog provides a venue to access and preserve data transformation tools, track provenance, track information loss, manage data movement, and process jobs in a scalable manner across a diverse set of computational resources. Overall, Brown Dog provides a low-level data infrastructure to interface with digital data contents and through its capabilities move software to being more agnostic to the format/structure of data, enabling the scientific community to focus more on their research, less on data wrangling, and allow researchers to more easily access datasets that would otherwise be inaccessible.
- Project Information and Resources
Children Display page Project Information and Resources
- Use Cases
Children Display page Use Cases
- Discussions / Under Development
- Alpha Beta Information Loss
- Beta Release
- Brown Dog API (Proposed Changes)
- Chrome Extension for DTS
- CI-BER Testbed
- Data and Tools
- Data Fetching Service & Data Movement Overall
- Deployment
- Extractors v2
- Fence User Quotas
- JSON-LD Support
- Ideas for Cyberintegrator for BrownDog
- LIDAR Tools
- Live Examples
- Metadata Encoding
- Metadata Representation
- Metadata Schemas
- Moving Computation Towards Data
- Obtaining Extractors Information- Heartbeats approach
- Polyglot Refactoring for Dockerizing SSes
- Polyglot Refactoring based on Clowder Architecture
- Polyglot / SoftwareServer Documentation
- REST Endpoint Consistency
- Relationships between Files
- Request a type of data be supported by the DAP and/or DTS
- Spaces
- Sprints
- Story Boards
- Transformations
- Tool Catalog
- Tool (or service) to generate a River Profile
- Tools
- VM Elasticity
- Miscellaneous Topics
Blog Posts | ||
---|---|---|
|
https://bd-api.ncsa.illinois.edu/
Recent Space Activity
Recently Updated | ||||||||
---|---|---|---|---|---|---|---|---|
|