Page History

Organization Ideas

Naming Conventions

Some ideas for how to name items that are placed in Clowder:

• When able, include the name of the Sensor in the title of Spaces, Collections, and Datasets
• Including the name of the sensor Sensor may make it is easier to search for items

Metadata and Tags

Metadata and Tags can be utilized to enhance organization and search capabilities.

• Metadata
  • Metadata is searchable
  • Datasets can have Metadata
  • Files (in either Datasets or Folders) can have Metadata
  • Definition sources are provided for each Metadata field
• Tags
  • Tags are searchable
  • Can view a list of all Tags in the application
  • Datasets can have Tags
  • Files (in either Datasets or Folders) can have Tags

Using the Sections Within Clowder

It would be good to have a general organization methodology moving forward.

This section will contain various contains ideas for organization.

Note: there are three basic sections within Clowder:

• Spaces
• Collections
• Datasets

One An idea for utilizing and organizing these sections:

• Spaces
  • Named after each Sensor or a general category (e.g.: "How To" Documentation, Images, etc.)
  • Contains both Collections of Datasets and individual Datasets
  • Can have an image appear in the listing on Clowder
• Collections
  • Naming
  • Include the Sensor
  Include any grouping information (e.g.: date range, etc.)would include the Sensor name
  • Contains Datasets
• Datasets
  
  • NamingWhen possible, the The name would include the name of the Sensor
  • Some of these are auto-generated, and are therefore auto-named
  • Should be placed in Collections
  • Some Datasets can contain Contains raw data and parsed dataother derived data
  • Can contain Folders that contain files
  • Datasets and Files can both have Metadata and TagsShould be placed in Collections

This is an example illustrating this idea:

• This is based upon the Flux Tower data (information about this dataset Dataset is available in this Wiki space at Flux Tower Data)
• Space
  • There is only one of these for this Space
  • Space Name: Flux Tower DataSite
  • Space Description: Flux Tower located at location-description
  • Space Image: Suggestion - provide an image of the site or the instrument or a logo (if available)
• Collection
  • There can be several of these for this Space
  • Raw Data Measurements Example
    • Collection Name: Flux Tower Raw Data Files date-rangeThe date-range could be years or months depending upon the size of the dataset
    • Collection Description: Collection of Raw Data Files for date-range
    • Collection Content: This will contain all relevant Datasets for this collection
  • Data Measurements Example
    • Collection Name: Flux Tower Data Files
    • Collection Description: Collection of Data Files
    • Collection Content: This will contain all relevant Datasets for this collection A: date-range is a year
      • If date-range is 2010
      • Then Datasets would be all the Datasets that include 2010 data
      Example B: date-range is January 2010 to March 2010
    • If date-range is January 2010 to March 2010
    Then Datasets would be all the Datasets that include 2010 data from January to March
  • Documentation Example
    
    • Collection Name: Flux Tower Documentation
    • Collection Description: Documentation for the Flux Tower Sensor
    • Collection Content: This will contain any relevant documentation that describes the Sensor (types of measurements gathered, etc.)
      
      • Datasets would not be present in this collection for enhanced organization
      • Files can be of any preferred format
• Datasets
  • There can be several of these for each Collection in the Space
  • To simplify managing data, use Folders in yearly Datasets to group files by month
  • Datasets with Folders Example
    • Would be in the Flux Tower Raw Data Files Collection
    • Some of these are auto-generated and may have a different naming convention
    • Dataset Name: Flux Tower
    Dataset information
    • Raw Data 2016
      • Flux Tower information for 2016
    • • The information would just describe the general content of the Dataset (type of measurement, type of data, etc.)
    Dataset Content
    • Dataset Description: Flux Tower Raw Data collected during the year of 2016
      • A Dataset with Flux Tower information for 2016
    • Dataset Metadata: This will contain any relevant Metadata
      
    • Dataset Tags: This will contain any relevant Tags
    • Dataset Content: This will contain Folders for each month of data
      • Folder 1: January 2016
        • This will contain all January files
      • Folder 2: February 2016
        • This will contain all February files
      • Folder 3: March 2016
        • This will contain all March files
      • Keep creating Folders for the year as needed