Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

 

Outline Parser Functions

Functions will be described as unique= code particular to the source is needed and general= should be able to run as part of every source

  1. Get data from source (unique)
    1. Parsing begins by getting the data from the source.  Two types of data are needed:
      1. data that describes the site such as geocodes, name,  and source. 
      2. measurements
    2. The format and retrieval method varies from source to source
      1. Some source formats
        1. API for a single station (USGS,NOAA)
        2. API for mixed stations (Water Quality Portal)
        3. Files stored to server with loggetnet (GREON)
        4. csv download (LRTM)
  2. Parse data to sensor (unique and general)
    1. Up till now, this has been a unique process for each source; however, this portion ...should be broken into 2 portions
      1. reformat data into a standard