This document shows how to generate list of sensors using the Geostreaming API.  Included are links to code and the output csv, as well as, a data dictionary. 

To create a list of sensors, use the following code: https://opensource.ncsa.illinois.edu/bitbucket/projects/GEOD/repos/gltg-parsers-py/browse/scripts/sensors_to_csv

Download the output CSV file (https://uofi.app.box.com/file/593176055855)

The output CSV is generated by parsing the JSON response from API. Example of JSON follows.

Typical Sensor JSON
{‘created': '2018-03-23T15:48:32Z',
'geoType': 'Feature',
'geometry': {'coordinates': [-84.44799549, 38.9203417, 0],
             'type': 'Point'},
'id': 1445,
'max_end_time': '2019-12-18T21:30:00Z',
'min_start_time': '2007-10-01T06:00:00Z',
'name': '03254520',
'parameters': ['discharge-ft3s',
                         'discharge-ft3s-qc',
                         'dissolved-oxygen-mgl',
                         'dissolved-oxygen-mgl-qc',
                         'nitrate-nitrite-as-n-mgl',
                         'nitrate-nitrite-as-n-mgl-qc',
                         'pH',
                         'pH-qc',
                         'specific-conductance-uScm',
                         'specific-conductance-uScm-qc',
                         'turbidity-fnu',
                         'turbidity-fnu-qc',
                         'water-temperature-c',
                         'water-temperature-c-qc'],
'properties': {'huc': {'huc2': {'code': '05'},
                       'huc4': {'code': '0510'},
                       'huc6': {'code': '051001'},
                       'huc8': {'code': '05100101'},
                       'huc_name': 'Licking'},
               'location': 'LICKING RIVER AT HWY 536 NEAR ALEXANDRIA, KY',
               'name': '03254520',
               'online_status': 'online',
               'popupContent': '03254520',
               'region': '0510',
               'type': {'id': 'usgs',
                        'network': 'NWIS',
                        'title': 'United States Geological Survey'}}}

Column Definitions

column namedefinition
sourceName of Institution that provides the data.
nameName of sensor provided by source.  If no name is provided by the source, naming convention applied in parser.
locationDescription of the location of the sensor provided by source.  
max_end_timeTimestamp of most recent datapoint.
min_start_timeTimestamp of first chronological datapoint.
parametersList of measurements collected by the sensor e.g., nitrate, phosphate, discharge.
huc8Hydrological Unit Code at subbasin level.
huc_name

Name of HUC.

online_status

Typical available for continuous data.  If the sensor data has been updated within the near past (~5 days), the sensor is designated 'online'.  If there is no recent data, the sensor will be designated 'offline'.  This is viewable in the UI.

Example Columns and Row

sourcenamelocationlongitudelatitudemax_end_timemin_start_timeparametershuc8huc_nameonline_status
United States Geological Survey3254520LICKING RIVER AT HWY 536 NEAR ALEXANDRIA, KY-84.44799538.92034172019-12-18T21:30:00Z2007-10-01T06:00:00Zdischarge-ft3s,
dissolved-oxygen-mgl,
nitrate-nitrite-as-n-mgl,
pH,
specific-conductance-uScm,
turbidity-fnu,
water-temperature-c,		5100101Lickingonline

Issues with Data

SourceIssuePertinence?
USGSA few locations show id instead of text
Water Quality Portal

many missing start and end time (update?)

many missing parameters


several sourcesmissing location
several sourcesmissing huc_name
several sourcesmissing online status
  • No labels

2 Comments

  1. Jong Lee

    u
    Marcus Slavenas could you re move "u" front of the string? 

  2. Marcus Slavenas

    changed name of file to gltg_sensors.csv