Priority Task list :
- Automate / code PyFluxPro “Creating the Database” section. (Done)
- Test with various dataset.
- Run EddyPro for Jan 2021 with 2 weeks data
- Make the below changes for the file output from Eddypro run:
- Match the meta data header rows in both files.
- Change timestamp format
- Convert temperature units for various columns
- Convert units and rename column
- Timestamp checks - check the first and last timestamps - should be 00:00 and 23:00.
- Manual entry of 2 sheets in excel. Copy output files from preprocessor.py and the changed output file from EddyPro run.
- Install and run PyFluxPro
- Man hours = approx. 15 hours
- Test with various dataset.
- Create a function to check if required variables are available and correctly formatted for eddypro in format.py
- Required variables : Ambient Relative Humidity (RH), Global Radiation (SWIN), Longwave Incoming Radiation (LWIN), Photosynthetically Active Radiation (PPFD) (Done)
- Check the variable upper/lower case names. (Done)
- Check if eddypro reads variables in case-sensitive manner.
- Man hours = approx. 4 hours
- Test preprocessor.py, format.py and eddypro headless with Sept - Oct 2020 data.
- Man hours = approx. 2 hours
- Create a function for quality check in precip data. This should be in preprocessor.py.
- Missing timestamp check : the function should break and write the till then processed output to file.
- Possible data values check : The range of precip data is 0-0.2 mm. the function should break and write the till then processed output to file.
- Man hours = approx. 4 hours
Other Tasks
- Test run eddypro_rp in macOS.
Resolve the current error of
NCSA-xxx:bin minum$ ./eddypro_rp "xx/xxx/xxx/templates/templates.eddypro" ******************* Executing EddyPro ******************* sh: -c: line 0: unexpected EOF while looking for matching `"' sh: -c: line 1: syntax error: unexpected end of file Reading EddyPro project file: /xx/xxx/xxx/xx/templates/templates.eddypro.. Done. sh: -c: line 0: unexpected EOF while looking for matching `"' sh: -c: line 1: syntax error: unexpected end of file Fatal error(86)> Could not retrieve files from directory. Either directory does not exist Fatal error(86)> or it does not contain files matching the selected requirements. Fatal error(86)> Program execution aborted. STOP 1
- Use python packages to convert units (cf_units or udunits) in format.py and preprocessor.py
- Yong Wook Kim will look into this
- Compare output from EddyPro
- will coordinate with Bethany Blakely
- Compare the eddypro output with the manual input file and the automated input file.
- will coordinate with Bethany Blakely
- Automate / code PyFluxPro “Formatting the PyFluxPro Control Files” - i think this does not require any man hours as these files are already shared by Bethany.