Uploaded image for project: 'IML-CZO Data Management '
  1. IML-CZO Data Management
  2. IMLCZO-267

Update Flux Tower and Allerton Parsers

XMLWordPrintableJSON

    • Icon: Task Task
    • Resolution: Fixed
    • Icon: Normal Normal
    • None
    • None
    • None
    • None
    • IMLCZO 2019 April, IMLCZO 2019 May

      This task may be removed depending upon conversations

      Expected Workflow (from notes 05.06.2019):

      • Hourly files come from LoggerNet on Linux
      • Cron checks for new files every hour
      • As parsing each of these files, could then concatenate the new ones with all the existing for the year to a new file EVERY HOUR
      • Upload that growing file to Clowder to a RAW folder in a new Dataset EVERY DAY
      • Annually, place the full year file in to the PROCESSED folder in the same Dataset EVERY YEAR, and then delete the RAW files for that year if desired
      • (Can do this year from start point if from start of year is not feasible) 

              mpitcel2 Michelle Pitcel
              mpitcel2 Michelle Pitcel
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

                Created:
                Updated:
                Resolved:

                  Estimated:
                  Original Estimate - 3 days
                  3d
                  Remaining:
                  Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                  2d 4h
                  Logged:
                  Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                  4h