Uploaded image for project: 'IML-CZO Data Management '
  1. IML-CZO Data Management
  2. IMLCZO-267

Update Flux Tower and Allerton Parsers

    XMLWordPrintableJSON

Details

    • Icon: Task Task
    • Resolution: Fixed
    • Icon: Normal Normal
    • None
    • None
    • None
    • None
    • IMLCZO 2019 April, IMLCZO 2019 May

    Description

      This task may be removed depending upon conversations

      Expected Workflow (from notes 05.06.2019):

      • Hourly files come from LoggerNet on Linux
      • Cron checks for new files every hour
      • As parsing each of these files, could then concatenate the new ones with all the existing for the year to a new file EVERY HOUR
      • Upload that growing file to Clowder to a RAW folder in a new Dataset EVERY DAY
      • Annually, place the full year file in to the PROCESSED folder in the same Dataset EVERY YEAR, and then delete the RAW files for that year if desired
      • (Can do this year from start point if from start of year is not feasible) 

      Gliffy Diagrams

        Attachments

          Activity

            People

              mpitcel2 Michelle Pitcel
              mpitcel2 Michelle Pitcel
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 3 days
                  3d
                  Remaining:
                  Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                  2d 4h
                  Logged:
                  Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                  4h

                  Tasks