Uploaded image for project: 'IML-CZO Data Management '
  1. IML-CZO Data Management
  2. IMLCZO-267

Update Flux Tower and Allerton Parsers

    XMLWordPrintableJSON

Details

    • Task
    • Status: Done
    • Normal
    • Resolution: Fixed
    • None
    • None
    • None
    • None
    • IMLCZO 2019 April, IMLCZO 2019 May

    Description

      This task may be removed depending upon conversations

      Expected Workflow (from notes 05.06.2019):

      • Hourly files come from LoggerNet on Linux
      • Cron checks for new files every hour
      • As parsing each of these files, could then concatenate the new ones with all the existing for the year to a new file EVERY HOUR
      • Upload that growing file to Clowder to a RAW folder in a new Dataset EVERY DAY
      • Annually, place the full year file in to the PROCESSED folder in the same Dataset EVERY YEAR, and then delete the RAW files for that year if desired
      • (Can do this year from start point if from start of year is not feasible) 

      Gliffy Diagrams

        Attachments

          Issue Links

            Activity

              People

                mpitcel2 Michelle Pitcel
                mpitcel2 Michelle Pitcel
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Time Tracking

                    Estimated:
                    Original Estimate - 3 days
                    3d
                    Remaining:
                    Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                    2d 4h
                    Logged:
                    Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                    4h

                    Tasks