Uploaded image for project: 'IML-CZO Data Management '
  1. IML-CZO Data Management
  2. IMLCZO-267

Update Flux Tower and Allerton Parsers

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Done
    • Priority: Normal
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Sprint:
      IMLCZO 2019 April, IMLCZO 2019 May

      Description

      This task may be removed depending upon conversations

      Expected Workflow (from notes 05.06.2019):

      • Hourly files come from LoggerNet on Linux
      • Cron checks for new files every hour
      • As parsing each of these files, could then concatenate the new ones with all the existing for the year to a new file EVERY HOUR
      • Upload that growing file to Clowder to a RAW folder in a new Dataset EVERY DAY
      • Annually, place the full year file in to the PROCESSED folder in the same Dataset EVERY YEAR, and then delete the RAW files for that year if desired
      • (Can do this year from start point if from start of year is not feasible) 

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                Assignee:
                mpitcel2 Michelle Pitcel
                Reporter:
                mpitcel2 Michelle Pitcel
                Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved:

                    Time Tracking

                    Estimated:
                    Original Estimate - 3 days
                    3d
                    Remaining:
                    Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                    2d 4h
                    Logged:
                    Time Spent - 4 hours Remaining Estimate - 2 days, 4 hours
                    4h

                      Tasks