Uploaded image for project: 'Clowder'
  1. Clowder
  2. CATS-1034

scripts to migrate filebytes storage files to AWS S3.

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Done
    • Priority: Normal
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We need a script that takes a mongo database with files in local storage, and migrates it to S3 storage. 

      This will require to move all files from disk to S3 buckets, we should use this as an opportunity as well check for consistency. As the files are moved we should modify the mongo database to the new location in S3. 

      We need to make a list of all files that have been migrated so we can delete them after migration is done and we checked all files.

       

      Meanwhile, make it as a docker image.

        Gliffy Diagrams

          Attachments

            Activity

              People

              Assignee:
              bing Bing Zhang
              Reporter:
              bing Bing Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Tasks