...
- ncsa.archival.disk: Moves the file from one specially-designated folder on disk to another (requires write access to Clowder's files on diskdata directory)
- ncsa.archival.s3: Changes the Storage Class of an object stored in S3 (requires write access to Clowder's bucket in S3)
The two options cannot currently be mixed, meaning that if Clowder uses DiskByteStorage then you must use the Disk archiver.
...
If a user chooses to Archive the file, then it is sent to the configured archival extractor with a parameter of operation=unarchivearchive.
The extractor performs whatever operation it deems as "archiving" - for example, copying to a network file system.
The page will refresh automatically after a few seconds - for most cases, this hard-coded delay is enough to pick up the new File status of ARCHIVED on refresh.
Finally the file is marked as ARCHIVED, and (if configured) the user is given the option to Unarchive the file.
...
If a user chooses to Unarchive a file, then it is sent to the configured archival extractor with a parameter of operation=unarchive.
The extractor performs the inverse of whatever operation that it previously defined as "archiving", bringing the file bytes back to where Clowder can access them for download.
NOTE: The page will refresh automatically after a few seconds - for most cases, this hard-coded delay is enough to pick up the new File status of PROCESSED on refresh.
Finally the file is marked as PROCESSED, and the user should be once again given the option to Archive the file and requests to download the file bytes should succeed.
Automatic File Archival
If configured (see below), Clowder can automatically archive files of sufficient size after a predetermined period of inactivity.
...
NOTE 1: MOUNTED_PATHS configuration is currently required without modifications to the Python code.
NOTE 2: on MacOSX, you may need to run the extractor with the --net=host option to connect to RabbitMQ.
...