...
The two options cannot currently be mixed, meaning that if Clowder uses DiskByteStorage then you must use the Disk archiver.
If neither of the above two these two extractors fit your use case, pyclowder can be used to quickly create a new archival extractor that fits your needs.
...
If the admin has configured the archival feature (see abovebelow), then the user is also offered a button to Archive the file.
...
Automatic File Archival
If configured (see abovebelow), Clowder can automatically archive files of sufficient size after a predetermined period of inactivity.
...
| Code Block |
|---|
# storage driver
service.byteStorage=services.filesystem.DiskByteStorageService
# disk storage path
#clowder.diskStorage.path="/Users/lambert8/clowder/data" # MacOSX
clowder.diskStorage.path="/home/clowder/clowder/data" # Linux
# disk archival settings
archiveEnabled=true
archiveDebug=false
archiveExtractorId="ncsa.archival.disk"
archiveAutoAfterDaysInactive=90
archiveMinimumStorageSize=1000000
archiveAllowUnarchive=true |
To run the Disk archival extractor with this configuration:
...
| Code Block |
|---|
# storage driver
service.byteStorage=services.s3.S3ByteStorageService
# AWS S3
clowder.s3.serviceEndpoint="https://s3-us-east-2.amazonaws.com"
clowder.s3.accessKey="AWSACCESSKEYKASOKD"
clowder.s3.secretKey="aWSseCretKey+asAfasf90asdASDADAOaisdoas"
clowder.s3.bucketName="bucket-on-aws"
clowder.s3.region="us-east-2"
# disk archival settings
archiveEnabled=true
archiveDebug=false
archiveExtractorId="ncsa.archival.s3"
archiveAutoAfterDaysInactive=90
archiveMinimumStorageSize=1000000
archiveAllowUnarchive=true |
NOTE: Changing the Region typically requires changing the S3 Service Endpoint.
...
| Code Block |
|---|
# storage driver service.byteStorage=services.s3.S3ByteStorageService # Minio S3 clowder.s3.serviceEndpoint="http://localhost:8000" clowder.s3.accessKey="AMINIOACCESSKEYKASOKD" clowder.s3.secretKey="aMinIOseCretKey+asAfasf90asdASDADAOaisdoas" clowder.s3.bucketName="bucket-on-minio" # S3 archival settings archiveEnabled=true archiveDebug=false archiveExtractorId="ncsa.archival.s3" archiveAutoAfterDaysInactive=90 archiveMinimumStorageSize=1000000 archiveAllowUnarchive=true |
NOTE: MinIO ignores the value for "Region", if one is specified.
...