Page History

...

1. SETUP: Is there special setup or configuration needed to make an instance "private"?
2. Login to Clowder
3. ???
   1. Expectations?
      

Fixes to Authentication Providers

• CATS-868: If no local password and only 1 provider, redirect to the provider login page immediately

1. ???

• CATS-911: fixed ldap userid

1. Enable LDAP login

...

1. in Clowder
2. Login with one user via LDAP
3. Login with a second user via LDAP
4. ???
   
   1. Expectations?

Fixed MongoDB Dataset Service findFileById

• CATS-897 / CATS-906: mongodbdatasetservice.findbyfileid will also return datasets indirectly containing give fileid

1. add file under path test/a/b/file,
   1. run get paths endpoint on this file.
   2. delete this file from clowder.
   3. Expectations?
2. add file under test dataset.
   1. run get paths endpoint on this file.
   2. delete this file from clowder.
   3. Expectations?

Fixed RabbitMQ Parameter Escaping

• CATS-905: Parameters subdocument is escaped in rabbitmq message

1. Enable the RabbitMQ plugin in your Clowder instance

2. Register an extractor with Clowder

3. Manually submit a file or dataset for extraction

4. View the message in RabbitMQ 
   1. You should see that the map of "parameters" is no longer escaped as a string

Fixed Extractors Logging Sensitive Data in Plaintext

• CATS-903: Fixed extractors printing the private key in error messages

1. Enable the RabbitMQ plugin in your Clowder instance
2. Register an extractor with Clowder

3. Manually submit a file or dataset for extraction

   1. Hint: Try to find some case that you know will produce an extractor error
4. Check the extractor logs / metadata
   1. You should no longer see the secret_key explicitly printed to the logs during errors

New Views: ExtractorInfo / ExtractorDetails

• CATS-

  890: Per-space extractor list should now show more detail

  891: New global extractor view (e.g. table)

1. Check out this branch, enable Enable the RabbitMQ plugin in your Clowder instance
2. Start , and start an extractor that has the process block defined in extractor_info.json
3. Create a space (or navigate to an existing space)
4. Admins should see an "Extractors" button/link on the right of the spaces/:spaceId view - click this link
   1. You should be brought to spaces/:spaceId/extractors
   2. You should see any registered extractors listed here
   3. This view now should roughly match the mockups attached to this ticket (sans the "Show Columns" dropdown)
   4. Each extractor should list the name, description, author, and process triggers, as well as the checkbox to enable or disable them

...

1. Login as an admin user via http://localhost:9000/login
2. Expand the "Admin" dropdown menu at the top-right (gear icon)
3. Choose the new option for "Extractors" (not to be confused with "Extractions", which previously existed)
   • This should navigate you to the new http://localhost:9000/extractors view
   • By default, no extractors should be enabled

   • CATS-908: You shouldn't see any extraneous <br> elements between the page header and the table

4. Enable an extractor and click "Update"
   • You should be brought back to the Clowder home page
5. Navigate back to the "Extractors" view and refresh the page
   • You should see that your selection is still enabled
   • The refresh further confirms that this change has been persisted to MongoDB (not just in-memory)
6. Navigate to a per-space extractor list for a space (e.g. spaces/:spaceId/extractors)

   • CATS-909: You should see that the extractor that was enabled globally cannot be unchecked

• CATS-892: New Extractor details view

• CATS-908: Removed excess whitespace from both updateExtractors views

...

1. Enable the RabbitMQ plugin in your Clowder instance

2. Start and register an extractor with Clowder (for example, ncsa.image.metadata):

   Code Block
   language bash
   export PUBLIC_IP="<YOUR_PUBLIC_IP>" export CLOWDER_API_KEY="<CLOWDER_API_KEY>" docker run -it --rm --net=host -e RABBITMQ_URI="amqp://guest:guest@localhost/%2f" -e REGISTRATION_ENDPOINTS="http://${PUBLIC_IP}:9000/api/extractors?key=${CLOWDER_API_KEY}" clowder/extractors-image-metadata

   
   

3. Navigate to localhost:9000/extractors/:extractorName (for example: http://localhost:9000/extractors/ncsa.image.metadata)

   1. You should see a new view that roughly matches the mockups shown here
   2. The new view should list all/most of the common fields of the underlying ExtractorInfo object (note that these fields were previously hidden everywhere else in the UI)

New API: Reverse Proxy

• CATS-793 / CATS-889: Clowder Reverse Proxy API - GET/POST/PUT/DELETE

...

1. view the updated spec in Swagger UI here: https://clowder.ncsa.illinois.edu/swagger/?url=http://localhost:9000/swagger

Notes

You can also serve swagger.yml some other way, if you'd like, but CORS did (I think) prevent me from linking Swagger UI directly to a raw file in our OpenSource BitBucket.

...

• CATS-374 / CATS-375: Track usage metrics - files/datasets + views/downloads

1. Enable the RabbitMQ plugin in your Clowder instance
2. Register the standard image preview extractor with Clowder
   1. NOTE: This will prevent "views" of a file from being counted as a download, which could be confusing to users
3. Login to Clowder
4. Upload a new file
5. View it in Clowder
   1. You should see that the file has 1 view and 0 downloads
6. Refresh the page a few times
   1. You should see that the "views" count is incremented for each refresh
7. Download the file and refresh the page again
   1. You should see now that the file has 1 download

Per-Space Extractors

• CATS-890: Per-space extractor list should now show more detail (e.g. table)

1. Enable the RabbitMQ plugin in your Clowder instance
2. Start an extractor that has the process block defined in extractor_info.json
   1. For example: image-metadata
3. Create a space (or navigate to an existing space)
4. Admins should see an "Extractors" button/link on the right of the spaces/:spaceId view - click this link
   1. You should be brought to spaces/:spaceId/extractors
   2. You should see any registered extractors listed here
   3. This view now should roughly match the mockups attached to this ticket (sans the "Show Columns" dropdown)
   4. Each extractor should list the name, description, author, and process triggers, as well as the checkbox to enable or disable them

   5. CATS-908: You shouldn't see any extraneous <br> elements between the page header and the table

• CATS-799: Extractors should now respect per-space enabled/disabled options

Configuration / Maintainability Changes

• CATS-884: Added Orcid Id's to zenodo.json file

1. ???

• BD-2128: Add overridable environment vars for Mongo and Rabbit MQ URIs

1. ???

• Script to create service accounts

1. ???