This page is under construction. This page will describe the features of Extractor Info Fetcher Service and the details about how it will be implemented.

Feature Description

For the purpose of moving compute to data, Brown Dog clients will need to know which extractors can process a given file. For this, the clients will first access an "Extractor Info Fetcher Service", through the BD-API endpoint /extractors. This service will return a list of extractors (including the docker image name) that can process files belonging to a given file type. Depending on which instance of BD-API was used (Dev, Prod, etc.), the list of extractors will be from that instance. I.e. only those extractors that are bound to a particular Brown Dog instance through RabbitMQ virtual host will be returned based on the request. Ideally these extractors should be either currently running or available, i.e., they shouldn't be obsolete.

The service will need to know the file type of a file to find the extractors that can process it. There are two options here, either the client can find out the mime type and send to the service or the client can send the file extension and the service can find out the mime type  

Implementation Details