Code commits
pyclowder2
-
Rob Kooper f511e3b72573598bb9eca3b12d724d584d5b3442
Update CHANGELOG
-
Rob Kooper 7b99a9580d4dbca33377320c562561f658d56208
release 2.2.0
-
Rob Kooper 8c97747b1d0882a0524eb5885c4f82791a45c25d
cleanup
- bumped some requirements (solves github complaining about security issues)
- fixes to be python 3.x compatible
- fix some functions not using key to post
- general cleanup- contrib/monitor/monitor.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/client.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/collections.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/connectors.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/datasets.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/extractors.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/files.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/geostreams.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- pyclowder/utils.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- requirements.txt (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- sample-extractors/binary-preview/binary_extractor.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- sample-extractors/echo/echo.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- sample-extractors/simple-r-extractor/README.md (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- sample-extractors/wordcount-simple-extractor/wordcount.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- sample-extractors/wordcount/wordcount.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
- setup.py (version 8c97747b1d0882a0524eb5885c4f82791a45c25d) (diffs)
-
Rob Kooper 87a6605ea74a9ed9ddf685d4a0cd25cf27390699
Update CHANGELOG.md
-
Rob Kooper 764d9e0e516bfc4aba00f9e03b402858665c62af
Merge pull request #81 in CATS/pyclowder2 from bugfix/CATSPYC-18-filename-with-special-characters-result-in-error to develop
* commit '10d7afd00c6df71111be4f0179330e0a4abf183b':
simplify code
cleanup whitespace
fix error parsing json body -
Rob Kooper 10d7afd00c6df71111be4f0179330e0a4abf183b
simplify code
-
Chris Schnaufer 10debfa0397ca1231d58a0a7f93b887919d02b82
Merge pull request #84 in CATS/pyclowder2 from Improvement/CATS-975-add_links_to_local_files to develop
* commit 'cc47ffa2700b15d796baaaaa2adef3e666d77465':
Added making a temp folder for cases where multiple instance are running on the same machine
Added linking to local files when the local file name doesn't match expected file name -
Rob Kooper 66fc7701b866370e2dd10c82ebabd80de793b232
Merge pull request #69 in CATS/pyclowder2 from feature/CATS-799-fire-extractors-registered-with-space to develop
* commit 'e7f8caf15e25901ccc0df28cb1e34852c9436141':
send heartbeat monitor heartbeats remove extractor_id default rabbitmq_queue to be extractor_info.name make sure there is a queue name monitor now groups by extractor_info['name']/extractor_info['version'] only remove file in case of exception update extractor message counts every 60 seconds Move logic from StandardError to Exception python3 docker containers -
Rob Kooper e7f8caf15e25901ccc0df28cb1e34852c9436141
send heartbeat monitor heartbeats remove extractor_id default rabbitmq_queue to be extractor_info.name make sure there is a queue name monitor now groups by extractor_info['name']/extractor_info['version'] only remove file in case of exception update extractor message counts every 60 seconds Move logic from StandardError to Exception python3 docker containers
- contrib/monitor/Dockerfile (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- contrib/monitor/monitor.py (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- docker.sh (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- pyclowder/collections.py (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- pyclowder/connectors.py (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- pyclowder/extractors.py (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- release.sh (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- sample-extractors/binary-preview/README.rst (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- sample-extractors/binary-preview/binary_extractor.py (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- sample-extractors/echo/Dockerfile (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
- sample-extractors/echo/echo.py (version e7f8caf15e25901ccc0df28cb1e34852c9436141) (diffs)
-
Chris Schnaufer cc47ffa2700b15d796baaaaa2adef3e666d77465
Added making a temp folder for cases where multiple instance are running on the same machine
-
Chris Schnaufer 0a0f246f3f50715cf3902cb97c9fe75b1f907d35
Added linking to local files when the local file name doesn't match expected file name
-
Bing Zhang b77a2828ad16022935a16ea7a4529447021da9aa
add real email addresses inside the email notification
-
Rob Kooper 1073a5ec3679ffac71f6464fbe613390549cd57b
Merge pull request #78 in CATS/pyclowder2 from r-extractor to develop
* commit '2ebddbb5b9dba23d259c62b1322a8c91f7ac8451':
use launcher script
Add missing Dockerfile example
Created generic SimpleExtractor class used by both the R and Python implementations. initial example of r extractor wordcount example -
Bing Zhang 14ce71b049364cf2c50d7ed7a76e4bb6734783f4
email notification when extraction is done
- CHANGELOG.md (version 14ce71b049364cf2c50d7ed7a76e4bb6734783f4) (diffs)
- Dockerfile (version 14ce71b049364cf2c50d7ed7a76e4bb6734783f4) (diffs)
- notifications.json (version 14ce71b049364cf2c50d7ed7a76e4bb6734783f4) (diffs)
- pyclowder/connectors.py (version 14ce71b049364cf2c50d7ed7a76e4bb6734783f4) (diffs)
-
Rob Kooper f1cc099fe0435295973018e37a5d9cf143423b2f
cleanup whitespace
-
Rob Kooper 816ac5a05be4a88f4cd329a7cd4328a0f614b2e1
fix error parsing json body
-
Rob Kooper 2ebddbb5b9dba23d259c62b1322a8c91f7ac8451
use launcher script
Original version use python module to call R code. This would lock all python threads resulting in missing heartbeats.- sample-extractors/simple-r-extractor/Dockerfile (version 2ebddbb5b9dba23d259c62b1322a8c91f7ac8451) (diffs)
- sample-extractors/simple-r-extractor/launcher.R (version 2ebddbb5b9dba23d259c62b1322a8c91f7ac8451) (diffs)
- sample-extractors/simple-r-extractor/r_extractor.py (version 2ebddbb5b9dba23d259c62b1322a8c91f7ac8451) (diffs)
-
Rob Kooper 2735f79a73c4c9b60395f33361fee762a3340137
Merge remote-tracking branch 'origin/develop' into r-extractor
-
Rob Kooper 44876afd0619dcebe1dd256c323d795a8ab36a84
Don't register by default
-
Rob Kooper 4e7f7ca2955df55907b73507b66fde5f9b8ff3a7
Add missing Dockerfile example
-
Rob Kooper 0751f96e1b435ff6534467e481b76a2d80c65fd2
Created generic SimpleExtractor class used by both the R and Python implementations. initial example of r extractor wordcount example
- docker.sh (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- pyclowder/extractors.py (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- release.sh (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/simple-extractor/Dockerfile (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/simple-extractor/README.md (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/simple-extractor/simple_extractor.py (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/simple-r-extractor/Dockerfile (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/simple-r-extractor/README.md (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/simple-r-extractor/r_extractor.py (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/wordcount-simple-r-extractor/Dockerfile (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/wordcount-simple-r-extractor/extractor_info.json (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
- sample-extractors/wordcount-simple-r-extractor/wordcount.R (version 0751f96e1b435ff6534467e481b76a2d80c65fd2) (diffs)
-
Todd Nicholson 6c18c50d54f6e7e23e4bd3df9c1b3f5cbb18c453
when uploading previews, metadata cannot be posted unless a section_id is included in the metadata. Since section_id is not required for preview metadata in clowder, this changes the requirement that section_id must be present to post metadata.
Also, if metadata is sent to upload_preview without a section_id, an error is thrown because the method checks for section_id key and it is not present.
changelog entry added
Updated changelog.
fixed per Sandeep's comment
check for section_id key in previewmetadata in collections.upload_preview
Updated changelog. -
Rob Kooper 5f20e20301c17a55d8387eeefeb1f51a704666da
Merge pull request #75 in CATS/pyclowder2 from BD-2226-add-docker-compose-file-to-pyclowder2 to develop
* commit '184bff6755b01cc7ce2d53e05d513bcc426973a4':
Updated changelog.
Added Docker Compose file. -
Rob Kooper 10c3dc319f976e1610710a99923ac3a2964fbb25
make sure to push simple extractor
-
Sandeep Puthanveetil Satheesan 60c7debe2a94fee8e3b07f3c9f5b6b813b2f741a
Updated word count simple extractor with more comments. Renamed the function variable.
-
Sandeep Puthanveetil Satheesan 184bff6755b01cc7ce2d53e05d513bcc426973a4
Updated changelog.
-
Sandeep Puthanveetil Satheesan 1cc660573d7efac6fcb60bb6028ce9b557ba3198
Added Docker Compose file.
