Nightingale - singularity is not an option. Conda can be used on R=
adiant; turned images into a Conda container. The Pod that they gave =
to us cannot work, so is working with Maria Jaromin on a work around. Rob r=
equests that Chen document what works and what doesn't, which can then be p=
ut into official documentation. (Docker, Kubernetes, Singularity, etc.)
V2: Max fixed some bugs.=20
Downloading still needs some work, perhaps because I was running multip=
le instances. We can provide a signature to a model and will convert Json f=
or you. Tested front end in docker compose - seemed to be working!
Adding notes to read.me
We are using FastAPI for Swagger
We need to create datasets and have been tested
Name Alpha 1 as a temporary name 2.0-Alpha.1 to distinguish between V1 =
and V2
Mike L notes that PR does not have good support for downloading file bl=
obs - client makes the assumption that we are working with Json or Txt and =
does not return binary data. Options are to look at a different generator o=
r use non-generated code for now
Should we use cookies instead of auth? Since we are fairly early in dev=
of v2, this might be a good time to change these patterns.
Using a generated client, it's returning binary blobs.
Working on how to sync a client and have put together a GitHub action a=
nd will check out the current FastAPI and run the latest docker image and g=
enerates the code.
Can we watch other GitHub actions? For extractors, it runs once a day/o=
nce an hour, etc. to check for merges OR make an access token can commit to=
another repository. However, if you're not careful, the secret token=
could be hacked. It would be best to run a cron job in the front end=
. GitHub actions can run a cron job. https://github.com/clowder-framework/e=
xtractors-core/blob/master/.github/workflows/pyclowder.yml. If yo=
u run a complex job on Friday night, it will be updated over the weekend an=
d on Monday there will be a completely updated version.
Todd going to be 25% on clowder after the new year. The PI should=
fill in the form themselves, including the CFOP, but the developer should =
help with how much space etc you will need in Clowder and Radiant usage.
Releasing V2 2.0-Alpha.1 this afternoon. Congrats to all! T=
here will be difference in the backend
Who
Notes
Luigi
absent
Max
absent
Mike L.
WIP GitHub action to sync OpenAPI spec changes w=
ith generated client code (still testing / trying to think of better patter=
ns) - Rob says look into turning this into a cron job action
Todd
pull requests open
edit and increment f=
ile
upload multiple files
Bing
Mike B.
Rob
Kastan
Get a reply from PDG machi=
ne learning folks - Scheduled for Monday 12/20
Ensure Dask worker.distributed works on HAL =
(workers getting killed by garbage collector)
Talk to HAL admins about Ray support (for IB=
M Codeflare)
Does Codeflare support current SOTA models (=
like MASK R-CNN) used by PDG?
Begin collaboration with IN-CORE grad studen=
t Tu Nguyen on building-type classification workflow.
Sandeep
Chen
Conda podman run Clowder stack (clowder-scala, rabbitmq and mongodb) wo=
rks on radiant machine; still figuring out on nightingale