Begin collaboration with IN-CORE grad student Tu Nguyen on building-type classification workflow.
PDG: Successful orientation meeting.
Does Codeflare support current SOTA models (like MASK R-CNN) used by PDG? No.. only sklearn.
PDG colab: They need data pipelines for ML & ML training pipelines (see post-meeting email for details). My concern: Codeflare satisfies only a small part of their needs, they primarily need data ops (like Airflow and Spotify's Luigi).
IN-CORE colab: They have data, need customized ML. I can help them use Codeflare to get better ML performance.
Ensure Dask worker.distributed for XGBoost works on HAL (currently, workers getting killed by garbage collector)
Talk to HAL admins about Ray support (for IBM Codeflare). Currently unsupported on ppcle.
Sandeep
Chen
Conda podman run Clowder stack (clowder-scala, rabbitmq and mongodb) works on radiant machine; still figuring out on nightingale