Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

WhoNotes
Luigi
Maxno updates
Mike L.no updates
Todd

Pull requests for extractors-geo - can someone check this? It's causing errors for some projects.

Pull request for 2.0 - upload multiple files.

Bingno updates
Mike B.

no updates

RobBug (question) in clowder where if you double click the create button it makes a two datasets (and maybe others)
Kastan
  •  PDG colab: They need data pipelines for ML & ML training pipelines (see post-meeting email for details). My concern: Codeflare satisfies only a small part of their needs, they primarily need data ops (like Airflow and Spotify's Luigi). Ray Workflows resolve this conflict.
  •  PDG colab: Recieved data (Commerical via XSEDE, public via Ingmar's Github). 
  •  IN-CORE colab: They have data, need customized ML. I can help them use Codeflare to get better ML performance.
  •  Ensure Dask worker.distributed for XGBoost works on HAL (currently, workers getting killed by garbage collector)
  •  Talk to HAL admins about Ray support (for IBM Codeflare). Currently unsupported on ppcleRecieved labeled data and a plan for creating new data.
  •  Resolve Ray asyncio threading conflict.
  •  PDG: Investigating PDG's current data ingest pipeline to recreate in Ray Workflows. Next deliverable is simple data-loading & pre-processing example.
  •  IN-CORE: Build prototype Ray workflow for satelite image pre-processing.
Sandeep
Chen
  • ACSW poster abstract submitted
  • create milestone alpha 2.0 and clean up / create some of the tasks
  • will start to work on error message modal this afternoon
Katie
Lisa

...