Automate streamflow run process
Action items:
-
create a project in rke2-1-dev-cineca for @vgeo -
@vgeo should familiarize with https://github.com/alpha-unito/streamflow , specifically https://github.com/alpha-unito/streamflow/tree/master/docs/source/cwl and all streamflow/cwl related material found in repo -
@vgeo hands-on/ test https://gitlab.ebrains.eu/ri/tech-hub/platform/workflows/streamflow-examples on k8s -
convert CWL workflow (<- this is what we ask from EBRAINS users) into streamflow.yml format (<- this is what steramflow expects) to run via streamflow in k8s -
use data-proxy for fetching the "input" files -
use data-proxy for uploading "output" files in object storage
Prior steps made by Nikos and Michalis:
- Although we have successfully tested StreamFlow Workflow Manager in streamflow-examples there is a need to automate the process of running CWL with streamflow like it is done by CWL-tes tool.
- For that purpose the streamflow-client repository has been created.
Edited by sofia karvounari