Software Developer for DT-GEO Project (RE1-2) per al Barcelona Supercomputing Center

Data dThe Computer Sciences (CS) department of the Barcelona Supercomputing Center aims to carry out research and development to influence the way computing machines are built, programmed and used. The Workflows and Distributed Computing group at the Barcelona Supercomputing Center performs research on programming models for distributed computing. More specifically, this group is contributing to the DT-GEO project (https://dtgeo.eu/), which aims to develop a prototype for a digital twin on geophysical extremes, including earthquakes, volcanoes, tsunamis, and anthropogenic-induced extreme events. Many of the DTC components are developed with COMPSs, and the automatic recording of metadata related to an experiment is enabled with the workflow provenance mechanism of COMPSs.

COMPSs (compss.bsc.es) is a task-based programming model that enables the parallel execution of applications in distributed computing environments. For this research, the group is looking for an engineer to design and implement the required extensions to the workflow provenance mechanism of the COMPSs runtime and the improvement of its related services.

Workflow provenance is the ability to record metadata from a computational experiment run as a workflow. In COMPSs, this is done in an interoperable format to enable the interaction with tools following the same metadata format. Workflow provenance metadata is useful for: reproducibility of experiments, FAIR workflows, knowledge extraction and traceability/explainability of results, among others.

Key Duties

• Develop extensions to the workflow provenance generation of COMPSs to support both containerised tasks and containerised applications
• Improve the current COMPSs Reproducibility Service to be able to re-execute COMPSs applications that include containers
• Integration with eFlows4HPC services (Workflow Registry, Software Catalog and Container Image Creation service) to close the loop on application generation / reexecution
• The candidate will work closely with other research members on the Workflows and Distributed Computing group
• Contribution to COMPSs user manual that illustrates how to use the newly developed features
• Contribution of the candidate to the DT-GEO projecte 

Daa detancament: Dilluns, 16 Desembre, 2024

Més informació

Més posts de Recerca