The position will be responsible for developing, deploying, and maintaining software for handling simulation and ML models, data storage, and communication between all these components in offline and streaming situations.
Knowledge of different backend systems, MLOps and DevOps methodologies and systems will be highly valuated. Sysadmin experience is required.
The infrastructures to be managed are two local machines, pipelines and systems in High-Performance Computing systems (mainly Marenostrum V), as well as cloud architectures (currently AWS). The candidate will work in close collaboration with multiple projects and other members of the team to help their needs.
Key Duties
- Deploying and manage virtualization architectures (Docker, Kubernetes, etc.)
- Deploying and manage streaming and orchestration software (Kafka, Spark, Airflow, etc)
- Implement usable tools to control and monitor all steps of the different operations
- Collaborate in the design and implementation of the backend for the group projects
- Create and maintain CI/CD pipelines using DevOps and MLOps methods and tools
- Manage and maintain internal software for the group work tools (Mattermost, B2Drop, Superset, Notion, and various web pages and databases) as well as two workstations and cloud hardware (AWS)
- Produce documentation of the code and systems
Data de tancament: Dijous, 02 Gener, 2025
Més posts de Recerca
Cap comentari:
Publica un comentari a l'entrada