Senior ML/LLM Ops Engineer - Hybrid (Brussels)
Posted Updated
Description
KEYES is seeking a Senior ML / LLM Engineer in Brussels to design and run production-grade ML systems within a secure hybrid on-premise and cloud setup. You will deploy, test, and monitor LLM models while collaborating with data scientists and developers to scale solutions.
The role focuses on LLMOps, data prep, fine-tuning, evaluation, and CI/CD pipelines, ensuring high reliability and security across EU institutions’ projects.
Design, build, and maintain production-grade ML systems with strong focus on LLMs in secure hybrid on-prem / cloud infrastructure. Deploy, test, manage and monitor ML models in containerised environments. Collaborate with data scientists and back-end developers to deploy ML models. Evolve LLMOps lifecycle: data prep, fine-tuning, evaluation, deployment, monitoring, iteration. Develop evaluation frameworks for LLM quality, robustness, regression tracking. Analyse performance metrics and troubleshoot to ensure high availability. Design CI/CD pipelines, orchestration solutions and data versioning tools. Create automated anomaly detection systems and optimize ML pipelines for scalability and cost-efficiency. Provide security studies and guidance on information system projects. Support and guide team members on LLMOps/MLOps practices. Master’s/Bachelor’s degree; Minimum 7 years of experience in Data, AI, LLMs. Excellent knowledge of managing an on-prem and/or cloud LLM / MLOps infrastructure. Excellent knowledge of containerisation and orchestration platforms (e.g. Kubernetes, Docker, Podman, EKS, PKS). Good knowledge of MLflow, TensorFlow (TFX) or equivalents. Good knowledge of Airflow. Good knowledge of AWS or EU cloud providers. Good knowledge of Python. Good knowledge Unix and Bash. Good knowledge agile software development methodologies. Good knowledge infrastructure as code (Terraform, CloudFormation). Good knowledge of messaging services and platforms (e.g. Kafka, Redis, RabbitMQ). Knowledge of data security measures (encryption, ML security a plus). Knowledge of NoSQL databases (OpenSearch, MongoDB). Knowledge of query languages (SQL, Hive, Pig). Experience with data analytics over big datasets and data lakes. Experience with monitoring and logging tools (ELK, Prometheus, Grafana, OpenTelemetry, Cloudwatch). Experience with model testing and validation in production environments. Ability to write clear technical documentation. Knowledge of EU Institutions’ grant management ecosystem (an asset).Skills
- Agile
- AI
- Airflow
- Analytics
- Anomaly Detection
- AWS
- Bash
- CI/CD
- Cloud
- CloudFormation
- CloudWatch
- Containerization
- Data Analytics
- Data Lake
- Docker
- EKS
- ELK
- Fine Tuning
- Grafana
- Hive
- Infrastructure as Code
- Kafka
- Kubernetes
- LLM
- LLMOps
- Machine Learning
- MLflow
- MLOps
- MongoDB
- NoSQL
- OpenSearch
- OpenTelemetry
- Podman
- Prometheus
- Python
- RabbitMQ
- Redis
- SQL
- TensorFlow
- Terraform
- Unix
Sign in to read and join the discussion.