Data Lakehouse Platform Devops Engineer
Summary
DevOps engineer on an international financial-sector project, keeping a data virtualization/lakehouse platform available, performant and scalable. Day to day: L2/L3 support, CI/CD automation, query and cost optimization, and observability using Dremio/Trino, Spark, Airflow, Terraform, Grafana, ELK and Dynatrace.
At Aubay, we continue to grow and are looking for a Data Platform DevOps Engineer to join an international project in the financial sector, contributing to the evolution and optimization of a next-generation data platform based on Data Lakehouse and Cloud technologies.
We are seeking professionals with experience in DevOps environments and data platforms, interested in working with Big Data technologies, automation, observability, and scalable architectures.
What will your mission be?You will be part of an international team responsible for ensuring the availability, performance, scalability, and optimization of a data virtualization platform used by various engineering and analytics teams.
You will contribute to process automation, environment management, platform monitoring, and the continuous improvement of Data Lakehouse architectures.
What will you do?- Administer and monitor data platforms in production environments.
- Manage incidents and provide advanced technical support (L2/L3).
- Automate deployments and processes through CI/CD pipelines.
- Optimize platform performance and data query execution.
- Design and implement observability and monitoring solutions.
- Participate in the integration and evolution of Data Lake and Data Lakehouse ecosystems.
- Collaborate with Data Engineering, Analytics, and Architecture teams.
- Contribute to cost optimization (FinOps) initiatives and continuous improvement.
Required tools and technologies:
- Dremio (or equivalent technologies such as Presto or Trino).
- Scripting languages (Python, Bash).
- SQL / Data processing (query execution analysis).
- Data Lake concepts (Parquet, Iceberg, Polaris, Data Governance).
- Data Lakehouse / Big Data.
- Apache Spark (highly desirable).
- Hadoop.
- Airflow (orchestration).
- Observability tools.
- Grafana.
- ELK Stack.
- Dynatrace.
- Infrastructure & DevOps.
- Terraform.
- Ansible.
- Git.
- Permanent contract and long-term project.
- Innovative and technologically challenging projects.
- Professional development in an international environment.
- Flexible compensation package: private health insurance, meal vouchers, and childcare vouchers.
- Continuous training and access to professional certifications.
- Corporate discount platform and employee benefits program.