Data Engineer (Spark, Scala, Java, Azure Databricks)
Description
About the role
We are looking to hire a Data Engineer to participate in the design, development, integration, and support of data solutions in an international technological environment.
The selected person will work with distributed processing and cloud technologies, mainly Apache Spark, Scala, Java, Azure Databricks, AWS EMR, and Apache Airflow, collaborating with different teams to ensure the quality, integration, and operation of data pipelines.
If you are a professional passionate about technology, with a solution-oriented mindset, and you are looking for an environment where you can grow and add value, we invite you to join our team at Metrica España!
What you'll do
- Design, develop, and maintain data lake pipelines using Spark, Scala, and SQL.
- Orchestrate batch workflows and dependencies with Control-M and Airflow.
- Implement data ingestion, transformation, validation, and publishing processes for market risk use cases.
- Optimize the performance, reliability, and scalability of Spark-based workloads.
- Analyze technical and functional deficiencies, propose solutions, and support delivery planning.
- Provide support for production incidents, root cause analysis, and continuous improvement of operational processes.
- Collaborate with agile teams, functional teams, and production support teams to generate business value.
What we're looking for
Experience: Minimum 2 years
- At least 2 years of experience in similar roles.
- Demonstrable experience with Java, Spark, Scala, and SQL (more than 2 years).
- Experience with Azure Databricks and Apache Airflow.
- Experience using AI-based tools to improve development productivity.
- Continuous integration (Git, GitHub Actions).
- Cloud computing: Azure and AWS.
- Experience with AWS EMR.
- Basic knowledge of cybersecurity and quality (Fortify, Sonar, Raptor, etc.).
- Minimum English level: B2.
Advanced Amazon EMR Mandatory
Advanced MySQL Mandatory
Advanced Microsoft Azure Mandatory
Advanced Apache Spark Mandatory
Nice to have
Advanced Data Ingestion & Transformation Optional
Advanced Regulatory Reporting Optional
What you'll get
SBA: 35,000€
- Permanent contract.
- Competitive salary, in accordance with the experience and knowledge provided.
- Opportunities for professional development and continuous training.
- Participation in projects of high technological impact.
- Collaborative and innovative working environment.
- Flexible hours and working modality to be defined.
How you'll work
Modality: 100% Remote
Skills
Sign in to read and join the discussion.