Data Engineer
Summary
Data Engineer building and maintaining large-scale ETL/ELT pipelines and data platforms with Python, Spark, Databricks and AWS (S3, Redshift, Glue, Lambda) for the Data & Analytics team of a major digital-marketplace business. Hybrid role in Barcelona (2-3 days in office), with room to explore LLMs in the data stack.
📍 Barcelona | Hybrid modality (2-3 days office) | Permanent contract | English (B2 or higher)
About the role
We are looking for a Data Engineer to join the Data & Analytics team of a leading technology company that operates large-scale digital marketplaces. In this team, data is at the centre of everything: you will help design, build and maintain the data infrastructure that supports products and analytics.
This is a very hands-on role, working with cutting-edge data technologies and close to the latest trends in the industry, including LLMs. It is a great fit if you want to influence how data drives decision-making and innovation across the company.
What will you do?
Build and optimise data pipelines
- Develop and maintain robust ETL/ELT processes with Python and Spark, ensuring data quality and reliability.
- Use AWS services (S3, Redshift and others) to cover large-scale data needs.
- Work with Databricks and Spark to explore and process data.
Design and maintain data platforms
- Work with Databricks to enable efficient exploration, transformation and advanced analytics.
- Use CI/CD to deploy and maintain data processes.
Drive innovation with LLMs and advanced analytics
- Research emerging tools and technologies to continuously improve the data stack.
Ensure reliability and performance
- Monitor systems, resolve bottlenecks and optimise queries and jobs.
- Apply CI/CD, security and data governance best practices.
What are we looking for?
- 3+ years of experience in data engineering or a related field.
- Strong AWS knowledge (EC2, S3, Redshift, Glue, Lambda) and a good understanding of cloud architecture.
- Hands-on experience with Databricks for data processing, analytics or machine learning pipelines.
- Advanced SQL and Python, with proven experience building and maintaining complex data pipelines.
- Knowledge of CI/CD to deploy and manage services.
Your profile
- Problem solving: you can diagnose issues that affect several systems and propose efficient, scalable solutions.
- Teamwork and communication: you enjoy working in a team, share knowledge and communicate well with both technical and business profiles.
- Continuous learning: you keep up to date with new technologies and trends.
What do we offer?
- Flexible working hours.
- Hybrid work model, supporting a healthy work-life balance.
- Competitive salary and flexible compensation plan.
- Private health insurance.
- Annual budget for training and professional development.
- Language courses.
- Participation in tech communities and industry events.
- Ongoing follow-up and professional support.
- Development and growth plan tailored to your goals.
About us
At InnoIT, we believe talent grows in an environment where learning, innovating and enjoying the journey go hand in hand. Join our team, take part in innovative projects and keep growing alongside people who are passionate about technology.
More info: https://www.inno-it.es/
InnoIT Consulting Barcelona Meetup: https://www.meetup.com/es-ES/Meetup-de-InnoIT-Consulting-en-Barcelona/
InnoIT Consulting Madrid Meetup: https://www.meetup.com/es-ES/meetup-de-innoit-consulting-en-madrid/
Diversity, Equity and Inclusion
At InnoIT we actively promote diversity, equity and inclusion. We welcome people from all kinds of backgrounds, experiences and career paths, and we particularly encourage applications from groups traditionally underrepresented in the tech sector. We evaluate all applications objectively and fairly, ensuring equal opportunities throughout the selection process. We are also committed to making the reasonable adjustments needed to ensure an accessible and inclusive experience.
We do not discriminate on the basis of gender, age, origin, nationality, sexual orientation, gender identity or expression, religion, disability or any other condition protected by applicable law. We work to build a diverse, respectful and inclusive work environment where everyone has the same opportunities for growth, development and professional recognition.
If you enjoy building reliable data pipelines with Spark, Databricks and AWS, and want to explore what LLMs can bring to a modern data stack, we'd love to meet you!
Skills
Sign in to read and join the discussion.