Senior Data Engineer
Description
About the role
We are looking to bring on board Senior Data Engineers specializing in Databricks to join our Data & AI team in Madrid and Valencia.
The selected person will participate in international data transformation projects, designing and developing modern platforms in cloud environments using Lakehouse architectures and advanced technologies from the Databricks ecosystem. You will work alongside architects, data scientists, analysts, and business teams, actively participating in the entire lifecycle of data solutions.
What you'll do
- Design, develop, and evolve scalable, robust, and efficient data pipelines.
- Implement ETL/ELT processes using Databricks, PySpark, and SQL.
- Build solutions based on Delta Lake and Lakehouse architectures.
- Develop both batch and streaming data processing processes.
- Guarantee the quality, performance, and cost optimization of data platforms.
- Apply best practices for development, testing, monitoring, and CI/CD.
- Collaborate with multidisciplinary teams in international environments.
- Participate in incident resolution, continuous improvement, and the evolution of platforms.
What we're looking for
To perform well in this position, knowledge and experience in the following are required:
- More than 6 years of experience in Data Engineering projects.
- Solid and recent experience working with Databricks.
- Possession of an official Databricks certification or equivalent certifications from the Databricks ecosystem.
- Advanced knowledge of Apache Spark, PySpark, and SQL.
- Experience in the design and development of ETL/ELT processes.
- Experience working with Delta Lake and Lakehouse architectures.
- Experience in Cloud environments (Azure, AWS, or GCP).
- Knowledge of Git and CI/CD practices.
- Ability to work in complex production environments and resolve incidents autonomously.
- Professional English level to collaborate on international projects.
Nice to have
- Unity Catalog.
- Auto Loader.
- Lakeflow Jobs.
- Databricks Asset Bundles.
- Streaming data processing and event-driven architectures.
- Terraform or other Infrastructure as Code (IaC) tools.
- Experience in migrations to Databricks.
- Knowledge of observability, data governance, security, and FinOps.
What you'll get
We value all applications and offer on-site, online, and certified training. Even if you do not meet 100% of the requirements, we want to meet you!
We have a very comprehensive catalog of Work-Life Balance and Development measures, such as, for example:
- Flexible compensation plan (childcare tickets, health insurance, restaurant card, or meal allowance, transportation, training...)
- 24 days of vacation + 2 personal days + 24 and 31 December + option to buy up to 7 vacation days per year.
- FlexAbroad: possibility to work remotely from another country for 45 days.
- Continuous training. Access to complete training itineraries with certification opportunities. You will have free access to platforms such as: Coursera, Udemy, Pluralsight, Harvard Manager Mentor, Education First for languages...
- Wellbeing HUB - Includes policies and actions for physical and mental health.
- Participation in volunteering and social action initiatives with our Sustainability, Inclusion, and Equality groups
- Varied and challenging projects: You will work on cross-sector challenges, avoiding routine and gaining exposure to diverse technologies.
- Continuous learning: Training in cloud technologies, data governance, visualization... Real participation in projects involving generative AI, Business AI, and emerging data technologies.
How you'll work
- Hybrid and flexible remote work model.
About the company & team
Choosing Capgemini means choosing a company where you will have the freedom to design your career as you wish, with the support and inspiration of a collaborative community of colleagues around the world. Here you can reinvent what is possible. Join us and help the world's leading organizations discover the value of technology and build a more sustainable and inclusive world.
We have a Data & AI team that will be delighted to have you on board. Would you like to join us?
Capgemini is a global partner in business and technological transformation, helping organizations accelerate their dual transition to a digital and sustainable world, generating a tangible impact on both companies and society. We are a responsible and diverse group, with 340,000 professionals in more than 50 countries. With over 55 years of experience, our clients trust Capgemini to leverage the value of technology and cover all their business needs. We offer comprehensive solutions that range from strategy and design to engineering, driven by our leading capabilities in artificial intelligence, generative AI, cloud, and data, along with deep industry knowledge and a strong network of partners.
MAKE IT REAL. Join the team!
Additional information
Our Equality Plan and Code of Ethics guarantee inclusive and non-discriminatory processes, promoting talent in a multicultural and accessible environment for people with disabilities (we positively value having a disability certificate).
Skills
Sign in to read and join the discussion.