DATABRICKS Data Architect
Summary
Data architect at consulting firm Devoteam who designs, implements, and optimizes Databricks Lakehouse platforms for clients — building Delta Lake architectures, Spark ETL/ELT pipelines, Unity Catalog governance, and ML/GenAI environments. 100% remote role based in Madrid, advising clients on Databricks best practices.
You will be responsible for designing, implementing, and optimizing Databricks-based data architectures, ensuring scalable, secure, and efficient solutions.
Your main responsibilities will include:
Design and implement Lakehouse and Delta Lake architectures across cloud and multi-cloud environments.
Develop and optimize ETL/ELT pipelines using Apache Spark, Structured Streaming, and Lakeflow Declarative Pipelines.
Implement data governance, security, and lineage frameworks using Unity Catalog.
Define AI governance mechanisms using Unity Gateway.
Design environments supporting Machine Learning, Generative AI, and advanced analytics using MLflow and Databricks Genie.
Optimize Databricks platform performance and costs, applying FinOps best practices.
Participate in data platform modernization and migration projects towards Lakehouse architectures.
Advise clients on Databricks best practices and collaborate with technical and business teams.
WHAT ARE WE LOOKING FOR?
Strong experience in data architecture and designing Databricks-based solutions.
Deep knowledge of Apache Spark, Delta Lake, Unity Catalog, and Photon.
Experience with cloud platforms such as Azure, AWS, or GCP.
Knowledge of cloud infrastructure, networking, storage, and IAM security.
Experience designing ETL/ELT pipelines and data processing solutions.
Knowledge of data governance, performance optimization, and Lakehouse architectures.
Strong communication skills, autonomy, and a customer-oriented mindset.
Fluent English and Spanish, both written and spoken.
Degree in Computer Science, Information Systems, or equivalent professional experience.
Nice to have:
Experience with Lakeflow, MLflow, Genie, or Unity Gateway.
Knowledge of Generative AI and Machine Learning.
Experience migrating legacy data platforms to Databricks.
Knowledge of FinOps and cloud cost optimization.
Databricks Data Engineer Professional certification or Platform Architect accreditations.
WHAT CAN YOU EXPECT FROM DEVOTEAM?
At Devoteam, we believe technology creates greater impact when combined with talented people. We offer:
Competitive salary based on your experience.
Annual performance bonus, linked to individual, team, and company objectives.
Flexible compensation package, including transport, childcare, training, health insurance, and meal benefits.
Employee benefits, including discounts, physiotherapy, and free English classes.
Career development opportunities, with access to training, certifications, and annual performance reviews.
100% remote working model.
If you enjoy designing modern data architectures and leveraging Databricks to help organizations unlock the full potential of their data, we'd love to hear from you!