Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

KEEP SIMPLE

New

Senior Data Engineer (Databricks & AI Platforms)

Posted Updated

Description

The Senior Data Engineer is responsible for designing, building, and optimizing scalable data platforms and pipelines that support analytics, business intelligence, machine learning (ML), and AI-driven solutions. This role partners with data scientists, AI engineers, architects, and business stakeholders to deliver trusted, high-quality data products using Databricks, cloud technologies, and modern data engineering practices. The position also serves as a technical leader in enabling enterprise AI and Generative AI initiatives through robust, secure, and governed data platforms. Key Responsibilities:Design, develop, and maintain scalable data pipelines and data products using Databricks, Spark, Python, and SQL. Build and optimize batch, streaming, and real-time data integration solutions from enterprise and third-party data sources. Implement Databricks Lakehouse architectures utilizing Delta Lake and Medallion design patterns. Develop and maintain data products that support analytics, predictive modeling, machine learning, and Generative AI applications. Collaborate with Data Scientists and AI Engineers to prepare, transform, and govern data for AI and ML use cases. Design and implement feature engineering pipelines and support ML lifecycle processes. Develop data solutions that support Retrieval Augmented Generation (RAG), vector search, semantic search, and LLM-based applications. Optimize Spark jobs, SQL workloads, and data processing frameworks for performance, scalability, and cost efficiency. Implement data quality, observability, lineage, governance, and monitoring capabilities. Ensure compliance with data privacy, security, and responsible AI standards. Contribute to CI/CD, Infrastructure-as-Code, and DataOps practices across the data platform. Mentor junior engineers and promote engineering best practices across the organization.

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →