Databricks Data Engineer

Job Description :

We are looking for a Databricks Data Engineer to join our team in Bengaluru, Hosur, or Ahmedabad. You will help build scalable, reliable, and secure data analytic solutions with strong expertise in Databricks.

Key Responsibilities :

- Design and implement data pipelines and scalable data architectures using the Databricks Lakehouse Platform.

- Collaborate with data engineers, architects, and business teams to translate business requirements into technical solutions.

- Develop and optimize ETL/ELT workflows using Databricks, PySpark, and SQL.

- Build data lakes and lakehouse architectures on cloud platforms such as AWS, Azure, or GCP.

- Ensure best practices in data governance, security, and performance optimization.

- Support migration of legacy data platforms to Databricks-based modern data platforms, Unity Catalog, Asset Bundles, and Liquid Clustering.

- Provide technical guidance and mentoring to junior engineers.

- Participate in solution design discussions, architecture reviews, and client presentations.

- Troubleshoot performance issues and optimize data processing workloads.

Tech Stack & Requirements :

- Strong expertise in Databricks.

- Good understanding of DBT.

- Experience with AI integration in projects, specifically building automations and frameworks integrated with AI to reduce manual intervention.