Databricks Developer

Your future duties and responsibilities
• Design and develop scalable ETL/ELT solutions.
• Build and support Databricks-based data engineering pipelines.
• Develop complex Teradata queries and data models.
• Optimize data ingestion, transformation, and analytics workloads.
• Support cloud migration and modernization initiatives.
• Implement data quality and governance standards.
• Collaborate with business stakeholders and solution architects.
• Monitor and improve platform performance.
• Support CI/CD and DataOps practices.
• Utilize AI-assisted development and automation approach.

Required qualifications to be successful in this role
Must Have Skills
• Strong experience with Azure Databricks / Databricks Platform, with hands-on expertise in Apache Spark, PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
• Strong knowledge of Teradata SQL, Teradata Utilities, data modeling, performance tuning, and stored procedures.
• Experience in data engineering, including designing and developing ETL/ELT processes, data warehousing solutions, data pipelines, and data integration workflows.
• Strong programming skills in Python and SQL, with the ability to develop efficient and scalable data processing solutions.
• Good understanding of cloud technologies, with hands-on experience in Microsoft Azure preferred. Exposure to AWS is an added advantage.
• Experience with Git, CI/CD practices, and DataOps for source control, deployment automation, and data engineering lifecycle management.