Data Engineer (Databricks + Pyspark)
Description
Requirements: Databricks with pyspark,Unity catalog,GHCP,Data modelling, Databricks Apps,Lakehouse Postgres, Data Architecture knowledge, have worked on Databricks open solution accelerators
Job Summary
Seeking an experienced Overseas Contractor specializing in Azure Data Architecture with expertise in Databricks Azure SQL and Dimensional Data Modeling and Databricks App to design the solution
Job Description
Design and implement robust data architectures using Azure services focusing on scalability and performance Utilize Databricks for big data processing and analytics workloads Develop and maintain Azure SQL databases ensuring data integrity and optimized querying Apply dimensional data modeling techniques to support business intelligence and reporting needs Collaborate with crossfunctional teams to understand data requirements and translate them into technical solutions Ensure best practices in data security governance and compliance are followed Continuously evaluate emerging Azure data technologies to improve existing data platforms
Should be able to perform data engineering activities in Databricks as well as have good exposure in databricks App
Skills
Sign in to read and join the discussion.