Lead data engineer
Summary
Lead data engineer role in New South Wales for candidates available to join immediately, focused on building and modeling data on Azure Databricks using PySpark Notebooks, Spark SQL, Unity Catalog, and Spark Structured Streaming. Power BI development experience is a plus.
Job Description:<\/span>
<\/p>
<\/p>
Immediate joiners<\/span><\/b>
<\/p>
<\/p>
- Must
have strong working experience with Azure Databricks , PySpark
Notebooks , Spark SQL and Unity Catalog.<\/b><\/span>
<\/li> - Must
have strong working experience with Spark Structured Streaming<\/b>.<\/span>
<\/li> - Need
to have good Data Modelling<\/b> experience with strong SQL
knowledge<\/b><\/span>
<\/li> - Optional:
Experience in Power BI development<\/span>
<\/li><\/ol>
<\/div><\/span>