Lead Data Engineer
Posted 10
views
Summary
Lead a team to design and build scalable data pipelines and warehouses using Python, Scala, SQL, Azure, Databricks, and Spark for analytics and reporting.
Job Description for Lead Data Engineer in Sydney.
10+ years of experience - Software engineering, Cloud computing, Databricks and Big Data
Data Engineering, Data Warehousing, Solution Design, Data Analysis, Visualization and Data Modeling
Programming: Python, Scala, SQL
Cloud: Azure and Databricks
Big Data: Cloudera (HDFS, Spark, Hive, Kafka), Apache Airflow
DevOps: Azure DevOps (Git, Repos, Pipelines), Git, Terraform, Docker
Reporting: SQL Server Reporting Services, Power BI
Certified DevOps Engineer Expert, Azure Cloud, Azure Data Lake