Data Engineer
Summary
Data Engineer in New South Wales, Australia who designs, builds, and maintains scalable data pipelines and ETL/ELT processes on Snowflake, Azure Data Lake, Python, SQL, and PySpark, deploying via CI/CD and DevOps practices. Requires 8-10 years of data engineering experience.
We are looking for an experienced Data Engineer to join our growing team. If you have a strong background in Snowflake, Python, SQL, and PySpark, along with experience building scalable data pipelines and modern data platforms, we'd love to hear from you!
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
- Develop and optimize data solutions using Snowflake, SQL, Python, and PySpark.
- Work with Azure Data Lake (ADLS) and cloud-based data platforms.
- Build, automate, and deploy data solutions using CI/CD and DevOps practices.
- Optimize data models and improve data quality, performance, and reliability.
- Collaborate with cross-functional teams to deliver business-critical data solutions.
Required Skills
- 8-10 years of experience as a Data Engineer.
- Strong expertise in Snowflake.
- Hands-on experience with Python, SQL, and PySpark.
- Experience working with Azure Data Lake (ADLS).
- Knowledge of Microsoft SQL Server 2019.
- Experience with CI/CD pipelines and DevOps practices.
- Strong understanding of data engineering best practices, performance tuning, and data integration.
Nice to Have
- Experience with Azure cloud services.
- Knowledge of data warehousing and big data technologies.
- Excellent analytical and problem-solving skills.