Data Engineer
Summary
A senior data engineering consultant role (Technology Analyst) in Victoria, Australia, working on banking-domain data and data warehouse solutions. Day-to-day involves SQL/PL-SQL analysis and development, Unix shell scripting and job analysis, Databricks pipelines, Control-M scheduling, and deployments via Git/Jenkins using Spark, Kafka, Python/Scala/Java and AWS.
Role : Consultant / Technology Analyst
Data bricks Certified Data Engineer Associate with 6-8 Yrs of experience
Must have expert SQL Development experience - minimum 5 Yrs of experience
Must be able to perform Analysis:
- SQL Script Analysis to understand the business logic
- Unix jobs analysis
Must have good hands-on experience on writing PL/SQL
Must have good hands-on experience on UNIX Shell scripting
Exposure to Control-M Scheduling.
Exposure to Testing and should be able to efficiently perform Testing.
Should have experience on Git and Jenkins.
Banking Domain experience (3-5 years)
Experience deploying/managing Data and Data Warehouse solutions
Experience in understanding and developing data systems in
- Data Engineering technologies (e.g. Spark, Hadoop, Kafka)
- Data Warehousing (e.g. SQL, OLTP/OLAP/DSS)
- Comfortable writing code in either Python, Scala or Java
- Good AWS fundamentals knowledge
- Understanding of Solution Development life cycles
- Knowledge on cloud technologies, ideally AWS. Have worked in a data operations position for a large Enterprise.
- Working knowledge in Infrastructure as code frameworks, Ansible/Terraform/ Cloud formation/Docker/ECS/Kubernetes/Packer