Data Engineer
Summary
A data engineering consultant/technology analyst role for someone with 6-8 years of experience (Databricks Certified Data Engineer Associate) who spends their days analyzing data and legacy SQL/Unix jobs, writing PL/SQL and shell scripts, and deploying data warehouse solutions for a banking-domain client using Spark, Kafka, AWS, Git, Jenkins and IaC tools like Terraform and Docker.
Detailed Job Description:<\/span><\/b>
<\/p>
Role
: Consultant <\/span>/ Technology Analyst<\/span>
Data bricks Certified Data
Engineer Associate with 6 -8 Yrs of experience<\/span><\/span><\/p>
Must
have expert SQL Development experience <\/span> - minimum 5 Yrs of experience<\/span>
<\/p>
Must
be able to perform Analysis:<\/span>
<\/p>
· <\/span><\/span><\/span>Data Analysis<\/span>
<\/p>
· <\/span><\/span><\/span>SQL Script Analysis to understand the business logic<\/span>
<\/p>
· <\/span><\/span><\/span>Unix jobs analysis<\/span>
<\/p>
Must
have good hands -on experience on writing PL/SQL<\/span>
<\/p>
Must
have good hands -on experience on UNIX Shell scripting<\/span>
<\/p>
Exposure
to Control -M Scheduling.<\/span>
<\/p>
Exposure
to Testing and should be able to efficiently perform Testing.<\/span>
<\/p>
Should
have experience on Git and Jenkins.<\/span>
<\/p>
Banking
Domain experience (3 -5 years)<\/span>
<\/p>
Experience
deploying/managing Data and Data Warehouse solutions<\/span>
<\/p>
Experience
in understanding and developing data systems in<\/span>
<\/p>
· <\/span><\/span><\/span>Data Engineering technologies (e.g. Spark, Hadoop,
Kafka)<\/span>
<\/p>
· <\/span><\/span><\/span>Data Warehousing (e.g. SQL, OLTP/OLAP/DSS)<\/span>
<\/p>
· <\/span><\/span><\/span>Comfortable writing code in either Python, Scala or
Java<\/span>
<\/p>
· <\/span><\/span><\/span>Good AWS fundamentals knowledge<\/span>
<\/p>
· <\/span><\/span><\/span>Understanding of Solution Development life cycles<\/span>
<\/p>
· <\/span><\/span><\/span>Knowledge on cloud technologies, ideally AWS. Have
worked in a data operations position for a large Enterprise.<\/span>
<\/p>
· <\/span><\/span><\/span>Working knowledge in Infrastructure as code frameworks,
Ansible/Terraform/ Cloud formation/Docker/ECS/Kubernetes/Packer<\/span>
<\/p><\/td><\/tr>
Minimum Years of Experience
: <\/span><\/b>6 -8 Years<\/span>
<\/p><\/td><\/tr><\/tbody><\/table>
<\/div><\/span>