Technology Analyst (Databricks Certified Data Engineer)
Summary
Data engineering role for a Databricks Certified Data Engineer (8-10 yrs) who analyzes data, SQL scripts and Unix jobs, writes PL/SQL and shell scripts, and deploys/manages data warehouse solutions in the banking domain. Core stack: Databricks, Spark, Kafka, AWS, Python/Scala/Java, Git, Jenkins and Control-M.
Job Description
Key accountabilities of the role
Databricks Certified Data Engineer Associate with 8-10 Yrs of experience
Must have expert SQL Development experience - minimum 5 Yrs of experience
Must be able to perform Analysis:
- Data Analysis
- SQL Script Analysis to understand the business logic
- Unix jobs analysis
Must have good hands-on experience on writing PL/SQL
Must have good hands-on experience on UNIX Shell scripting
Exposure to Control-M Scheduling.
Exposure to Testing and should be able to efficientlyperform Testing.
Should have experience on Git and Jenkins.
Banking Domain experience (3-5 years)
Experience deploying/managing Data and Data Warehouse solutions.
Experience in understanding and developing data systems in
- Data Engineering technologies (e.g. Spark, Hadoop, Kafka)
- Data Warehousing (e.g. SQL, OLTP/OLAP/DSS)
- Comfortable writing code in either Python, Scala, or Java
- Good AWS fundamentals knowledge
Understanding of Solution Development life cycles
Key Challenges of the role :
- Knowledge on cloud technologies, ideally AWS. Have worked in a data operations position for a large Enterprise.
- Working knowledge in Infrastructure as code frameworks, Ansible/Terraform/ Cloud formation/Docker/ECS/Kubernetes/Packer
Responsibilities
- Collaborative & Persuasive, Self-motivated, Research Oriented, Hands-on, Committed, Always-on learner.
- High performing and diverse team with an unrivalled culture of innovation
- Opportunity to drive change across the project