Azure Data Engineer
Posted Updated
Summary
Data engineer at HDFC Bank building and operating Azure-based ELT pipelines using Azure Data Factory, Databricks, Trino, and PySpark, with CDC tools (Kafka, Qlik, Golden Gate) and CI/CD via Azure DevOps. Also handles deployments, databases, and cloud infrastructure for banking data workloads.
Job Role - Azure Data Engineer
Location - Mumbai
Experience - 5 to 15 Years
Job Responsibilities:
- Fundamentals of DevOps, DevSecOps, CD / CI Pipeline using ADO
- Good understanding of MPP Architecture, MySQL, RDS, MS
- SQL DB, Oracle ,Postgres DB
- Would need to interact with Software Integrators on a day-to day basis.
- Deployment and testing skills
- Strong communication skills
- ELT - Trino, Azure Data factory, Azure Databricks, PySpark, Python, Iceberg, Parquet
- CDC Tool like Qlik/ Golden Gate/Dbsium/IBM CDC, Kafka/ Solace • Scripting Shell, Python, Java,
- Good Understanding of Azure Cloud Engineering – ADLS, Iceberg, Databricks, AKS, RHEL
- Good understanding of MS Project
- Development skill using Trino, PySpark and Databricks
- Understanding of security basics, Encryption/Decryption,
- Understanding of IT hardware basics: Unix/Windows servers, RAM/CPU utilization, storage on cloud
- Basic project management skills for preparation of a high-level project plan.
- Understanding of DNS and Load Balancing, and their use.
- Understanding of DR/BCP/Recovery/Backup conceptually for DB and Apply Servers