Data Engineer
Summary
Designs and maintains ETL workflows with Informatica PowerCenter and builds data pipelines using Python, Spark, Hive, and HDFS for large-scale financial data platforms.
Experience
10+ Years
Role
Data Engineer
Required Skills
Must Have
- Informatica PowerCenter
- SQL (Oracle/Teradata/SQL Server)
- Python
- Apache Spark
- Hive & HDFS
- ETL/Data Warehousing concepts
- Unix Shell Scripting
- Production Support
- Agile/Scrum
Good to Have
- Apache Sqoop
- Apache NiFi
- Control-M or AutoSys
- Git/Bitbucket
- Jenkins
- Banking or Financial Services domain experience.
Preferred Qualifications
- 8–12 years of experience in ETL and Data Engineering.
- Strong analytical, problem-solving, and communication skills.
- Experience working with large-scale enterprise data platforms.
Key Responsibilities
- Design, develop, and maintain ETL workflows using Informatica PowerCenter.
- Develop data pipelines using Python, Spark, Hive, and HDFS.
- Perform data extraction, transformation, and loading (ETL/ELT) from multiple source systems.
- Write and optimize SQL queries for Oracle, Teradata, or SQL Server databases.
- Prepare technical design documents, mapping specifications, and data flow documentation.
- Perform performance tuning, troubleshooting, and production support.
- Coordinate with Business Analysts, QA, and business stakeholders throughout the project lifecycle.
- Participate in Agile/Scrum ceremonies and contribute to sprint planning and delivery.
- Support production deployments and incident resolution.