System Engineer ETL
Posted Updated
Description
- Strong hands‑on experience with the ETL(Informatica
Power Center) and Teradata based ETL development, similarly Hadoop
ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink
etc.,), and data pipeline orchestration.
- Create EDW ETL/ELT codes using Teradata SQL,
Informatica, apache Spark, QueryGrid, Trino to perform various
transformation and load into Teradata based data warehouse or datamarts
- Performance tuning of highly complex applications to
reduce resource usage
- Create framework using GCFR, shell scripts, BTEQ and
shell scripts to automate end to end. Also to integrate with control
- Build in-house CDC framework using Java to process OLR
logs from SAP(Oracle) and ingestion the data into Teradata. Create
framework around this CDC ingestion to make it configurable
- Install and build Master Data Management(MDM)
application for various user uploads along with data validations and
approval workflow