Senior Data Engineer
Posted
Summary
A senior production-support role focused on keeping enterprise data platforms running: the engineer administers and troubleshoots Informatica (PowerCenter, BDM/DEI, IDQ, EDC/Axon) and Cloudera Hadoop (HDFS, Hive, Spark/PySpark) environments, builds and optimizes ETL pipelines, handles incidents and deployments, and automates tasks with Linux, shell scripting, SQL, and Python.
- Support and maintain enterprise data engineering, ETL, data quality, metadata, and governance platforms.
- Develop, monitor, troubleshoot, and optimize Informatica workflows, mappings, applications, and data pipelines.
- Administer Informatica domains, nodes, repositories, Integration Services, and related application services.
- Support Informatica PowerCenter, BDM or DEI, IDQ, and EDC or Axon components in production and non-production environments.
- Investigate failed jobs, data-quality exceptions, performance issues, and platform incidents; complete root-cause analysis and implement appropriate corrective action.
- Support Cloudera Hadoop services and data processing across HDFS, Hive, Spark, and PySpark workloads.
- Perform deployments and migrations across development, quality assurance, user acceptance testing, and production environments.
- Use Linux, shell scripting, and SQL to automate routine tasks, validate data, and troubleshoot platform issues.
- Support user access, security, and permissions in line with established controls and operating procedures.
- Coordinate incident resolution and planned changes with application, database, infrastructure, business intelligence, and business stakeholders.
- Maintain accurate operational documentation, handover notes, change records, and support procedures.
Skill Requirement
Informatica
- PowerCenter and BDM or DEI; administration of domains, nodes, repositories, Integration Services, and application services; ETL development, monitoring, troubleshooting, and performance tuning; IDQ; EDC or Axon.
- Cloudera or Hadoop; HDFS; Hive; Spark or PySpark.
Core Platform Skills
- Linux or Unix; shell scripting; advanced SQL; Oracle or Microsoft SQL Server; data warehouse or data lake environments; enterprise production support.
- Informatica MDM or IICS
- Kafka, Impala, NiFi, Kerberos, or Ranger
- Python
Experience
- 10+ years of relevant experience in data engineering, Informatica development, Informatica administration, or closely related roles.
- Strong hands-on experience supporting enterprise production environments and resolving data-platform incidents independently.
- Demonstrated experience across both Informatica and Cloudera or Hadoop environments.
- Experience working with high-volume data pipelines, data warehouses, or data lakes.
- Exposure to UAE or GCC enterprise or government environments is advantageous.