Data Engineer
Posted Updated
- Design, develop, and maintain scalable data pipelines and Data Products to support analytics, reporting, regulatory, and operational use cases.
- Build and optimize data ingestion, transformation, and integration workflows across batch and near real-time processing environments.
- Develop and maintain automated ETL/ELT processes, workflow orchestration, and scheduling mechanisms to ensure reliable data delivery.
- Design and implement data cleansing, standardization, enrichment, and transformation processes to produce trusted and consumption-ready datasets.
- Collaborate with business, Analytics Insights, and technology teams to translate business requirements into reusable Data Products and data solutions.
- Implement and maintain data quality controls, validation rules, reconciliation processes, and exception handling mechanisms.
- Monitor and troubleshoot data pipelines, perform root cause analysis, and support production incident resolution.
- Maintain technical metadata, source-to-target mappings, data lineage, and technical documentation.
- Ensure data solutions comply with enterprise data governance, security, privacy, and regulatory requirements.
- Support system integration testing (SIT), user acceptance testing (UAT), deployment, and production implementation activities.
- Identify and drive opportunities for automation, optimization, scalability, and continuous improvement across data engineering processes.
- Work closely with Platform Engineering teams to ensure data solutions are operationally stable, performant, and scalable.