Data Engineer
Summary
Data Engineer on Central Pattana's Data & AI team, developing and maintaining ETL/ELT integration pipelines across SAP ECC/S4HANA, Data Integration Hub, and Azure Databricks, with production support, monitoring, and SAP migration work. Core stack: Azure (ADLS, ADF), Databricks/Delta Lake, SQL, Python.
About the Role
We are seeking an experienced Data Engineer to join our Data & AI team, specializing in enterprise data integration and cloud data engineering.
The successful candidate will be responsible for developing, maintaining, and optimizing data integration pipelines across enterprise systems, including SAP ECC / S/4HANA, Data Integration Hub (DIH), and Microsoft Azure Databricks.
This role requires strong hands-on technical expertise in data engineering, cloud data platforms, and production support to ensure reliable, secure, and scalable data integration.
Key Responsibilities
1. Data Integration & Engineering
- Design, develop, and maintain ETL/ELT pipelines using Microsoft Azure and Databricks.
- Develop and support data integration pipelines connecting SAP ECC / S/4HANA, enterprise applications, Data Integration Hub (DIH), and Azure Databricks.
- Configure, maintain, and support enterprise data integration tools and connectors.
- Support batch processing, incremental data loading, and Change Data Capture (CDC) where applicable.
- Ensure data accuracy, completeness, and consistency across source and target systems.
2. Azure Databricks & Data Platform
- Develop, maintain, and optimize data pipelines and workflows on Azure Databricks.
- Work with Azure cloud services, including Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and related data integration components.
- Optimize data processing performance, reliability, and resource utilization.
- Support data transformation, Delta Lake tables, and data processing workflows.
- Collaborate with Data Platform teams to implement data security, access controls, and platform best practices.
3. Production Support & Monitoring
- Monitor production data pipelines and resolve integration failures, data discrepancies, and performance issues.
- Perform root cause analysis and implement preventive measures.
- Implement monitoring, alerting, logging, and automated recovery mechanisms.
- Support data reconciliation and validation between SAP, DIH, and Azure Databricks.
- Maintain technical documentation, operational runbooks, and incident resolution procedures.
4. Technical Collaboration & Delivery
- Act as the technical point of contact for assigned data integration solutions.
- Collaborate with Digital Technology, SAP, Data Platform, and business application teams.
- Coordinate with external vendors on integration implementation, troubleshooting, and technical enhancements.
- Support SAP S/4HANA migration, system integration testing, and production deployment activities.
- Identify opportunities to improve data integration reliability, performance, and operational efficiency.
Qualifications
Required:
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- 5+ years of hands-on experience in Data Engineering, Data Integration, or related roles.
- Hands-on experience with Microsoft Azure and Azure Databricks.
- Strong SQL and Python programming skills.
- Experience designing, developing, and maintaining ETL/ELT data pipelines.
- Knowledge of Azure Data Lake Storage (ADLS), Delta Lake, and cloud data processing concepts.
- Experience with enterprise data integration tools and connectors.
- Experience in production support, troubleshooting, monitoring, and performance optimization.
- Understanding of data quality, data reconciliation, and data pipeline reliability.
- Strong problem-solving skills and ability to work independently.
Preferred:
- Experience integrating SAP ECC or SAP S/4HANA with cloud data platforms.
- Experience with Data Integration Tool, Azure Data Factory, or similar integration tools.
- Knowledge of Apache Spark / PySpark and Databricks Workflows.
- Familiarity with Change Data Capture (CDC) and incremental data processing.
- Experience with Databricks Unity Catalog, access controls, and data governance.
- Experience supporting enterprise Data Integration Hubs (DIH).
- Familiarity with CI/CD, Git, and automated deployment processes.
- Experience working with external technology vendors and supporting enterprise migration projects.
Skills
Sign in to read and join the discussion.