Cloud Data Engineer
Summary
Design and maintain scalable Azure-based data pipelines and platforms for analytics, using Data Factory, Synapse, Databricks, and Fabric.
Location: Makati City, Philippines (Hybrid - 2-3 days onsite per week)
Job Summary
We are seeking a Senior Data Engineer to design, build, and maintain scalable, resilient, and cost-effective data platforms and pipelines that support enterprise analytics and business intelligence initiatives. You will leverage Microsoft Azure technologies and software engineering best practices to develop automated data transformation solutions while collaborating with architects, analysts, data scientists, and business stakeholders.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Microsoft Azure services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Microsoft Fabric.
Build and manage data solutions utilizing Azure Data Lake Storage Gen2 and Azure Blob Storage.
Collaborate with Data Architects, Data Scientists, Analysts, and business stakeholders to translate business requirements into technical solutions.
Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
Implement data quality validation, monitoring, and governance best practices.
Monitor, troubleshoot, and resolve production data pipeline issues.
Develop technical documentation, architecture diagrams, and operational procedures.
Implement and maintain CI/CD pipelines for automated deployment and testing of data solutions.
Evaluate emerging technologies and recommend improvements to the organization's data platform.
Required Experience
Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent professional experience).
7+ years of experience as a Data Engineer or in a similar data platform engineering role.
Experience designing and supporting enterprise-scale ETL/ELT solutions.
Experience working in Agile software development environments.
Nice-to-Have Experience
Experience leading technical initiatives or mentoring engineers.
Experience working directly with business stakeholders or consulting teams.
Experience developing cloud-native Spark applications.
Experience supporting enterprise data governance initiatives.
Required Skills
Microsoft Azure Data Engineering (Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Microsoft Fabric)
SQL and relational database development (SQL Server, PostgreSQL)
Data pipeline engineering using software engineering best practices (CI/CD, version control, automated testing)