Data Engineer
Summary
Data Engineer building and maintaining scalable ETL pipelines and data solutions using Microsoft Azure services such as Data Factory, Synapse, Databricks, and Fabric, with SQL, Python, and Spark.
We are looking for an experienced Data Engineer to design, develop, and maintain scalable, reliable, and automated data pipelines and ETL solutions using Microsoft Azure technologies.
Key Responsibilities:
- Build and maintain data pipelines using Azure Data Factory, Synapse, Databricks, and Azure Fabric.
- Manage data using Azure Data Lake Gen2 and Blob Storage.
- Develop efficient data transformations using SQL, Python, and PySpark/Spark.
- Optimize pipelines for performance, scalability, reliability, and cost efficiency.
- Implement data validation and quality processes.
- Monitor, troubleshoot, and resolve pipeline issues.
- Manage deployments through Azure DevOps, Git, and CI/CD.
- Collaborate with data scientists, analysts, architects, and business stakeholders.
- Maintain technical documentation and follow data engineering best practices.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or related field.
- 3+ years of Data Engineering/ETL experience.
- Strong hands-on experience with Microsoft Azure data services.
- Strong SQL skills and experience with modern relational databases.
- Experience with Spark/PySpark and big data technologies.
- Strong understanding of software engineering, version control, testing, and CI/CD.
Preferred: Python, Azure Fabric, Delta/Parquet/Avro, API data integration, Azure DevOps, Git, and Ansible experience.
Why Join Strategic Staffing Solutions (S3)?
Competitive Salary Package
Hybrid Work Setup: Ayala Makati (2 Days Onsite / 3 Days Remote)
HMO Coverage: Up to 500K
Leave Credits: Prorated, applicable on first day