Sr. Fabric Data Engineer
Summary
Builds and optimizes scalable data pipelines using Microsoft Fabric, Azure Data Factory, and PySpark to power real-time analytics and reporting for a semiconductor firm.
Job Details
Senior Fabric Data Engineer within the Data & Analytics team focusing on designing modern data platforms using Microsoft Fabric, Azure Data Factory, and PySpark. This role involves collaboration with Business Analysts, engineering teams, and Data Scientists to deliver robust, real-time, and secure data operations.
Job Type: Regular • Shift: Shift 1 (Malaysia) • Primary Location: Penang 15, Penang, Malaysia.
Responsibilities
- Expert in data engineering, ETL/ELT, and modern data platforms such as Microsoft Fabric, Synapse, Databricks, and others.
- Design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Microsoft Fabric.
- Develop ETL/ELT workflows using PySpark, SQL, and data orchestration frameworks.
- Architect and implement data Lakehouse and data warehouse solutions on Microsoft Fabric.
- Apply strong understanding of data warehousing, data modeling, data engineering principles, cloud computing, and the Microsoft Fabric platform.
- Write complex SQL queries and stored procedures.
- Collaborate with data scientists and analysts to ensure efficient data delivery and model readiness.
- Leverage CI/CD practices and infrastructure‑as‑code (IaC) to deploy and maintain data pipelines in production.
- Monitor and troubleshoot data pipelines, ensuring performance, reliability, and data quality.
- Enforce data governance, security, and compliance best practices across platforms.
- Mentor junior engineers and contribute to architectural decisions, coding standards, and engineering best practices.
Qualifications
- Bachelor’s or master’s degree in computer science, information systems, engineering, or a related field.
- 7+ years of experience in data engineering with strong knowledge of cloud data platforms.
- Proficiency in PySpark, Azure Data Factory, Databricks, and SQL.
- Experience working with Microsoft Fabric or similar unified analytics platforms.
- Solid understanding of data lakehouse and data warehouse architectures.
- Solid understanding of data modeling concepts.
- Experience with Delta Lake, Synapse Analytics, and other Azure analytics services.
- Familiarity with CI/CD pipelines, version control systems (e.g., Git), and deployment automation tools (e.g., Azure DevOps, GitHub Actions).
- Strong problem‑solving skills and ability to work across technical and business teams.
Posting Statement: All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.