Data Engineer
Posted Updated
Description
MAS Global Consulting, LLC is seeking a hands-on Data Engineer to build a governance data platform on Microsoft Fabric, covering ingestion, master hub, and back-synchronization to source systems. You will collaborate with a Data Architect, Power BI Developer, and client data stewards.
You will implement a medallion architecture, develop a PySpark-based matching engine, and ensure data quality across Workday, payroll, ERP, and security systems.
Build metadata-driven ingestion from source systems into bronze. Standardize names, nicknames, suffixes, dates and codes in silver with data quality checks. Implement the matching engine in PySpark: shared-ID, exact rules, probabilistic scoring. Build the master hub in Fabric SQL: golden records and survivorship. Build the stewardship workflow: review queue and audit trail. Build the sync back of create, update and deactivate events through Fabric pipelines or MuleSoft. Publish gold tables and data quality findings ready for Power BI Direct Lake. Schedule and monitor daily runs with secure handling of sensitive data. Work with Git and deployment pipelines, and write tests for matching rules. 5+ years in data engineering, including 2+ on the Microsoft data stack. Hands-on Microsoft Fabric experience, or deep Synapse or Databricks on Azure plus active Fabric adoption. Built a medallion architecture in production. Strong PySpark, Spark SQL and T-SQL. Entity resolution or MDM: fuzzy matching, survivorship, golden records. API integration (REST, OAuth, files, SFTP) and write-back to operational systems. Git and CI/CD for data workloads.Skills
Sign in to read and join the discussion.