freehire launches on Product Hunt on 26 August.

Follow →

Data Engineer

Summary

Builds and maintains Azure-based data pipelines, profiles undocumented datasets, and documents data quality issues for stakeholders using SQL, PySpark, and Power BI.

We are seeking an experienced Data Engineer to join a dynamic team operating within a complex data integration environment. The ideal candidate will possess strong technical expertise combined with the ability to work with partially documented and quality-challenged data sources. This role involves diagnosing data issues, producing detailed documentation, and effectively communicating technical findings to stakeholders at all levels.

Key Responsibilities:

  • Work with undocumented and partially defective data extracts, diagnosing issues systematically.
  • Develop and maintain data pipelines using core Azure services and modern architecture patterns.
  • Produce formal documentation and communicate technical issues clearly to non-technical stakeholders.
  • Profile large datasets, identify data quality issues, and develop solutions.
  • Collaborate with teams using version control tools such as Azure DevOps or GIT.

Required Skills and Experience:

  • Expert-level SQL development, including complex transformations and data analysis.
  • Proficiency in Python and PySpark with hands‑on pipeline development experience.
  • Practical experience implementing Medallion architecture across multiple data layers.
  • Advanced knowledge of Power BI, including semantic modeling, DAX, and visual development.
  • Deep understanding of dimensional modeling techniques and their implementation.
  • Hands‑on data profiling and diagnosis of large, undocumented datasets.
  • Experience with version control systems, particularly Azure DevOps or GIT.
  • Metadata-driven or framework-based ELT experience, particularly with Azure Synapse or Azure Data Factory.
  • Familiarity with Microsoft Dynamics CRM and Dataverse, including data quality issues and GUID generation patterns.

If you are a proactive Data Engineer with a passion for tackling complex data challenges and eager to contribute to impactful projects, we encourage you to apply.

See also