freehire launches on Product Hunt on 26 August.

Follow →

Data Engineer (Enterprise Data Warehouse)

Summary

Build and maintain scalable data pipelines and warehouse solutions using C#, .NET, Python, and Azure tools to power analytics and business intelligence.

Data Engineer

Job Overview

We are seeking a highly skilled and detail-oriented Data Engineer to design, develop, and maintain scalable data solutions that support business intelligence, analytics, and operational requirements. The ideal candidate will have strong experience in data warehousing, ETL/ELT processes, cloud-based data platforms, and software development, with a passion for building reliable and efficient data pipelines.

Key Responsibilities

  • Develop, enhance, and maintain data applications, pipelines, and warehouse solutions based on business and technical requirements.

  • Write clean, efficient, maintainable, and well-documented code following established coding standards and best practices.

  • Design and implement ETL/ELT processes for data ingestion, transformation, and integration from various internal and external data sources.

  • Build and optimize database structures, queries, stored procedures, and data models to ensure performance and scalability.

  • Manage source code repositories, version control, and technical documentation.

  • Perform unit testing and support System Integration Testing (SIT) and User Acceptance Testing (UAT).

  • Troubleshoot, debug, and resolve technical issues in a timely manner.

  • Support deployment activities, including release management, rollback procedures, and production monitoring.

  • Participate in system architecture, solution design, and technical planning discussions.

  • Ensure data quality, governance, lineage, metadata management, and compliance with organizational standards.

  • Collaborate with cross-functional teams including developers, analysts, business users, and project stakeholders.

  • Provide on-call support outside regular business hours when required.

Qualifications

Required

  • Bachelor's Degree in Computer Science, Information Technology, Information Systems, Engineering, or a related field.

  • At least 3 years of experience in software development and/or data engineering.

  • Strong experience in C#, .NET Core/MVC, and React development, preferably in web-based applications.

  • Advanced knowledge of SQL, including database design, query optimization, performance tuning, and data modeling.

  • Experience in designing and implementing ETL/ELT processes, data integration, and data transformation solutions.

  • Proficiency in Python for data engineering and pipeline development.

  • Knowledge of RESTful APIs and integration with third-party or external data sources.

  • Experience with Azure Data Factory (ADF) for building and managing data pipelines.

  • Hands‑on experience with Microsoft SQL Server and familiarity with SSIS or other legacy ETL tools.

  • Experience using Azure DevOps for source control, CI/CD, and deployment automation.

Preferred

  • Experience with enterprise-scale data warehouse solutions and cloud-based data platforms.

  • Familiarity with:

    • Azure Synapse Analytics

    • Azure Data Lake Storage (ADLS)

    • Microsoft SQL Server Data Warehouse Solutions

  • Strong understanding of:

    • Data Governance

    • Data Quality and Data Cleansing

    • Data Lineage

    • Metadata Management

  • Experience handling both structured and unstructured data environments.

Technical Skills

Programming Languages & Frameworks

  • C#

  • .NET Core / MVC

  • React

  • Python

Databases & Data Platforms

  • Microsoft SQL Server

  • Azure Synapse Analytics

  • Azure Data Lake Storage (ADLS)

Data Engineering Tools

  • Azure Data Factory (ADF)

  • SQL Server Integration Services (SSIS)

  • ETL/ELT Frameworks

DevOps & Source Control

  • Azure DevOps

  • Git

  • CI/CD Pipelines

See also