Data Engineer (Enterprise Data Warehouse)
Summary
Build and maintain scalable data pipelines and warehouse solutions using C#, .NET, Python, and Azure tools to power analytics and business intelligence.
Data Engineer
Job Overview
We are seeking a highly skilled and detail-oriented Data Engineer to design, develop, and maintain scalable data solutions that support business intelligence, analytics, and operational requirements. The ideal candidate will have strong experience in data warehousing, ETL/ELT processes, cloud-based data platforms, and software development, with a passion for building reliable and efficient data pipelines.
Key Responsibilities
Develop, enhance, and maintain data applications, pipelines, and warehouse solutions based on business and technical requirements.
Write clean, efficient, maintainable, and well-documented code following established coding standards and best practices.
Design and implement ETL/ELT processes for data ingestion, transformation, and integration from various internal and external data sources.
Build and optimize database structures, queries, stored procedures, and data models to ensure performance and scalability.
Manage source code repositories, version control, and technical documentation.
Perform unit testing and support System Integration Testing (SIT) and User Acceptance Testing (UAT).
Troubleshoot, debug, and resolve technical issues in a timely manner.
Support deployment activities, including release management, rollback procedures, and production monitoring.
Participate in system architecture, solution design, and technical planning discussions.
Ensure data quality, governance, lineage, metadata management, and compliance with organizational standards.
Collaborate with cross-functional teams including developers, analysts, business users, and project stakeholders.
Provide on-call support outside regular business hours when required.
Qualifications
Required
Bachelor's Degree in Computer Science, Information Technology, Information Systems, Engineering, or a related field.
At least 3 years of experience in software development and/or data engineering.
Strong experience in C#, .NET Core/MVC, and React development, preferably in web-based applications.
Advanced knowledge of SQL, including database design, query optimization, performance tuning, and data modeling.
Experience in designing and implementing ETL/ELT processes, data integration, and data transformation solutions.
Proficiency in Python for data engineering and pipeline development.
Knowledge of RESTful APIs and integration with third-party or external data sources.
Experience with Azure Data Factory (ADF) for building and managing data pipelines.
Hands‑on experience with Microsoft SQL Server and familiarity with SSIS or other legacy ETL tools.
Experience using Azure DevOps for source control, CI/CD, and deployment automation.
Preferred
Experience with enterprise-scale data warehouse solutions and cloud-based data platforms.
Familiarity with:
Azure Synapse Analytics
Azure Data Lake Storage (ADLS)
Microsoft SQL Server Data Warehouse Solutions
Strong understanding of:
Data Governance
Data Quality and Data Cleansing
Data Lineage
Metadata Management
Experience handling both structured and unstructured data environments.
Technical Skills
Programming Languages & Frameworks
C#
.NET Core / MVC
React
Python
Databases & Data Platforms
Microsoft SQL Server
Azure Synapse Analytics
Azure Data Lake Storage (ADLS)
Data Engineering Tools
Azure Data Factory (ADF)
SQL Server Integration Services (SSIS)
ETL/ELT Frameworks
DevOps & Source Control
Azure DevOps
Git
CI/CD Pipelines