Data Engineer (C#/.NET Experience)
Summary
Data engineer who integrates data from APIs, data lakes, and third-party apps into clean, real-time pipelines for analytics, with validation and troubleshooting. Core stack: Python or C#/.NET, SQL and Cosmos DB, Azure ETL tooling, Kusto/Application Insights/Grafana for log analysis, and Power BI dashboards.
Bachelor's degree in computer science or other engineering disciplines.
5+ years of Python or C# experience.
5+ years of experience with database systems (SQL, Cosmos).
2+ years of experience with ETL (python, Azure Data foundry or similar) and log analysis systems (SQL, Kusto, Application Insights, Grafana, etc.).
3+ years’ experience creating and maintaining PowerBI dashboards.
Strong analytical skills - able to synthesize complex information and large datasets to drive decisions.
Responsibilities
- Integrate data from various internal and external sources such as APIs, data lakes, and third-party applications.
- Ensure the quality and consistency of data through the implementation of validation checks and automated testing.
- Identify and troubleshoot data-related issues, proposing solutions for improvements.
- Implement data pipelines that provide clean, accessible, and real-time data for analytical purposes.