Senior Software Engineer
Posted Updated 41
views
Referral available at Incedo
An employee here can refer you. The referrer stays anonymous and reaches out to you directly if interested.
Description
Position Overview
We are looking for an experienced Azure Data Engineer with strong hands-on expertise in Azure Data Factory (ADF), Azure Databricks (ADB), DBT, Snowflake, and SQL databases. The ideal candidate should have experience working in production environments, strong scenario-based problem-solving skills, and the ability to collaborate effectively with both technical and business stakeholders.
Experience in the Wealth Management domain will be an added advantage.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and data engineering solutions on the Azure platform.
- Develop and manage ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB).
- Implement data transformation workflows using DBT.
- Work with Snowflake for data storage, transformation, and analytical workloads.
- Apply Medallion Architecture principles (Bronze, Silver, and Gold layers) for organizing, processing, and serving data.
- Design and implement robust data pipelines following appropriate data-layering, transformation, and data-quality practices.
- Develop and optimize complex SQL queries, stored procedures, and data-processing solutions using SQL Server and PostgreSQL.
- Work with Azure Logic Apps for workflow orchestration and system integrations.
- Troubleshoot data pipelines, production issues, and performance-related problems.
- Participate in production support activities, including incident analysis, root-cause analysis, and issue resolution.
- Understand business and technical scenarios and translate requirements into effective data engineering solutions.
- Collaborate with business analysts, data architects, developers, and other stakeholders.
- Use modern development tools such as VS Code and GitHub Copilot to improve development productivity.
- Follow coding, deployment, monitoring, data-quality, and data engineering best practices.
Experience & Qualifications
- 3+ years of relevant experience in Data Engineering.
- Strong hands-on experience with Azure data services and cloud-based data engineering.
- Strong understanding and practical experience with Medallion Architecture, including Bronze, Silver, and Gold data layers.
- Proven experience developing and supporting production-grade data pipelines.
- Strong SQL development and database concepts, particularly with SQL Server and PostgreSQL.
- Experience with DBT and Snowflake in modern data engineering environments.
- Good understanding of data integration, ETL/ELT, data transformation, orchestration, and troubleshooting.
- Strong ability to understand real-world business scenarios and translate them into technical solutions.
