Data Engineer
Summary
Build and maintain Azure-based data pipelines, SQL databases, and monitoring for a developer-focused security platform.
Job Summary:
- 3-5 years as an Application Developer/Support with good knowledge and understanding of Software Development Life Cycle, databases, batch processing, knowledge of firewalls, FTP, and SFTP. Experience in application production support, including logical thinking, organizational skills, and troubleshooting skills.
- Azure cloud development and design working knowledge on the following items:
- Azure App services: Web apps, API-Apps
- Azure Network Security groups: To identify the NSG rules that are required to be allowed or denied
- Azure monitor: To configure alerts on various metrics and analyze for troubleshooting
- Azure data lake: Reading from and writing to different sources using Azure SDK/APIs/configuration
- Azure data factory: Pipelines, data sets, linked services, integrated with Self-hosted integration runtime, mapping, authoring, and monitoring data flow
- Azure SQL/Azure SQL MI: Azure SQL feature differences and SQL programming
- Azure Function App: HTTP Triggered apps, Timer triggered apps
- Azure Key Vault: Storing and retrieving secrets programmatically.
- Writing and troubleshooting complex SQL queries and Stored Procedures is required
- Working knowledge in partitioning, indexes, statistics, explain/execution plans, etc
- Experience in creating Power BI Reports and analytics is a plus
- Experience building and integrating with external systems using REST API connectors is a plus
- Knowledge and experience of using GIT and Azure DevOps
- Ability to independently analyze, troubleshoot, and resolve technical issues
- Strong problem-solving and communication skills
- Ability to adapt to new technologies as required
- PowerShell / Azure CLI scripting – Automation of routine tasks, deployment scripts, and production support troubleshooting.
- Azure Log Analytics & KQL (Kusto Query Language) – Querying logs, diagnosing pipeline failures, and production incident investigation.
- Application Insights – Tracing end-to-end request flows and identifying performance bottlenecks in APIs and Functions.
- CI/CD pipeline authoring (YAML in Azure DevOps) – Building and maintaining build/release pipeline definitions, not just consuming them.
- Infrastructure as Code (Bicep / ARM templates) – Basic ability to read, modify, and deploy infrastructure changes.
- Production support is required for this role