Data Engineer
Summary
Designs and builds scalable data pipelines in Python and Databricks, writes FastAPI services, and deploys on Azure while collaborating with analysts and product teams.
Role & responsibilities
- -Design and develop scalable data processing solutions using Python and Databricks
- -Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
- -Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
- -Design and optimize SQL queries and data models
- -Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
- -Deploy and maintain solutions on Microsoft Azure
- -Drive best practices in performance optimization, monitoring, testing, and code quality
- -Mentor junior engineers and contribute to architectural decisions