Data Engineer
Posted Updated
Summary
Data engineer with 5+ years building scalable ETL/ELT pipelines and reporting on the Azure stack — ADF, Databricks, PySpark, SQL, Data Lake — plus Power BI dashboards and GenAI/LLM integrations using Azure OpenAI and vector databases.
5+ years of experience in Data Engineering
- Strong hands-on experience with ADF, Azure Databricks, PySpark, SQL, Power BI
- Experience building data pipelines and data integration solutions
- Working knowledge of Azure OpenAI, LLM integration, Prompt Engineering, Vector Databases
- Experience with Azure Data Lake, Git, DevOps, and CI/CD pipelines
- Develop and maintain scalable ETL/ELT pipelines
- Implement data ingestion, transformation, and reporting solutions
- Develop Power BI dashboards and semantic models
- Support GenAI/LLM use cases using Azure OpenAI services
- Optimize PySpark workloads and improve pipeline performance
- Collaborate with business and technical teams for solution delivery