Data Engineer
Summary
Data Engineer designing and optimizing Azure-based data pipelines (Databricks, SQL Server, Data Factory) with SQL and Python/PySpark, collaborating with Finance and Portfolio teams.
We're Hiring: Data Engineer | Thought Focus ✨
Location: Bangalore / Hyderabad
Experience: 8–14 years
About the Role
We're looking for a hands-on Data Engineer who's comfortable writing production-grade SQL, designing ADF pipelines, and turning messy, undocumented source data into reliable, governed assets — working closely with Finance, IR, and Portfolio teams. ?
?
Responsibilities
- Have strong hands-on experience with Azure Databricks, Azure SQL Server, and Azure Data Factory
- Can build and optimize scalable, fault-tolerant data pipelines for ingestion and processing
- Understand data quality, validation frameworks, and automated testing deeply
- Can analyze data patterns, spot inconsistencies/anomalies, and rigorously validate data — not just process it
- Document data models, pipelines, and data dictionaries clearly for both technical and business stakeholders
- Are strong in SQL (T-SQL is a plus) and Python with PySpark, Data Frames, and API integration
- Push back on over-engineering and have a strong automation mindset
Qualifications
Bonus points: CI/CD & DevOps release pipelines, YAML configs, AI/MCP tooling with LLM workflows, Power BI reporting
.
Required Skills
Strong hands-on experience with Azure Databricks, Azure SQL Server, and Azure Data Factory
.
Preferred Skills
CI/CD & DevOps release pipelines, YAML configs, AI/MCP tooling with LLM workflows, Power BI reporting
Send your resume to santhosh.krishnappa@thoughtfocus.com
.