Databricks Data Engineer
Summary
Design, build, and maintain scalable cloud-based data pipelines using Databricks, Apache Spark, Python, and SQL for Energy Trading & Risk Management clients.
Job Title: Databricks Data Engineer
Location: Delhi (Hybrid)
Experience: 2–6 Years
Type: Full-Time
About the job
Veracy Consulting provides Consulting and Development services to Energy Trading & Risk Management clients. We’re growing our data team and looking for skilled Databricks Engineers to help design, build, and maintain modern, cloud-based data solutions. If you love turning messy data into reliable, scalable pipelines — and enjoy solving tough technical problems alongside a collaborative team — we’d love to hear from you.
🚀 What you’ll do
• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark
• Build and optimize ETL/ELT processes for structured and semi-structured data
• Write clean, efficient, maintainable code in Python and SQL
• Partner with business and technical stakeholders to translate data requirements into robust solutions
• Integrate data from multiple source systems into cloud-based platforms
• Monitor, troubleshoot, and improve pipeline performance, reliability, and data quality
• Champion best practices in testing, documentation, version control, security, and data governance
• Contribute to code reviews, technical discussions, and continuous improvement
✅ What we’re looking for
• 2–6 years in data engineering, data development, or a similar role
• Strong experience with Databricks
• Strong Python and SQL skills
• Solid grasp of data pipelines, ETL/ELT, and modern data engineering practices
• Experience with large datasets and optimizing data-processing workloads
• Familiarity with cloud data platforms — ideally Azure
• Comfortable with Git and collaborative development practices
• A structured, solution-oriented mindset and a sharp eye for data quality
• Strong communicator and team player
⭐ Nice to have
• Azure Data Factory, Azure Data Lake, or similar cloud services
• Delta Lake, Databricks Workflows, and Unity Catalog
• CI/CD pipelines and infrastructure-as-code
• Supporting reporting, analytics, or BI use cases
Why join us
• Work on impactful, modern cloud-data projects
• Grow your Databricks and data-engineering expertise in a collaborative environment
• Build scalable platforms that support real business decisions
• Flexible, growth-oriented workplace
#DataEngineering #Databricks