Technology Lead - Databricks Data Engineering
Summary
Lead a team to build and optimize Databricks-based ETL/ELT pipelines using Python/SQL, Delta Lake, and cloud platforms (Azure/AWS/GCP) for large-scale data processing.
Technology Lead - Databricks Data Engineering
Today, the corporate landscape is dynamic and the world ahead is full of possibilities! None of the amazing things we do at Infosys would be possible without an equally amazing culture, the environment where ideas can flourish and where you are empowered to move forward as far as your ideas will take you. At Infosys, we assure that your career will never stand still, we will inspire you to build what’s next and we will navigate further together. Our journey of learnability, values and trusted relationships with our clients continue to be the cornerstones of our organization and these values are upheld only because of our people.
Required Skills (Must Have)
- Hands‑on experience with Databricks (notebooks, clusters, jobs, Delta Lake).
- Strong understanding of ETL/ELT processes.
- Experience with Python or SQL.
- Good understanding of cloud platforms (Azure, AWS, or GCP).
- Knowledge of Delta Lake features (ACID transactions, time travel, schema evolution).
- Familiarity with data warehousing concepts.
- Ability to work with large datasets and optimize performance.
- Strong debugging and problem‑solving skills.
Preferred Skills (Good to Have)
- Experience with streaming systems (Auto Loader, Structured Streaming).
- Knowledge of CI/CD workflows (Git, DevOps pipelines).
- Experience with orchestration tools (Azure Data Factory, n8n, etc.).
- Understanding of lakehouse architecture.
- Exposure to ML workflows or MLOps.
Qualifications
- 2–6 years of experience in data engineering or analytics.
- Certifications in Databricks, Azure, AWS, or GCP are a plus.
Soft Skills
- Good communication skills.
- Ability to work with cross‑functional teams.
- Proactive attitude and ownership mindset.
All aspects of employment at Infosys are based on merit, competence and performance. We are committed to embracing diversity and creating an inclusive environment for all employees. Infosys is proud to be an equal opportunity employer