We are seeking a seasoned Data Engineering professional to join Bristlecone India's AI‑Delivery team. The Senior Software Engineer will own end‑to‑end data pipelines, drive architectural decisions, and act as a subject‑matter expert for Snowflake and Databricks platforms, enabling data‑driven AI initiatives across the organization.
- Design, build, and maintain robust data pipelines on Snowflake and Databricks.
- Develop scalable ETL/ELT processes using Python, SQL, and Spark.
- Collaborate with data scientists and analysts to translate requirements into data solutions.
- Optimize data models and query performance for large‑scale workloads.
- Implement data governance, security, and compliance best practices.
- Mentor junior engineers and promote best coding standards.
- Evaluate emerging technologies and recommend improvements to the data stack.
- Create comprehensive documentation and technical specifications.
- Participate in agile ceremonies and contribute to sprint planning.
- Monitor production systems, troubleshoot issues, and ensure high availability.
- 5+ years of professional experience in data engineering.
- Deep expertise with Snowflake and Databricks platforms.
- Strong proficiency in SQL and Python (or Scala).
- Hands‑on experience with cloud services (AWS, Azure, or GCP).
- Solid understanding of data modeling, warehousing, and lakehouse concepts.
- Experience building and optimizing Spark jobs at scale.
- Knowledge of CI/CD pipelines and infrastructure as code.
- Excellent problem‑solving and analytical skills.
- Effective communication and stakeholder management abilities.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.