Lead / Staff Data Engineer
Posted Updated
Description
Responsibilities:
- Be part of developing scalable, reliable and highly available production-level data platforms and data pipelines to meet various business needs.
- Should be able to design (high level / low level) software solutions for new requirements.
- Code independently and also with other team members with proper software industry standard best practices.
- Collaborate with data analysts/ product managers in understanding the data.
- Mentoring junior developers, code reviews and deployments.
- Work closely with QA and deliver the product end-to-end.
Requirements:
- B. E/MTech in Computer Science.
- 6+ years of experience in software development.
- Experience in building scalable products, preferably with big data.
- Good coding skills in Python; experience in Spark.
- Experience in either data warehouses or relational databases is mandatory.
- Experience in Kafka and stream/batch processing applications like Storm and kstreams.
- Experience in AWS cloud.
- Ability to work collaboratively across multiple products and application teams.