Data Engineer Architect
Posted
Summary
Onsite Data Engineer Architect role in Hyderabad (8-11 years experience) focused on architecting large-scale distributed data pipelines with Hadoop, Spark, Kafka and Hive, plus NoSQL stores like Cassandra and MongoDB. Hands-on Python is mandatory; AWS/GCP cloud experience is a plus.
Job Title: Data Engineer Architect
Experience: 8-11Years
Work Type: Onsite
Employment Type: Full Time
Requirement:
- Responsibilities:8+ years of hands-on Experience with crafting and building large scale data pipelines in distributed environments with technologies such as Hadoop, Spark, Kafka, Hive etc.
- Experience with NoSQL datastores like Cassandra, Elasticsearch, HBase, MongoDB.
- Proven skills in designing, tuning & optimizing scalable, highly available distributed systems which can handle high data volumes.
- Strong understanding of software engineering principles and fundamentals including data structures and algorithms.
- Strong experience of working with APIs and integrating multiple applications together.
- Proficient & hands-on in Python is a must.
- Good Experience with modern engineering practices and technologies including CICD, Cloud native development, social coding (github), chatbots and more.
- Good data modelling experience to address scale and read/write performance.
- Excellent written and oral communication skills on both technical and non-technical topics.
- Excellent general analytical & problem solving skills.
- Experience with cloud computing platform like AWS or GCP is a plus.