Associate Technical Lead - Data Engineering
Posted
Description
Responsibilities:
- Designing and developing data solutions for one of the world’s largest corporations involved in the marketing and distribution of food products
- Implementing distributed and highly available data processing applications that scale for enterprise demands
- Adhering to Continuous Integration and Continuous Delivery of solutions
- Ensuring high code quality by following software engineering best practices
- Working collaboratively in a cross-functional team in an Agile delivery environment
- Adhering to DevOps principles and being involved in projects throughout their full software lifecycle: from development, QA, and deployment, to post-production support
Requirements:
- A Bachelor’s Degree in Computer Science or equivalent, and 4+ years of experience in developing enterprise grade data processing applications
- A strong programming background in data ops (Python, Shell, SQL)
- Experience in working with streaming data (Kafka)
- Strong hands-on experience with AWS data services including Redshift, RDS (PostgreSQL), DMS, Lambda, EC2 and S3
- Experience in processing large volumes of data
- Hands-on experience in working with relational/NoSQL databases and distributed storage engines (HDFS, S3, Redshift)
- Hands-on experience in ETL design and development using ETL tools (Preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive)
- Experience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantage
- Working in a Scrum Agile delivery environment and DevOps practices
- Experience in code management and CICD tools such as Github, Gitlab, Jenkins
- Experience in an agile environment and aligning Pod members on technical vision and path to implementation
- A strong desire to continue to grow your skillset
- Strong communication skills that are influential and convincing
Skills
Sign in to read and join the discussion.