Senior Data Engineer
Posted 3
views
Summary
Senior Data Engineer for a long-term contract in Hyderabad, focused on building and managing data lakes and scalable pipelines on AWS. Core stack includes Python, SQL, Airflow, Terraform, and AWS services like Glue, Redshift, Lambda, and DynamoDB; role requires night-shift hours (8:30 PM–4:30 AM IST).
Hello
Hope you’re doing well
Title: Senior Data Engineer
Location: Hyderabad (Remote)
Duration: Contract Long term / Full time
Salary : DOE
Working Hours : 8:30 PM IST to 4:30 AM IST
JD:
- 6+ years of experience working with enterprise data platforms, building and managing data lakes and using big data technologies
- 5+ years of experience working with relational and non-relational / NoSQL databases, advanced knowledge of SQL
- 4+ years of experience working with AWS platform. Experience with solutioning on AWS infrastructure using services like AWS IAM, S3, API Gateway, Lambda, Glue, Lake formation, Redshift, DynamoDB, RDS
- 4+ years of experience with using Python for data engineering and developing high performance and scalable data pipeline
- 2+ years of experience working with Apache Airflow for orchestrating analytics workload
- 2+ years of experience with IaC solutions like terraform, cloud formation
- Preference to candidates with MLOps experience and exposure to executing ML/AI use cases in AWS cloud utilizing services like Sagemaker, Bedrock
- Strong understanding of concepts around data warehousing, BI, data security, data quality and profiling
- Prior experience with traditional ETL tools like Talend Open Studio, Informatica, Pentaho or something similar
- Cloud DevOps experience utilizing products like Gitlab, Bitbucket or similar ones
- Prior experience with AWS EKS service, setting up and managing kubernetes clusters and services is preferred
- Have to be a team player and open to working with newer technologies as well as supporting legacy systems