SDE- Data Engineer
Posted 4
views
Summary
Data engineer with 3-7 years' experience for an MNC client in Hyderabad, focused on migrating legacy Data Lake/Big Data platforms to Snowflake/Lakehouse environments. Day-to-day work centers on SQL, Python/Java, Spark/PySpark, AWS-hosted data lakes, data quality/reconciliation, and performance optimization.
Hiring for a MNC - client
3- 7 years experience
We are specifically looking for candidates with strong Data Engineering and Data Migration experience, particularly those who have worked on legacy Data Lake/Big Data platforms and migration/modernization to Snowflake/Lakehouse environments.
- Strong SQL and Python/Java programming skills
- Hands-on experience with Apache Spark / PySpark
- Strong Data Engineering / Data Lake experience
- Experience in Data Migration / Data Lake Migration projects
- Hands-on experience with Snowflake
- Knowledge/experience with Apache Iceberg / Lakehouse
- Strong understanding of Data Reconciliation, Data Validation & Data Quality
- Good understanding of Data Modeling concepts, including SCD Type 2
- Experience with Data Partitioning, Clustering and Performance Optimization
- Exposure to Hadoop/HDFS/Hive
- Good understanding of Parquet, Avro and JSON
- Experience with CI/CD; Kubernetes exposure is preferred
- Exposure to Kafka is an added advantage
- Cloud: AWS – Mandatory (experience with AWS-hosted Data Lake/Lakehouse environments is preferred)