ETL Developer with AWS Glue

Role: ETL Developer with AWS Glue Exp.

Yrs of exp: 8-12 yrs,

JD:

We are looking for ETL Developers with AWS Glue experience. Below is the JD.

ETL Dev:

• Design and develop scalable ETL pipelines using AWS services such as:
  • AWS Glue for serverless data integration

• • AWS Lambda for lightweight transformations

• Integrate data from diverse sources including APIs, databases, and flat files into AWS-based data platforms.
• Implement data transformation logic using PySpark, SQL within AWS Glue

• Monitor, schedule, and orchestrate ETL workflows using AWS Step Functions, Glue Workflows, or Apache Airflow on Amazon MWAA.
• Ensure data quality, consistency, and lineage using AWS Glue Data Catalog and AWS Lake Formation.
• Optimize ETL performance and cost-efficiency through partitioning, parallelism, and resource tuning.
• Document ETL processes, data flows, and architecture using tools like AWS Architecture Diagrams or Confluence.