AWS Data Engineer
Summary
Builds and maintains scalable AWS data pipelines using Glue, PySpark, Redshift, and Kinesis to process and stream large datasets for clients.
We're looking for an experienced AWS Data Engineer with 10+ years of hands-on experience in designing, developing, and supporting production-grade AWS data platforms. This is a hands-on Individual Contributor (IC) role, so we're looking for someone who can quickly contribute to technical deliverables from day one. We are not looking for lead or managerial profiles.
Required Skills:
- Strong hands-on experience with AWS Glue using PySpark and Python to build scalable ETL and data processing pipelines.
- Experience working with Amazon S3, AWS Lambda, Amazon Redshift, and Amazon DynamoDB to design and support cloud-based data solutions.
- Solid experience with Amazon Kinesis and/or Apache Kafka for building real-time data ingestion and streaming pipelines.
- Hands-on knowledge of Apache Airflow for workflow orchestration and scheduling complex data pipelines.
- Strong SQL skills with experience writing and optimizing complex queries for large datasets.
- Experience implementing Infrastructure as Code (IaC) using AWS CDK or Terraform to automate cloud infrastructure deployments.