AWS Data Engineer

Required Skills & Qualifications

Experience:

• 5+ years of professional experience in data engineering, with a strong focus on data warehousing or data lake development.
• 2+ years of hands-on experience with AWS data services.

Technical Skills:

• Programming: Strong proficiency in Python is essential.
• AWS Data Services: In-depth knowledge and hands-on experience with core AWS data services including:
  ▪ Storage: S3 (object storage, data lake foundation)
  ▪ Compute: AWS Glue, AWS Lambda
  ▪ Orchestration: Event Bridge, AWS Step Functions.
  ▪ Cataloging/Querying: AWS Glue Data Catalog, Athena
  ▪ SQL: SQL skills for data manipulation, querying, and optimization.
  ▪ Data Formats: Experience working with various data formats (e.g., Parquet, ORC, CSV, JSON, Avro).
  ▪ Version Control: Git, experience with branch and merge process.

Soft Skills:

• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Ability to work independently and as part of a collaborative team.
• Proactive attitude and a strong desire to learn and grow.

Nice-to-Haves:

• AWS Certifications (e.g., AWS Certified Data Engineer, AWS Certified Solutions Architect).
• Experience with other cloud platforms (Azure, GCP).
• Familiarity with containerization technologies (ECS, Docker, Kubernetes).
• Exposure to machine learning data pipelines and MLOps.
• Experience with data governance frameworks and tools.
• Understanding of data modelling techniques (e.g., dimensional modelling,
  data vault)