Senior Data Engineer – AWS & Cloud Migration
Summary
Design and migrate on-prem data pipelines to AWS using Glue, Redshift, EMR, and Python; automate workflows with Airflow and monitor with CloudWatch/Kibana.
Overview
Role Description:
- Have strong knowledge on AWS, and its related services
- Have hands-on knowledge on Python, spark, spark, AWS glue and redshift
- Have strong knowledge on airflow schedule and AWS monitoring tools like Cloud watch and Kibana
- Have strong knowledge on AWS EMR services.
- have strong knowledge on migrating cloud from on prem workloads
- have strong knowledge on incident, problem, change management
- Strongproblem-solving abilities to troubleshoot and optimize automated processes.
- Capability to analyze business processes and identify automation opportunities.
- Skill in data interpretation and making data-driven decisions
- Excellent communication skills to interact with stakeholders and team members.
- Ability to work collaboratively in a team environment.
- Strong organizational skills to manage multiple tasks and priorities
Competencies
Amazon Web Service (AWS) Cloud Computing, Python for Data Science, Microsoft SQL Server 2019, PySpark, Netezza
Experience (Years)
8-10
Essential Skills
Data Bases like SQL, Netezza and Bigdata tools like Hadoop Data Lake, Datawarehouse and ETL, ELT AWS cloud and Data management
Seniority level
- Mid-Senior level
Employment type
- Full-time
Job function
- Information Technology
Industries
- Information Services