Senior AWS Data Engineer
Posted
Description
Role: Senior AWS Data Engineer
Locations: Fort Mill, SC
Experience: 09+ years
Key Skills: Data, AWS, Airflow, Glue HVR
Mode of Hire: Full time
Job Description:
- Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake.
- Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks.
- Implement data integration solutions using HVR to ensure real-time data availability.
- Write and optimize SQL queries for data retrieval and manipulation.
- Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Monitor and troubleshoot data pipelines to ensure high availability and performance.
- Document data processes and maintain data quality standards.
- Stay updated with the latest industry trends and technologies related to data engineering and cloud computing.
Mandatory Required Skills:
- Proven experience with AWS services, particularly Airflow and Glue.
- Strong knowledge of Snowflake and its data warehousing capabilities.
- Proficiency in SQL for data manipulation and analysis.
- Experience with Python for data processing and automation tasks.
- Hands-on experience with ETL processes and tools.
- Strong understanding of cloud computing concepts and architectures.
Preferred Skills:
- Experience with HVR for data replication and integration.
- Familiarity with data modelling and database design principles.
- Knowledge of data governance and data quality best practices.
- Experience with version control systems such as Git.
- Understanding of Agile methodologies and project management practices.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 7-12 years of experience in data engineering or a related role.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- Ability to work independently and as part of a team in a fast-paced environment.
Skills
Sign in to read and join the discussion.