Data Engineer
Posted 3
views
Summary
A Data Engineer in Taguig develops, maintains, and monitors cloud-based data pipelines and data infrastructure on AWS, using SQL and Python day to day with services like S3, Redshift, Glue, IAM, CloudWatch, and DataSync.
About the role
We are looking for a Data Engineer with hands-on knowledge of SQL, Python, and AWS data services. The role will support the development, maintenance, and monitoring of cloud-based data pipelines and data infrastructure. The ideal candidate has a good foundation in data engineering concepts and practical experience working with AWS services such as S3, Redshift, IAM, Glue, and CloudWatch.
Key responsibilities
- Develop and maintain data processing and data integration solutions using SQL and Python.
- Support the development and maintenance of data pipelines within AWS environments.
- Work with AWS S3 for data storage and management.
- Support data warehousing activities using AWS Redshift.
- Work with AWS Glue for data integration, transformation, and ETL processes.
- Manage and support AWS IAM, including roles, users, and policies.
- Monitor data pipelines and AWS resources using AWS CloudWatch.
- Support data synchronization (DataSync) and data transfer activities.
- Troubleshoot data pipeline, integration, and processing issues.
- Perform data validation and ensure data accuracy and consistency.
About you
- Hands-on knowledge of SQL.
- Hands-on programming experience with Python.
- Experience or practical knowledge of AWS S3.
- Experience or practical knowledge of AWS Redshift.
- Understanding of AWS IAM, including roles, users, and IAM policies.
- Experience or knowledge of AWS Glue.
- Familiarity with AWS CloudWatch.
- Experience or knowledge of AWS DataSync / Data Synchronization.
- Good understanding of data engineering and ETL concepts.
- Strong analytical and problem-solving skills.