Data Engineer
Summary
Designs, builds, and maintains ETL/ELT data pipelines and data infrastructure using AWS data services (Glue, Lambda, S3, Redshift, EMR, Kinesis, Airflow) and/or Talend Studio. Works with data lakes, lakehouse architectures, and enterprise data warehouses, monitoring and optimizing pipelines for accuracy and reliability.
Job Summary:
We are looking for a Data Engineer responsible for designing, developing, and maintaining data pipelines and data infrastructure using AWS data engineering services and/or Talend Studio. The role will work with data from multiple sources and support reliable, secure, and scalable data processing solutions.
Key Responsibilities:
- Design, develop, and maintain data pipelines and ETL/ELT processes using AWS data services and/or Talend Studio.
- Work with data from multiple sources, including data lakes, data warehouses, and relational databases.
- Monitor, troubleshoot, and optimize data pipelines to ensure data accuracy, quality, and reliability.
- Develop and maintain data integration solutions using AWS services such as Glue, Lambda, S3, Redshift, EMR, RDS, Step Functions, Kinesis, and MWAA/Airflow.
- Collaborate with cross-functional teams to support data requirements, security protocols, and data-driven initiatives.
- Develop and maintain data solutions using S3-based Lakehouse architectures and Enterprise Data Warehouse environments.
- Contribute to the improvement, automation, and optimization of data engineering processes.
- Prepare and maintain technical documentation for data pipelines, processes, and integrations.
Qualifications:
- 2–5 years of experience in data engineering, ETL, or data integration.
- Experience with Talend Studio and/or AWS data engineering services. Talend experience is preferred but not mandatory.
- Strong experience with AWS-native data engineering services is acceptable in lieu of Talend experience.
- Proficiency in SQL, Python, Spark, and Java.
- Experience with AWS services such as Glue, Lambda, S3, Redshift, EMR, RDS, Step Functions, Kinesis, and MWAA/Airflow.
- Experience with S3-based Lakehouse architectures, RDS, and Enterprise Data Warehouse (EDW) environments.