AWS Data Engineer
Summary
Design, build, and maintain data transformation pipelines using AWS services, Python, PySpark, and Databricks. Manage large datasets and databases like PostgreSQL or MongoDB while participating in code reviews and deployment processes.
Job Requirements*
The successful candidate will be responsible for
- Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage efficiently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.
Key Responsibilities*
- Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage effeciently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.