Data Engineer
Posted Updated 8
views
You will design, build and maintain data pipelines and data lakes. You will collect, clean and process data while ensuring its quality and availability. You will work with data scientists, platform engineers and front-end engineers to define requirements, create new data processes, and improve existing ones. You will also develop data visualization and analytics tools.
Responsibilities
- Design, build and maintain data pipelines and data lakes
- Collect, clean and process data while ensuring data quality and availability
- Collaborate with data scientists, platform engineers and front-end engineers to define requirements and design data processes
- Maintain and improve existing data processes
- Design, develop and implement data visualization and analytics tools
- Collaborate with UI/UX designers
- Create rapid prototypes
Requirements
- Experience designing, building and maintaining data pipelines and data lakes
- Experience with Amazon Web Services, Google Cloud Platform and ETL pipelines
- In-depth knowledge of SQL and NoSQL databases
- Experience with Spark or other big data frameworks
- Fluency in Python
- Experience developing web and mobile applications
- Experience collaborating with UI/UX designers
- Experience with rapid prototyping
- Working experience with Git
- Exposure to agile software development methodology
- 1 to 3 years of experience
- B.E., B.Tech, BCA, MCA, B.Sc or M.Sc