Hiring for Data Engineer-DataBricks
Summary
Build and optimize data pipelines on AWS and Databricks to cut costs while scaling analytics for a global fashion brand.
Responsibilities
- Optimize AWS, Databricks, and Informatica resource usage to control costs while meeting performance and scalability requirements.
- Stay up to date with AWS, Databricks, Informatica IDMC services, and data engineering best practices to recommend and implement new technologies and techniques.
- Conduct user requirement analysis for the development / implementation of new systems and enhancements to existing systems.
- Evaluate potential solutions and make recommendations to resolve business problems.
- Involvement in the system integration testing phase prior to implementation.
- Plan and coordinate end‑user training for any system implementations or enhancements.
Qualifications
- Minimum 6 years of experience in data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC.