Data Engineering - AWS/Spark/Python

Job Description :

This is a senior-level engineering role where the candidate would be a part of the Data Engineering team distributed in the US and India. They are expected to provide technical leadership, be fully hands-on, and lead by example. They are expected to architect complete end-to-end solutions/data pipelines; data ingestion, ETL, reporting, and APIs.

You Will :

- Work with various Big Data technologies on AWS.

- Deploy data pipelines in production based on CI/CD practices using Docker and Airflow

- Contribute to software implementation specs, test plans, participate actively in code reviews and adhere to very high-quality coding practices with good test coverage.

- Mentor and lead other data engineers.

You have :

- B.Tech./B.E./M.Tech./MCA or equivalent, in computer science or relevant area

- 6+ years of computer systems design/software architecture experience

- 6+ years of Java/Scala and/or Python programming with good CS fundamentals

- 6+ years of Big Data development experience with Hadoop/Spark and writing ETLs

- 6+ years' experience of SQL, RDBMS and/or NoSQL database technologies

- AWS experience preferred or any other public cloud

- A big plus and way to standout - Experience building Machine Learning pipelines, MLOps, knowledge of fundamental ML/statistical models