AWS Data Engineer - Data Pipelines & Ingestion

Role : Data Engineer (AWS)

Mandatory :

- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, preferably on AWS.

- Experience in ingesting batch and streaming data from various data sources.

- Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)

- Experience in developing ETL, OLAP based and Analytical Applications.

- Ability to quickly learn and develop expertise in existing highly complex applications and architectures.

- Comfortable working in Agile projects

Desirable :

- Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.)

- Knowledge of DevOps and CD/CD tools.

- Experience in handling unstructured data

- Knowledge of Financial Markets domain

Keywords : Data Engineer, Data Pipelines, Data Ingestion, AWS Lambda, AWS Athena