Azure Data Engineer
Summary
Azure Data Engineer designing and maintaining data transformation pipelines using Python, PySpark, Databricks, and Azure services like ADF and Azure Functions.
Greetings from TCS!
We are looking for - Azure Data Engineer(Python, PySpark, Databricks, ADF)
Experience: 6+ Years
Location: Delhi, Pune, Bangalore, Hyderabad
Topic of Evaluation / Skills* -
Python
Databricks
Azure Data Factory
Pyspark
Pandas,NoSQL
Nummy
Job Requirements*
The successful candidate will be responsible for
- Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage efficiently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.
Key Responsibilities*
- Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
- Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
- Manage effeciently large dataset.
- Manage SQL database - Postgresql or MongoDB.
- Implement and maintain complex data calculation formula.
- Open to collaborate with Software Engineers.
- Participate in code reviews, design discussions, and software planning.
- Contribute to automation, testing, and deployment processes.