Azure, DataBricks, Pyspark, Python, SQL
Summary
Develops and debugs data pipelines using Azure, Databricks, PySpark, Python, and SQL for financial services clients.
Azure, DataBricks, Pyspark, Python, SQL\:
- Resource with 8+ Experience in the code skills listed
- Able to write the complex code and fix the issues
- Should have strong problem solving capability
- Collaborate with stakeholders to understand requirements and deliver robust solutions independently
- Responsible for both development and strong expertise to debug and fix any post production issues for their developed code
- Interview ask \: To write optimal code (in Python/pysaprk) in timeboxed period for scenario given (covering data quality, transformation) without AI tool and code to be accurate. To resolve code issue for a bug introduced in sample code
- Strong Expertise in Azure, Databricks, Python, Pyspark, SparkSQL, CI-CD (Jenkins, Github), Obs (Dynatrace),
- Nice to have \: Java, Kafka , Casandra, Microservices, API, Flink, ZeroMQ, Protocol Buffers
- Functional experience of Retail Banking, capital markets, securities processing will be advantage