Azure DE - ADB, Python, PySpark, SQL + BI
Summary
Designs, codes, and debugs data pipelines in Azure Databricks using Python, PySpark, and SQL, while mentoring junior team members and collaborating with stakeholders.
Azure DE - ADB, Python, PySpark, SQL + BI\:
- Able to write the complex code and fix the issues
- Should have strong problem solving capability
- Collaborate with stakeholders to understand requirements and deliver robust solutions independently
- Leads \: Role is 70% of time in Design, Architect, Coding and 30% of time in team mentoring, guidance, coordination
- Responsible for both development and strong expertise to debug and fix any post production issues for their developed code
- Interview ask \: To write optimal code (in Python/pysaprk) in timeboxed period for scenario given (covering data quality, transformation) without AI tool and code to be accurate. To resolve code issue for a bug introduced in sample code
- Strong Expertise in Azure, Databricks, Python, Pyspark, SparkSQL, CI-CD (Jenkins, Github), Obs (Dynatrace),
- Nice to have \: Exposure to PowerBI dashboard development
- Functional experience of Retail Banking, capital markets, securities processing will be advantage