Data Engineer
NewBe an early applicantMust-Have
Min 6+ years experience in implementing projects in Azure stacks
Experience with Azure Databricks, Data Factory
Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
Experience in Python PySpark
Experience in data ingestion, curation and transformation using spark
Good-to-Have
Excellent verbal and written communication and interpersonal skills
Ability to work independently and within a team environment.
SN Responsibility of / Expectations from the Role 1
Provide Azure stacks (ADB and ADF) technology expertise for solution design and technical implementation 2
Design, code, unit test, and code review iterative improvements to platform 3
Ensure adherence to sound architecture 4
Build and maintain the Infrastructure for data products, including data pipelines, storage systems, and processing engines. 5
Ensures the scalability, reliability, and performance of data infrastructure, optimizing resource utilization and minimizing downtime. 6
Collaborate with Data Architects and Domain Data Stewards to design and implement data solutions that align with business requirements and Data Mesh principles.
SN Responsibility of / Expectations from the Role 1
Provide Azure stacks (ADB and ADF) technology expertise for solution design and technical implementation 2
Design, code, unit test, and code review iterative improvements to platform 3
Ensure adherence to sound architecture 4
Build and maintain the Infrastructure for data products, including data pipelines, storage systems, and processing engines. 5
Ensures the scalability, reliability, and performance of data infrastructure, optimizing resource utilization and minimizing downtime. 6
Collaborate with Data Architects and Domain Data Stewards to design and implement data solutions that align with business requirements and Data Mesh principles.