Data Engineer
Tata Consultancy Services Data Engineer
Summary
Develop and maintain Azure Data Factory pipelines and Azure Data Bricks notebooks, migrate ETL workloads to Data Lake, and support data lake governance frameworks using Azure Data technologies, PySpark, and PL/SQL.
Job Description
**mandatory
SN
Required Information
Details
Role**
Azure Data Engineer
Required Technical Skill Set**
Azure Data Lake Storage-Gen 2/SQL Db, Azure Data Bricks, Azure Data Factory, Storage Account/Key vault, Azure DevOps
Languages: PySpark, PL/SQL
Desired Experience Range**
6 to 12 Years
Location of Requirement
Chennai
Desired Competencies (Technical/Behavioral Competency)
Must-Have**
(Ideally should not be more than 3-5)
Azure Data technologies – PaaS components (ADF, ADB, Data Lake)
PL/SQL. Hands-on Azure Data technologies experience for atleast 2+ years
Good-to-Have
1. Good communication skills
2. AzureDevOps
3. SQL Server
4.
5.
SN
Responsibility of / Expectations from the Role
- Develop & maintain Azure Data Factory(ADF) Pipelines and Azure Data Bricks(ADB) notebooks (using PySpark)
- Migrate RDBMS/traditional ETL workloads into Data Lake/ELT workloads
- Support and maintain data lake and SQL Server control/governance frameworks (including templates and directory structures)
- Analyze, design and implement fixes/change requests/enhancements pertaining to Azure Data Lake and data mart solutions
- Able to work directly with client stakeholders
- Incident handling and resolution
- Flexible to work in Cologne time zone