Azure Data Engineer

Job Details:

• Organization: Mphasis
• Location: PAN India(Any Mphasis Office)
• Job Type: Contract To Hire
• Payroll : Absika Solutions
• Work Mode: Hybrid

Candidate Details Required:
Full Name As Per Aadhaar :

Total Experience:

Relevant Experience:

Current CTC:

Expecting CTC:

Notice Period:

Alternate No:
Alternate Mail ID:

Reason for job change:

Reason for Relocation:

Location: (please confirm):

PAN Number:

Job Description:

Core Responsibilities

• Design and implement scalable data platforms and pipelines using Azure Databricks, Apache Spark, Delta Lake, and MLflow.
• Lead the migration of legacy data platforms to modern Lakehouse architecture.
• Develop and optimize batch and streaming data pipelines for data ingestion, transformation, and analytics.
• Establish and enforce standards for data governance, data quality, security, and compliance.
• Collaborate with business stakeholders and technical teams to align data architecture with business objectives.
• Mentor data engineers and developers on Azure Databricks best practices and scalable data engineering solutions.
• Integrate Databricks with Power BI, Tableau, Apache Kafka, Snowflake, and Azure Data Factory.
• Optimize distributed data processing, Spark jobs, and overall platform performance.
• Implement CI/CD pipelines and DevOps practices for data engineering workflows.

Mandatory Skills

• Strong hands-on experience with Azure Databricks and Microsoft Azure services.
• Proficiency in SQL, Python, Scala, Apache Spark, and PySpark.
• Strong knowledge of Delta Lake, Lakehouse architecture, and distributed computing.
• Experience building and managing batch and real-time data pipelines.
• Hands-on experience with CI/CD, DevOps, and orchestration tools such as Azure Data Factory or Apache Airflow.
• Deep understanding of performance tuning, data security, and data governance.
• Experience with enterprise-scale data platform design and implementation.