This is a remote position.

Job Description – Senior Data Engineer

Role Overview

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate will have strong expertise in big data technologies, cloud-based data engineering, and modern data lakehouse architectures.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Databricks
  
• Build and manage data ingestion and orchestration workflows using Azure Data Factory (ADF)
  
• Perform complex data transformations and optimization using SQL and PySpark
  
• Implement and manage Delta Lake for reliable, high-performance data storage
  
• Develop and maintain data models (fact and dimension tables) for analytics and reporting
  
• Handle large-scale data processing, ensuring performance, scalability, and reliability
  
• Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders
  
• Ensure data quality, consistency, and governance across pipelines
  

Required Skills

• Strong experience in PySpark and Databricks
  
• Hands-on experience with Azure Data Factory (ADF)
  
• Proficiency in SQL and data transformation techniques
  
• Experience with Delta Lake and Lakehouse architecture
  
• Good understanding of data modeling (fact/dimension design)
  
• Experience handling large-scale data processing
  

Requirements

Preferred Qualifications (Nice to Have)

• Experience with streaming frameworks (Kafka / Structured Streaming)
  
• Knowledge of Azure ecosystem (ADLS, Key Vault, Synapse)
  
• Familiarity with data governance and security practices
  
• Experience in performance tuning and optimization in Spark