Data Engineer

We're Hiring: Data Engineer | 10+ Years | Remote

Job Description:

We are looking for a Senior Data Engineer with 10+ years of experience in designing and building enterprise-scale data platforms and pipelines. The ideal candidate should have strong expertise in Python, PySpark, SQL, Apache Spark, Databricks, Airflow, AWS/Azure, ETL/ELT development, streaming data processing, CI/CD, and Data Lake/Lakehouse architectures.

Key Responsibilities:

• Design and develop scalable ETL/ELT pipelines using Python, SQL, and PySpark.
• Build batch and real-time data processing solutions.
• Develop and optimize Spark-based data platforms on AWS/Azure.
• Implement workflow orchestration using Airflow, MWAA, AWS Glue, and Databricks Workflows.
• Build data quality, lineage, observability, and governance frameworks.
• Implement CI/CD pipelines and DevOps best practices for data platforms.
• Support Data Lakes, Lakehouse architectures, analytics, and AI/ML workloads.
• Collaborate with Data Architects, Data Scientists, and business stakeholders.

for Quick Response Share CV on diksha.raut@siroclinpharm.com