Senior Data Engineer
Summary
Luxoft is hiring a Senior Data Engineer to design, build, and optimize enterprise-scale cloud data platforms — developing ELT pipelines, data models, and analytics-ready datasets using Snowflake, Azure Data Factory, DBT, Python, and SQL, with workflow orchestration via Airflow/Prefect/Dagster and CI/CD best practices.
Project description
We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using modern cloud technologies. The role involves building robust ELT pipelines, scalable data models, and analytics-ready datasets leveraging Snowflake, Azure Data Factory (ADF), DBT, Python, and SQL. The ideal candidate will play a key role in enabling data-driven decision making by delivering high-quality, governed, and performant data solutions.
Responsibilities
- Key Responsibilities
- Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
- Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
- Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
- Develop reusable and modular data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
- Automate data ingestion, transformation, and operational processes using Python, Pandas, and PySpark.
- Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
- Establish data quality, governance, monitoring, and CI/CD best practices.
- Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
- Create and maintain technical documentation, deployment procedures, and operational runbooks. Mandatory Skills
- Snowflake Data Warehouse
- Azure Data Factory (ADF)
- DBT
- Python
- Advanced SQL
- Data Modeling (3NF, Star Schema, Snowflake Schema)
- Apache Airflow / Prefect / Dagster
- Cloud Platforms (Azure preferred)
- Git and CI/CD
- Data Quality and Governance Frameworks
- Agile/Scrum Methodology Nice-to-Have Skills
- PySpark
- Databricks
- Microsoft Fabric
SKILLS
Must have
- Mandatory Skills
- Snowflake Data Warehouse
- Azure Data Factory (ADF)
- DBT
- Python
- Advanced SQL
- Data Modeling (3NF, Star Schema, Snowflake Schema)
- Apache Airflow / Prefect / Dagster
- Cloud Platforms (Azure preferred)
- Git and CI/CD
- Data Quality and Governance Frameworks
- Agile/Scrum Methodology
Nice to have
Nice-to-Have Skills • PySpark • Databricks • Microsoft Fabric