Senior Data Engineer
Summary
Senior Data Engineer in Mumbai building and maintaining scalable ETL pipelines and data warehouses/lakes for retail data (sales, inventory, customer behavior), integrating POS, ERP, and CRM systems. Core stack includes SQL, Python/Scala, AWS/Azure/GCP, Snowflake/Redshift/BigQuery, Airflow, and Kafka/Spark Streaming.
About the Role:
We are seeking a skilled and detail-oriented Data Engineer with 6 years of experience, preferably in
the retail sector, to join our growing data team. You will be responsible for building and maintaining
robust data pipelines, integrating data from various retail systems (POS, CRM, ERP), and enabling
data-driven decision-making across the organization.
Key Responsibilities:
- Design, develop, and maintain scalable ETL pipelines for retail data (sales, inventory, customer
behavior).
- Integrate data from internal systems (e.g., POS, ERP, CRM) and external sources (e.g., market
trends, vendor feeds).
- Build and manage data warehouses and data lakes using platforms like Snowflake, Redshift, or
BigQuery.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and
deliver solutions.
- Ensure data quality, integrity, and security across all data platforms.
- Optimize query performance and data retrieval for reporting and analytics.
- Implement data governance and compliance best practices.
- Automate data workflows and monitor pipeline health using tools like Apache Airflow, dbt, or Luigi.
- Support real-time analytics and streaming data using tools like Kafka or Spark Streaming.
Required Skills & Qualifications:
- Bachelor?s or Master?s degree in Computer Science, Data Engineering, or related field.
- 7+ years of experience as a Data Engineer, preferably in the retail or e-commerce domain.
- Strong programming skills in SQL, Python, or Scala.
- Experience with cloud platforms (AWS, Azure, or GCP).
- Proficiency in data modeling, data warehousing, and ETL development.
- Familiarity with big data tools (Hadoop, Spark, Hive).
- Understanding of retail KPIs like sales trends, customer segmentation, inventory turnover, etc.
- Excellent problem-solving, communication, and collaboration skills.
Preferred:
- Experience with CI/CD pipelines, version control (Git), and DevOps practices.
- Exposure to machine learning pipelines or recommendation systems in retail.
- Knowledge of data visualization tools like Power BI, Tableau, or Look
Skills
- Airflow
- Analytics
- AWS
- Azure
- Big Data
- BigQuery
- CI/CD
- Cloud
- CRM
- Data Engineering
- Data Governance
- Data Lake
- Data Modeling
- Data Pipelines
- Data Quality
- Data Visualization
- Data Warehousing
- dbt
- DevOps
- E-commerce
- ERP
- ETL
- GCP
- Git
- Hadoop
- Hive
- Kafka
- Machine Learning
- Power BI
- Python
- Recommendation Systems
- Redshift
- Scala
- Snowflake
- Spark
- SQL
- Tableau
- Version Control