Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Smart IMS

Lead Data Engineer - Big Data

Posted Updated

Description

Role Overview :

We are looking for a Lead Data Engineer to join one of the largest E-commerce platform companies. You will lead engineering teams and drive architecture decisions for large-scale distributed data platforms.

Required Qualifications :

- 7-10 years of experience in Data Engineering or Big Data.

- 2+ years of experience leading engineering teams or technical projects.

- Experience building large-scale distributed data platforms.

Technical Skills :

- Programming : Scala, SQL

- Big Data : Apache Spark (Core, SQL, Streaming), Apache Flink

- Cloud : GCP (DataProc, BigQuery, GCS) or AWS/Azure

- Containerization : Kubernetes, Docker

- Lakehouse : Apache Iceberg, Apache Hudi, Delta Lake

- Strong knowledge of Data Warehousing, Dimensional Modeling, Data Lakes, and Lakehouse Architecture.

Leadership Skills :

- Strong leadership, mentoring, stakeholder management, and communication skills.

- Ability to drive architecture decisions, manage cross-functional teams, and deliver complex engineering programs.

- Strong analytical, problem-solving, and project management capabilities.

Education :

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.

Preferred Qualifications :

- Experience with Apache Airflow, Argo Workflows, or Azkaban.

- Exposure to CI/CD, MLOps, Feature Stores, and real-time analytics platforms (Druid, ClickHouse, HBase).

- Experience in large-scale eCommerce, Retail, FinTech, or Internet organizations.

- Knowledge of GenAI, LLMs, and Agentic AI is a strong advantage.

Skills

What Lead Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →