Lead / Sr Data Engineer Remote / Bangalore

Hi,
We are having opening for Lead / Sr Data Engineer- Remote / Bangalore



Job Summary We are seeking a Lead / Senior Data Analytics Engineer to drive the design, development, and delivery of enterprise data platforms. You will act as a technical authority for data pipelines, data warehousing, and big data architecture while providing technical guidance to junior/mid-level team members. In addition to core data engineering expertise, experience leveraging AI / GenAI to accelerate data modeling, pipeline automation, and code generation is highly desirable.

Working Days: Monday Friday
Job Timing: 9AM 6PM



Position / DesignationLead / Sr Data Engineer - Remote / Bangalore


QualificationBachelor's degree in Computer Science, Information Technology, Engineering, or a related technical fieldYears of Experience7+ Years
Team leading exp required Permanent / Contract (If contract, period ?)Permanent Full TimeOffice / Remote / Hybrid 4th Floor, 04-108, Vaishnavi Signature, 78/9, Outer Ring Road, BellandurNumber of post2GenderMale / FemaleAnnual CTC / Salary25 L to 35 L p.a.
Selection Process1- Total 3 Technical round
2- 2 rounds evaluation with LV (we can plan to take this together based on panel availability) & 1 with client Job Role & Responsibility Architecture & Design: Design and architect scalable, high-throughput, and reliable end-to-end data systems (databases, warehouses, and big data platforms) adhering to data governance, privacy, and compliance standards.
Lead & Technical Delivery: Drive the end-to-end technical delivery of complex data initiatives. Translate broad business requirements into robust, production-grade technical designs.
Pipeline Engineering: Lead the implementation and optimization of complex ETL/ELT data pipelines using SQL, PySpark, Hive, and Airflow across large-scale distributed environments.
Team Leadership & Mentorship: Provide technical leadership, code reviews, and architectural guidance to junior and mid-level data engineers to enforce best practices and quality standards.
Stakeholder Management: Collaborate with business leadership, product managers, and enterprise architects to align data strategies with overall organization goals.
AI & Innovation: Leverage AI / GenAI tools to streamline pipeline generation, query optimization, automated test suite generation, and metadata management.
Skills

• Primary Skills: Advanced PySpark, Advanced SQL, Data Architecture & Design, Big Data Ecosystem (Hadoop, HDFS, Hive), Airflow / Workflow Orchestration, Data Warehousing (Snowflake / Redshift / BigQuery).

• Secondary Skills: Enterprise Cloud Platforms (AWS / GCP / Azure), CI/CD & DevOps for Data Platforms, GenAI / AI-driven pipeline automation, Data Governance & Quality Frameworks, Streaming (Kafka / Spark Streaming).

Joining DateNeed Immediate to 1 Month