Technical Manager, Data Engineering ( AI / Pyspark / BigData)

Job Overview


Essential Functions

• Manages a team of professional-level employees.
• Develops and communicates plans and priorities to meet team performance and results requirements.
• Establishes team processes, goals, and procedures and tracks performance.
• Informs and influences decision-making at the management level.
• Provides coaching and guidance on job performance and career development to direct reports.

Qualifications

• Bachelors Degree Computer Engineering, Computer Science or related field Req
• 10-12 years+ experience in software development

AI, Data Engineering Technology Leadership - Key Responsibilities

• Lead the strategy, architecture, and delivery of AI/Generative AI solutions to automate complex business processes.
• Design and implement AI assistants, intelligent agents, RAG-based solutions, and conversational AI platforms.
• Drive AI adoption and continuous improvement through feedback loops, model optimization, and user-centric enhancements.
• Architect scalable cloud-based data platforms leveraging modern analytics and big data technologies.
• Lead ETL/ELT, data integration, transformation, reporting, and enterprise data management solutions.
• Establish data quality, validation, testing, and reconciliation frameworks to ensure trusted business insights.
• Oversee end-to-end software development lifecycle activities, from requirements and architecture through deployment and support.
• Develop reusable frameworks, accelerators, and automation assets to improve delivery efficiency and operational excellence.
• Champion technology modernization through cloud-native architectures, microservices, and automation-driven solutions.
• Lead and mentor global engineering and analytics teams while managing delivery, stakeholder engagement, talent development, and technology outcomes aligned to business KPIs.
• Lead executive presentations, solution demonstrations, and business reviews.

Technical Skills

• Hadoop / Cloudera Ecosystem
• Data Warehousing
• SQL
• Python (must Have)
• Artificial Intelligence (AI) Generative AI
• Retrieval-Augmented Generation (RAG)
• Multi-Agent Architectures
• Prompt Engineering
• Machine Learning NLP

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.