Data Architect / Team Lead

Job Title: Data Architect / Team Lead

Company: Jnanasethu IT Labs Private Limited
Location: Bengaluru, Karnataka, India
Experience: 3-5 years
Employment Type: Full-time

Job Description

We are looking for an experienced Data Architect / Team Lead with strong hands-on expertise in PySpark and SQL, along with the ability to lead developers, review code, troubleshoot technical issues, and guide the team in implementing effective data solutions.

The ideal candidate should have a good understanding of data architecture, data transformation, and data pipeline development, along with familiarity with Tableau and its data requirements for dashboard development. The candidate will be responsible for ensuring data quality, optimizing query performance, conducting pull request reviews, and guiding developers in building reliable and scalable data solutions.

Key Responsibilities

• Design, develop, and maintain data pipelines and data transformation solutions using PySpark and SQL.
• Review pull requests, validate code quality, and ensure adherence to coding standards and best practices.
• Troubleshoot complex code issues, identify root causes, and provide effective technical solutions.
• Provide technical guidance, mentorship, and support to developers.
• Understand business and reporting requirements and translate them into appropriate data models and datasets.
• Work closely with Tableau developers to prepare, structure, and optimize data for dashboard development.
• Ensure data accuracy, consistency, quality, and performance across data processing workflows.
• Optimize PySpark jobs and SQL queries for performance and efficiency.
• Review data architecture and recommend improvements to data processing and transformation workflows.
• Collaborate with business analysts, data engineers, BI developers, and other stakeholders to deliver reliable data solutions.
• Support technical discussions, problem-solving, code reviews, and implementation of data engineering best practices.

Required Skills and Qualifications

1. PySpark and Data Engineering

• Strong hands-on experience with PySpark and distributed data processing.
• Understanding of data transformation, data pipelines, and large-scale data processing.
• Ability to troubleshoot and optimize PySpark jobs.

2. SQL and Database Management

• Strong proficiency in SQL, including complex queries, joins, aggregations, and data transformations.
• Experience in query optimization and performance tuning.
• Ability to troubleshoot SQL issues and review SQL code written by developers.

3. Code Review and Technical Leadership

• Experience conducting pull request reviews and ensuring code quality.
• Ability to identify coding issues, recommend improvements, and troubleshoot complex problems.
• Experience guiding developers and providing technical direction to the team.
• Strong analytical and problem-solving skills.

4. Tableau and Data Visualization

• Good understanding of how Tableau connects to and consumes data.
• Ability to identify the datasets, data models, and transformations required to support dashboards and reports.
• Understanding of data preparation, aggregation, and performance considerations for BI reporting.
• Ability to collaborate effectively with Tableau developers and translate dashboard requirements into suitable data solutions.

5. Data Architecture and Modeling

• Understanding of data modeling, data structures, and data transformation principles.
• Ability to design efficient datasets to support analytical and reporting requirements.
• Knowledge of data quality, consistency, and performance optimization.

Ideal Candidate Profile

• Strong technical expertise in PySpark and SQL.
• Ability to review code, troubleshoot technical issues, and guide developers effectively.
• Good understanding of data requirements for Tableau dashboards and reporting.
• Strong problem-solving, communication, and collaboration skills.
• Ability to translate business reporting requirements into efficient data solutions.
• A proactive approach to code quality, performance optimization, and continuous improvement.

Join Jnanasethu IT Labs Private Limited and contribute to building reliable, scalable, and data-driven solutions.