Data Engineering & Analytics
Description
Work Timings: 10:15 AM - 7:15 PM
Working Days: 5 Days a Week - We Chose Balance Over the Industry Norm
Work Mode: Work from Office
Location: Marol, Mumbai
We are looking for a hands-on Lead - Data Engineering & Analytics to build and strengthen our organisation's data infrastructure, data architecture, and analytics ecosystem.
The role will be responsible for designing scalable data architectures, building ETL/ELT pipelines, integrating data across multiple business systems, and establishing a centralised and reliable source of truth across the organisation.
A key expectation from this role is the ability to design data models and database structures from scratch, ensure data consistency across systems, and implement AI-driven solutions that improve business processes and decision-making.
The ideal candidate should have strong expertise in SQL, PostgreSQL, data modelling, data engineering, and ETL pipeline development, along with the ability to independently own and execute complex technical projects.
Key ResponsibilitiesData Architecture & Modelling:
- Design scalable data architectures and relational data models from scratch to support organisation-wide data requirements.
- Define entities, relationships, data structures, constraints, and data standards across multiple business systems.
- Design and maintain centralised databases and data warehouses to establish a reliable source of truth.
- Develop data models that ensure consistency, accuracy, scalability, and accessibility across different systems.
- Identify data duplication, inconsistencies, and structural gaps and implement solutions to improve data quality.
- Define data architecture standards and ensure that data structures can support future business and technology requirements.
Data Engineering & ETL/ELT Pipelines:
- Design, develop, and maintain scalable ETL/ELT pipelines to integrate data from CRM, websites, LMS, marketing platforms, and other business systems.
- Build automated data ingestion and transformation processes using SQL, Python, APIs, and appropriate integration tools.
- Implement incremental data loads, data validation, deduplication, error handling, retries, and pipeline monitoring.
- Establish centralised data processing workflows to maintain historical records and ensure data consistency across systems.
- Optimise pipeline performance, processing efficiency, and infrastructure costs.
- Troubleshoot data integration issues and ensure the reliability of data flows across business applications.
Source of Truth & Data Management:
- Establish a centralised and standardised source of truth across organisational data systems.
- Integrate data from multiple sources and define consistent data structures, business definitions, and metrics.
- Ensure data accuracy, completeness, consistency, and reliability across systems.
- Design processes for data reconciliation, historical data management, and quality monitoring.
- Identify opportunities to eliminate manual data handling and disconnected data sources.
- Build a scalable data foundation that supports reporting, analytics, automation, and AI initiatives.
Reporting & Business Intelligence:
- Develop reliable reporting datasets and analytical data models for BI platforms such as Looker Studio, Power BI, or Tableau.
- Consolidate existing reports and establish standardised business metrics across departments.
- Translate business requirements into structured data models and actionable reports.
- Identify and resolve discrepancies across reports and improve the accuracy of business metrics.
- Automate manual reporting processes and improve data accessibility for stakeholders.
- Enable leadership and business teams to make informed decisions through reliable data.
AI Implementation & Advanced Analytics:
- Identify and implement AI-driven solutions to improve business processes, data management, and operational efficiency.
- Build AI-enabled workflows and integrate LLMs, APIs, and other AI technologies into existing business systems.
- Explore and implement intelligent data processing, automated insights, and AI-assisted reporting solutions.
- Develop or contribute to predictive analytics use cases such as lead conversion prediction, forecasting, customer segmentation, and trend analysis.
- Evaluate emerging AI tools and technologies and translate relevant opportunities into practical business implementations.
- Work with business stakeholders to identify high-impact AI use cases and take ownership of their technical implementation.
Technical Ownership & Collaboration:
- Independently own data engineering and analytics projects from requirement gathering to implementation.
- Collaborate with backend developers and business teams to ensure effective data integration across applications.
- Review data models, SQL queries, ETL pipelines, and technical implementations to maintain quality standards.
- Document data architecture, pipeline logic, data definitions, and technical processes.
- Guide and mentor team members wherever required and ensure effective knowledge sharing.
- Work closely with technology, marketing, sales, finance, and academic teams to understand and address their data requirements.
RequirementsRequired Skills & Qualifications:
- 3-6 years of relevant experience in Data Engineering, Data Architecture, Analytics Engineering, or related technical roles.
- Strong hands-on expertise in SQL and PostgreSQL.
- Proven experience designing database structures, data models, and data architectures from scratch.
- Strong understanding of relational database concepts, ER modelling, normalisation, indexing, and data relationships.
- Hands-on experience building and maintaining ETL/ELT pipelines and integrating multiple data sources.
- Strong understanding of data warehousing, data modelling, data transformation, and data quality management.
- Experience establishing centralised data repositories and reliable sources of truth.
- Practical experience implementing AI-enabled solutions, LLM integrations, or AI-driven business workflows.
- Ability to independently design, develop, troubleshoot, and implement complex data engineering solutions.
- Strong problem-solving skills and the ability to translate business requirements into scalable technical solutions.
Good to Have:
- Experience designing application databases for business applications such as LMS, CRM, ERP, or student management systems.
- Understanding of OLTP databases, transactional integrity, database migrations, and backend application integration.
- Python for data processing, scripting, and pipeline development.
- Experience with BigQuery, Snowflake, Redshift, or similar data warehouse platforms.
- Familiarity with Airflow, dbt, Dagster, or other orchestration and transformation tools.
- Experience with Looker Studio, Power BI, or Tableau.
- Knowledge of REST APIs, cloud infrastructure, and database deployment practices.
- Experience with predictive modelling, machine learning, forecasting, or advanced analytics.
- Familiarity with Spring Boot, Java, or other backend application frameworks.
- Previous experience leading or mentoring data engineers and analysts.
Expected Outcomes:
- A well-defined and scalable data architecture built to support organisational requirements.
- Database structures and data models designed from scratch wherever required.
- A centralised and reliable source of truth integrating data across business systems.
- Automated, monitored, and maintainable ETL/ELT pipelines.
- Improved data quality, consistency, and accessibility across the organisation.
- Standardised reporting datasets and business metrics across departments.
- Successful implementation of practical AI-driven solutions and intelligent workflows.
- A scalable data foundation supporting future analytics, automation, and AI initiatives.
Skills
- Accessibility
- AI
- Airflow
- Analytics
- API
- Automation
- BigQuery
- Business Intelligence
- Cloud
- CRM
- Dagster
- Data Engineering
- Data Ingestion
- Data Modeling
- Data Quality
- Data Reconciliation
- Data Warehousing
- dbt
- ELT
- ERP
- ETL
- Java
- LLM
- Looker
- Looker Studio
- Machine Learning
- PostgreSQL
- Power BI
- Predictive Analytics
- Predictive Modeling
- Python
- RDBMS
- Redshift
- REST
- Snowflake
- Spring
- SQL
- Tableau
Sign in to read and join the discussion.