Data Engineer

We are looking for a Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The role involves working with large datasets (banking, GST, financial transactions, logs) to enable analytics, fraud detection, and decision-making systems.

You will play a key role in ensuring high-quality, reliable, and secure data flow across systems.

Key Responsibilities

Data Pipeline Development

• • Design and build robust ETL/ELT pipelines
• • Ingest data from multiple sources:
• • Bank statements
• • GST filings
• • APIs, logs, third-party datasets
• • Ensure efficient batch and near real-time processing

Data Architecture & Storage

• • Develop and maintain data lakes / data warehouses
• • Design data models optimized for analytics and investigation use cases
• • Ensure scalability for large-volume datasets

Data Quality & Governance

• • Implement validation, cleansing, and reconciliation processes
• • Ensure consistency between source systems and processed data
• • Maintain audit trails and lineage of data

Performance Optimization

• • Optimize queries and pipelines for speed and cost efficiency
• • Handle high-volume and high-velocity data processing

Collaboration

• • Work closely with:
• • Product team (features & use cases)
• • Data scientists (ML models)
• • Analysts & investigation teams
• • Translate business requirements into data solutions

Security & Compliance

• • Ensure secure handling of sensitive financial data
• • Implement access controls and data protection mechanisms

Required Skills

Technical Skills

• • Strong programming in Python and SQL
• • Experience with ETL tools and data pipelines
• • Hands-on with databases (PostgreSQL, MySQL, etc.)
• • Experience with big data tools (e.g., Spark)
• • Familiarity with cloud platforms (AWS / Azure / GCP)
• • Understanding of data warehousing concepts

Good to Have

• • Experience in financial services / fintech / fraud analytics
• • Knowledge of GST, banking, or transaction data
• • Exposure to real-time data processing (Kafka, streaming)
• • Experience with workflow orchestration tools (Airflow)

Qualifications

• • Bachelors/Masters in Computer Science, Engineering, or related field
• • 58+ years of experience in data engineering or related roles

What We’re Looking For

• • Strong problem-solving mindset
• • Attention to data accuracy and detail
• • Ability to work in a fast-paced, product-driven environment
• • Ownership and accountability

Impact of the Role

• • Enable fraud detection and investigation systems
• • Power analytics for banking and regulatory use cases
• • Build core data backbone for scalable products