Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Papigen

NewBe an early applicant

Python Data Engineer / Database Developer

Posted Updated

Summary

An experienced Python data engineer / database developer in Chennai who builds automation utilities, reconciliation frameworks, and complex SQL/T-SQL solutions for enterprise data migration, validation, and reporting across Azure data services, data warehouses, and platforms like Murex and FDR.

Role Overview

We are looking for an experienced Python Data Engineer / Database Developer to support enterprise data transformation, migration, reconciliation, validation, and reporting initiatives.

The candidate should have strong hands-on expertise in Python, advanced SQL, data analysis, ETL validation, source-to-target mapping, and data quality management. The role involves working with multiple enterprise platforms, including Murex, FDR, data warehouses, APIs, Azure data services, and reporting systems.

This is a combination of Python development, database engineering, data reconciliation, and migration testing—not a conventional Python application development role.

Key Responsibilities

Python Development & Automation

  • Develop reusable Python applications, libraries, and automation utilities for data extraction, transformation, cleansing, validation, and reconciliation.
  • Use Pandas, NumPy, OpenPyXL, Requests, SQLAlchemy, and PyODBC for data processing.
  • Implement OOP concepts, exception handling, logging, debugging, and unit testing.
  • Optimize Python applications for processing large data volumes.

Data Analysis & Reconciliation

  • Perform source-to-target data profiling and validation across enterprise systems.
  • Identify missing records, duplicates, mismatches, aggregation issues, and transformation defects.
  • Develop reconciliation frameworks, validation rules, and exception reports.
  • Investigate production data discrepancies and perform root cause analysis.

SQL & Database Development

  • Develop complex SQL/T-SQL queries, stored procedures, functions, views, indexes, and database utilities.
  • Work with SQL Server, Azure SQL Database, and data warehouses.
  • Perform query optimization, indexing, execution-plan analysis, and performance tuning.
  • Support database design and dimensional modelling.

Data Mapping & Migration

  • Prepare source-to-target mapping documents and field-level transformation specifications.
  • Define business rules, data dictionaries, metadata, and lineage documentation.
  • Support mock migrations, migration rehearsals, production migration, and post-migration validation.

ETL Testing & Quality Assurance

  • Validate ETL pipelines, transformation logic, inbound/outbound feeds, and data balancing.
  • Perform data, reconciliation, migration, integration, regression, and functional testing.
  • Prepare SQL validation scripts, test cases, expected results, and defect reports.
  • Support UAT and release validation.

Azure & Production Support

  • Support Azure Data Factory, Azure SQL, Azure Functions, Blob Storage, ADLS Gen2, and Key Vault.
  • Work with Azure DevOps for CI/CD and deployment activities.
  • Monitor and troubleshoot Azure data pipelines.
  • Investigate production incidents, resolve data issues, and maintain support documentation.

Mandatory Skills & Experience

  • 5+ years of hands-on Python development experience.
  • Strong Python programming, OOP, modular development, design patterns, debugging, and performance optimization.
  • Practical experience with Pandas, NumPy, OpenPyXL, Requests, SQLAlchemy, and PyODBC.
  • 5+ years of SQL development experience.
  • Strong expertise in SQL/T-SQL, stored procedures, functions, views, indexing, query optimization, and performance tuning.
  • Experience with SQL Server, Azure SQL Database, and data warehouses.
  • Strong data engineering and analysis experience covering:
    • Source-to-target mapping.
    • Data migration and reconciliation.
    • Data profiling and validation.
    • Data quality assessment.
    • Data lineage and governance.
    • Business rule validation and root cause analysis.
  • Hands-on ETL, data, reconciliation, migration, integration, functional, and regression testing experience.
  • Experience preparing test cases, validation scripts, expected results, and test evidence.
  • Ability to work with business users, architects, developers, DBAs, and QA teams.
Preferred Skills

  • Murex and FDR platform experience.
  • Dremio, particularly TViews/CViews.
  • Azure Data Factory and Azure Functions.
  • Azure DevOps and CI/CD.
  • Power BI and data warehousing.
  • Banking, financial services, or capital markets domain experience.
  • Agile methodologies and DevOps practices.

Skills: ci/cd,fdr,datawarehouse,data structures,pandas,sql,numpy,python,azure,murex

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →