Senior ETL & Python Developer - Data Merger Project
Summary
Design and build ETL pipelines in Python to merge banking data from Oracle, SQL Server, APIs and flat files into a target data warehouse.
Senior ETL & Python Developer - Data Merger Project
Luxoft Amsterdam, North Holland, Netherlands
Our client is an EU subsidiary of a Global Financial Bank working in multiple markets and asset classes.
We are seeking a highly skilled Senior ETL & Python Developer to support a Data Merger Project for a leading bank. The ideal candidate will have extensive experience in ETL development, Python programming, and data migration strategies within a banking environment. This role involves designing and implementing ETL pipelines to facilitate the seamless integration of financial data from multiple sources into the bank's target data warehouse.
Responsibilities
- ETL Development & Data Integration
- Design, develop, and optimize ETL workflows and data pipelines to support the migration and consolidation of banking data.
- Extract, transform, and load (ETL) data from heterogeneous data sources (Oracle, SQL Server, flat files, APIs, cloud storage).
- Ensure data integrity, quality, and consistency throughout the migration process.
- Python Development & Automation
- Develop and maintain Python scripts for data extraction, transformation, validation, and automation.
- Implement data processing and transformation logic using Pandas, PySpark, or SQLAlchemy.
- Work with APIs to integrate external data sources where required.
- Participate in the data mapping, cleansing, and reconciliation process to ensure accurate data consolidation.
- Troubleshoot and resolve data migration issues, performance bottlenecks, and discrepancies.
- Database & Performance Optimization
- Work with relational databases (Oracle, SQL Server, PostgreSQL) to optimize queries and improve data processing speed.
- Implement partitioning, indexing, and caching strategies for large-scale data processing.
- Ensure the security and compliance of banking data during migration.
- Collaborate with business analysts, data engineers, and IT teams to understand requirements and define ETL strategies.
- Document ETL processes, data transformation rules, and architecture for future reference.
- Support testing and validation phases by working closely with QA teams.
Skills
Must have
- 5+ years of experience in ETL development, data migration, and data integration.
- Strong expertise in Python programming for data processing and automation.
- Hands-on experience with ETL tools such as Informatica, Talend, Apache NiFi, or custom Python-based ETL solutions.
- Solid understanding of banking and financial data structures, including transactions, customer records, regulatory reporting, and risk data.
- Strong SQL skills, with experience in Oracle, SQL Server, or PostgreSQL.
- Experience handling large-scale data processing, performance tuning, and debugging complex ETL workflows.
- Familiarity with cloud-based ETL solutions (in particular Azure Fabric) is a plus.
- Knowledge of data governance, lineage, and compliance frameworks in the banking sector.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, Finance, or a related field.
- Certifications in Python, ETL tools, or cloud-based data solutions.
Nice to have
- Background in SSIS / SSAS / SSRS
- Experience in big data technologies (Hadoop, Spark, Databricks) is a plus.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting