Senior Data Engineer / Data Analyst

The Senior Data Engineer / Data Analyst is responsible for designing, implementing, and managing data migration initiatives while ensuring data integrity, traceability, governance, and compliance through robust audit trail mechanisms.

The role acts as a bridge between business stakeholders and technical teams, translating business requirements into scalable data solutions and ensuring successful delivery of data transformation and migration projects.

This role is suitable for a Senior Data Engineer / Data Analyst that combines data migration expertise, audit trail governance, and strong stakeholder engagement capabilities across both business and technical audiences.

Key Responsibilities

Data Migration

Planning and Analysis

• Assess source and target systems to determine migration scope, complexity, and dependencies.
• Conduct data profiling, reconciliation, and quality assessments.
• Define migration strategies, mappings, transformation rules, and validation criteria.
• Prepare migration runbooks and rollback plans.

Migration Delivery

• Design, develop, and execute ETL/ELT processes.
• Perform full, incremental, and delta data migrations.
• Manage cutover activities and post-migration support.
• Ensure data consistency between legacy and target platforms.

Data Validation and Reconciliation

• Validate record counts, balances, transactions, and business rules.
• Investigate and resolve migration discrepancies.

Audit Trails and Data Governance

Audit Framework Design

• Design and implement data lineage and audit tracking mechanisms.
• Ensure traceability from source systems through transformation layers to reporting outputs.
• Maintain detailed audit logs for data movement and changes.

Compliance and Governance

• Support regulatory and governance requirements.
• Implement controls for:
• Data access management
• Data privacy and security

Monitoring & Reporting

• Track migration status, exceptions, and remediation activities.
• Support internal and external audit processes.

Business and Stakeholder Engagement

Requirements Gathering

• Facilitate workshops with business and technical stakeholders.
• Elicit and document:
• Business requirements
• Functional requirements
• Non-functional requirements
• Data requirements
• Reporting requirements

Stakeholder Management

• Act as the primary liaison between business users, project teams, and technology teams.
• Present technical concepts in business-friendly language.
• Manage stakeholder expectations throughout project delivery.

Documentation

• Produce and maintain:
• Business Requirement Documents (BRDs)
• Functional Specifications
• Data Mapping Documents
• Technical Design Documents
• Migration Runbooks

Technical Responsibilities

Data Integration

• Design and implement ETL/ELT pipelines.
• Build scalable and reusable data integration solutions.
• Integrate data from cloud, on-premises, and third-party systems.
• Create conceptual, logical, and physical data models.
• Design data warehouses, data marts, and reporting structures.
• Implement dimensional and relational modelling techniques.

Database Development

• Develop and optimize SQL queries and stored procedures.
• Perform performance tuning and query optimization.
• Maintain database integrity and availability.

Required Technical Skills

Databases

• Microsoft SQL Server
• Oracle

Programming and Scripting

• SQL (Advanced)
• Python
• PowerShell
• Shell Scripting

ETL / Integration Tools

• SSIS
• Informatica
• Talend
• Databricks

Cloud Platforms (advantageous)

• AWS

Reporting and Analytics (advantageous)

• Tableau
• Excel Advanced Analytics

Data Governance

• Metadata Management
• Data Quality Frameworks
• Master Data Management (MDM)
• Audit Controls

Required Business Analysis Skills

• Requirements elicitation and analysis
• Process mapping
• Gap analysis
• Data mapping and transformation analysis
• User story development
• Workshop facilitation
• Business process improvement
• Stakeholder engagement and management
• Change impact assessment

Experience Requirements

• 5+ years in Data Engineering or Data Analytics roles.
• 3+ years delivering data migration projects.
• Experience with large-scale enterprise data migration initiatives.
• Proven experience implementing audit and data lineage solutions.
• Experience engaging both technical teams and business stakeholders.
• Experience documenting business and technical requirements.

Preferred

• Regulatory reporting and compliance exposure.

The successful candidate should be able to produce:

• Data Mapping Specifications
• Source-to-Target Mapping Documents
• Data Quality Assessment Reports
• Audit Trail Frameworks
• Data Validation Reports
• Business Requirements Documents (BRDs)
• Functional Specifications
• Technical Design Documents
• Migration Cutover Plans
• Data Analysis
• Data Governance
• ETL Development
• Cloud Data Platforms (Advantageous)
• Data Quality Management
• Problem-solving mindset
• Analytical thinking
• Influencing and negotiation skills
• Project delivery focus
• Ability to work across technical and business domains

Success Measures

The role will be measured on:

• Data migration accuracy (>99.5%)
• Compliance with governance standards
• Accuracy of data reconciliation and validation results

Skills

Python AWS SQL Tableau SSIS Azure Data Factory Oracle Data Architecture Powershell Data Analysis Microsoft SQL Server Stakeholder Management BRD Analytical Thinking Workshop Facilitation Attention to detail Metadata Management Data Governance Data Quality Management Microsoft Azure Functional Specifications gap analysis master data management shell scripting google cloud platform process mapping business requirements documents informatica talend business process improvement Strong communication skills Databricks MDM Requirements Elicitation and Analysis Data Engineering Cloud Data Platforms ETL Development ADF Stakeholder Engagement and Management data quality frameworks Data Lineage Data Migration Strategy Problem-solving mindset User Story Development Change Impact Assessment Audit Controls Excel Advanced Analytics Data Mapping and Transformation Analysis Influencing and Negotiation Skills Project Delivery Focus Data Mapping Specifications Ability to work across technical and business domains Source-to-Target Mapping Documents Data Quality Assessment Reports Audit Trail Frameworks Data Validation Reports Technical Design Documents Data Lineage Diagrams Migration Cutover Plans Reconciliation Reports