GCP Data Engineer (BigQuery)-GTCFD-3001

Data Migration & Integration: Design, build, and deploy robust data pipelines to migrate large-scale datasets from SAP environments to GCP.

Transformation Engineering: Translate and recreate complex SAP business logic, transformations, and data models into highly efficient BigQuery SQL and scripts.

Pipeline Optimization: Manage and optimize Change Data Capture (CDC) processes, delta loads, and implement efficient data merging strategies (e.g., MERGE vs. INSERT) for large daily record volumes.

Version Control & CI/CD: Utilize GitLab for source code management, code reviews, and automating CI/CD pipelines for data deployments.

Performance Tuning: Monitor, troubleshoot, and optimize BigQuery performance, utilizing clustering, partitioning, and query optimization best practices.

Collaboration: Work closely with data architects, analysts, and SAP subject matter experts to ensure data accuracy, quality, and alignment with business requirements.