Data Engineer
Posted
Description
About the Company
Not specified.
About the Role
Position / Role: Data Engineer
Responsibilities
- Responsibility of / Expectations from the Role
- Develop and orchestrate automated ingestion and transformation pipelines (batch and streaming) across source systems including SAP, LIMS and MES.
- Implement modular, testable transformation logic in SQL and Python, following the medallion/layered pattern into the Roche PT Common Data Layer.
- Operationalize pipelines through CI/CD, version control and automated deployment to ensure environment stability and reproducibility.
- Embed data-quality, lineage and monitoring controls (freshness, completeness, accuracy) to sustain a single source of truth.
- Ensure all pipelines are compliant-by-design, honoring ALCOA+ principles and audit-trail requirements under 21 CFR Part 11 / EMA
- Designs, builds and maintains robust, high-velocity data pipelines that integrate and process data reliably across Roche PT's global, GxP-regulated environment. Optimises data flows to reduce latency while preserving the integrity of complex, cross-functional datasets feeding data products such as DPM, Batch Release Cockpit and APQR.
Qualifications
- Not specified.
Required Skills
- Required Technical Skill Set
- Apache Airflow (orchestration)
- Snowflake (cloud data platform)
- dbt (transformation / modelling)
- Talend (data integration)
- Amazon S3 (data lake storage)
- GitLab (source control & CI/CD)
- Collibra (governance / lineage)
- Desired Competencies (Technical/Behavioral Competency)
- Must-Have (Ideally it should not be more than 3-5)
- Core Skills & Competencies
- Advanced SQL and Python for data engineering
- ELT/ETL pipeline design & data modelling (dimensional / medallion)
- Workflow orchestration & scheduling
- CI/CD, Git branching & automated testing
- Data quality, lineage & observability
- Performance tuning & cost optimization
- Technology & Tools
- Apache Airflow (orchestration)
- Snowflake (cloud data platform)
- dbt (transformation / modelling)
- Talend (data integration)
- Amazon S3 (data lake storage)
- GitLab (source control & CI/CD)
- Collibra (governance / lineage)
- Technical Development (R&D)
- Clinical trial data, Process development, Active ingredient data, Knowledge graphs, Substance properties.
Skills
Sign in to read and join the discussion.