Senior Data Engineer
Posted Updated
Description
We are looking for an experienced Data Engineer / Deployment Engineer with strong expertise in Python, Advanced SQL, ETL/ELT and Data Integration to build and manage industrial data pipelines using Cognite Data Fusion (CDF).
The candidate will be responsible for data ingestion, transformation, contextualization, data quality validation and data modeling across enterprise and industrial data sources.
Mandatory Technical Skills:
- Python - Intermediate to Advanced
- Advanced SQL and Query Optimization
- ETL/ELT and Data Integration
- Data Ingestion and Transformation
- Data Profiling, Cleansing and Validation
- Data Modeling and Metadata Management
- Cloud Platforms - AWS / Azure / GCP
- Industrial Data Systems - SCADA / PI Systems / SAP / MES / Historians (at least one)
- Git and GitHub
Key Responsibilities:
- Design and deploy end-to-end data ingestion pipelines.
- Integrate data from SQL databases, SAP, SCADA, PI Systems and other industrial sources.
- Develop Python scripts for data transformation and automation.
- Perform data profiling, validation and quality checks.
- Design and maintain data models, entities and relationships.
- Support cloud-based deployments and troubleshoot pipeline issues.
- Collaborate with clients, developers and solution architects.
Preferred Skills:
- Cognite Data Fusion (CDF)
- OptiFlow and OptiSite
- MDM and Data Governance
- DevOps and CI/CD
- Energy, Manufacturing or Industrial domain experience
Candidate Requirements:
- Minimum 5 years of relevant experience.
- Strong analytical and problem-solving skills.
- Good communication and stakeholder management.
Skills
Sign in to read and join the discussion.