Data Engineer
Posted
Description
Data Engineer GCP
We are looking for a Mid-Level Data Engineer with hands-on experience in data migration and modernization initiatives, preferably involving SAS to Client Cloud Platform (GCP) migrations. The ideal candidate should have experience designing, developing, and optimizing data pipelines, data integration processes, and cloud-based data solutions.
Required Experience
- 3-6 years of experience as a Data Engineer or related role.
- Experience in large-scale data migration and modernization projects.
- Strong knowledge of ETL/ELT development, data transformation, and data quality validation.
- Experience working with structured and semi-structured data.
- Familiarity with Agile development methodologies.
Technical Skills
Client Cloud Platform (GCP)
- BigQuery
- Cloud Storage
- Dataflow
- Dataproc
- Cloud Composer (Airflow)
- Pub/Sub
- Vertex AI
Programming
- Python
- SQL
- Shell Scripting (nice to have)
Data Engineering & Integration
- ETL/ELT frameworks
- Data modeling (Dimensional and Relational)
- Data quality and reconciliation processes
- API and file-based integrations
Development & Collaboration
- Git
- CI/CD pipelines
- Jira or equivalent Agile tools
Responsibilities
- Design and develop scalable data pipelines on GCP.
- Analyze legacy data processing workflows and support migration initiatives.
- Migrate and modernize SAS-based data assets to GCP-native architectures.
- Perform data reconciliation, testing, and validation activities.
- Collaborate with solution architects, business stakeholders, and development teams to deliver migration and modernization projects.
Skills
Sign in to read and join the discussion.