Associate, Data Engineer
Summary
Builds and maintains ETL/ELT pipelines in Microsoft Fabric to ingest and transform logistics data, ensuring reliable reporting and analytics for warehouse operations.
Junior Data Engineer
The Junior Data Engineer supports the development, maintenance and continuous improvement of Starlinks data platform by building and maintaining reliable data pipelines that enable business reporting and data-driven decision‑making across logistics and warehousing operations. Working closely with experienced Data Engineers, the role is responsible for onboarding new source systems, developing and supporting Bronze‑to‑gold data pipelines and contributing to the ongoing enhancement of an established data architecture. Through hands‑on delivery, collaboration, mentorship and code reviews, the role helps ensure the availability of high‑quality, scalable and reliable data solutions while building technical expertise and engineering best practices.
Main Job Responsibilities
- Build and maintain ETL/ELT pipelines to ingest data from operational source systems (APIs, file drops, databases) into the Microsoft Fabric data platform.
- Transform raw data through bronze, silver and gold layers following the established medallion architecture.
- Write, optimize and maintain SQL and Python/PySpark code for data transformation and processing.
- Apply data quality checks, validation rules and change detection patterns across ingestion pipelines.
- Follow and contribute to team standards for naming conventions, schema design, documentation and Git workflows.
- Support pipeline monitoring, alert configuration and issue resolution using Microsoft Fabric Activator.
- Assist with onboarding new data sources into the enterprise data platform.
- Troubleshoot and resolve data pipeline failures, performance issues and data quality incidents.
- Collaborate with Data Engineers, Data Analysts and business stakeholders to understand data requirements and deliver reliable data solutions.
- Participate in code reviews, testing and deployment activities to ensure high‑quality, maintainable solutions.
- Document data pipelines, source systems, transformation logic and technical processes to support ongoing maintenance and knowledge sharing.
- Support the continuous improvement of data engineering processes, automation and platform performance.
- Ensure data solutions comply with organisational data governance, security and engineering best practices.
- Participate in Agile ceremonies including sprint planning, daily stand‑ups and retrospectives, contributing to team delivery and continuous improvement.
Qualifications
- Bachelor's degree in computer science, Information Systems, Engineering, or a related field.
- Working knowledge of SQL: ability to write queries, joins and transformations without looking up syntax.
- Basic understanding of data pipeline concepts (ingestion, transformation, loading).
- Familiarity with at least one cloud data platform (Azure, AWS or GCP).
- Willingness to learn; hands‑on exposure or certification in Microsoft Fabric is a strong plus, not a requirement.
- Good communication skills: asks questions when blocked rather than making assumptions.