Senior Data Engineer (MSP)
Summary
Build and maintain cloud-native AWS data platforms, ETL/ELT pipelines, and data lakes to support analytics and BI use cases.
Senior AWS Data Engineer
We are looking for an experienced Senior AWS Data Engineer with 5+ years’ experience designing, building, and supporting modern cloud-native data platforms.
Responsibilities
- Design, build, and support modern cloud-native data engineering platforms on AWS.
- Develop and maintain scalable ETL/ELT pipelines for data ingestion, transformation, and processing.
- Architect and manage data lake solutions to support structured, semi-structured, and unstructured data.
- Integrate data from multiple sources, including APIs, SaaS platforms, databases, streaming platforms, and file-based systems.
- Apply modern cloud-native design principles, leveraging AWS-managed services where appropriate.
- Ensure data platforms are reliable, scalable, and optimised for performance and cost-efficiency.
- Implement data governance, quality checks, validation processes, and monitoring frameworks.
- Provide operational support, including troubleshooting, issue resolution, and ongoing optimisation of data pipelines.
- Collaborate with analytics and business teams to structure and deliver reporting-ready datasets.
- Support downstream reporting, business intelligence, and advanced analytics use cases.
- Contribute to best practices, standards, and continuous improvement of data engineering processes.
Qualifications
- 5+ years’ experience delivering enterprise data engineering solutions.
- Strong experience designing cloud-native data engineering solutions on AWS.
- Experience designing and supporting modern data lake architectures.
- Experience building scalable ETL/ELT pipelines.
- Experience working with structured, semi-structured, and unstructured data.
- Experience integrating data from APIs, SaaS platforms, databases, streaming platforms, and file-based sources.
- Experience building production-grade, operationally supported data platforms.
- Experience implementing data quality, validation, monitoring, and operational support processes.
- Strong practical experience with AWS technologies, including S3, Lake Formation, Glue, Lambda, Redshift, Athena, DMS, Kinesis, EventBridge, SQS, SNS, Step Functions, IAM, Secrets Manager, KMS, CloudWatch, and CloudTrail.
- Strong experience with SQL, Python, ETL/ELT development, data pipeline design, orchestration, data modelling, source-to-target mapping, data quality frameworks, performance optimisation, and operational troubleshooting.
- Experience with Git, GitHub, CI/CD pipelines, Infrastructure as Code (e.g. Terraform), automated deployments, logging and monitoring, and secure development practices.
- Strong understanding of modern cloud-native architectures, data lake design, analytical data platforms, data governance, metadata management, security, cost optimisation, performance optimisation, and high-availability design.
- Solid understanding of how engineered datasets are consumed for analytics, including designing reporting-ready datasets and supporting BI and analytics teams.
Desired Skills
- Experience with PySpark, Apache Spark, or shell scripting.
- Exposure to analytics tools such as Amazon QuickSight, Power BI, Tableau, or similar platforms.
- Experience with Apache Iceberg, Apache Airflow, dbt, Docker, or Kubernetes.
- Experience with Amazon EMR or Amazon MWAA (Managed Workflows for Apache Airflow).
- Experience with Snowflake, Databricks, or Microsoft Fabric.
- Experience using AI-assisted development tools such as GitHub Copilot, Claude Code, ChatGPT, or Amazon Q Developer.
Preferred Certifications
- AWS Certified Data Engineer – Associate.
- AWS Certified Solutions Architect – Associate or Professional.
- AWS Certified Developer – Associate.
- Databricks Certified Data Engineer Associate or Professional.
- Equivalent certifications demonstrating strong capability in cloud-native data engineering.
Location
This role is remote; however, we require candidates to be based locally in the Philippines for occasional onsite activities such as team events, client meetings, or equipment handover. Local residency is also required for compliance with Philippines labor laws and employment regulations.
Diversity and Inclusion
At Sharesource, we believe in the value of diversity and inclusion. We are committed to creating a diverse, respectful, and inclusive workplace, and we do not discriminate based on factors such as race, gender, religion, sexual orientation, or disability.