Senior Data Engineer – Cloud Lakehouse
Summary
A senior data engineer who designs and builds scalable cloud data lake/lakehouse architectures (e.g., Apache Iceberg on AWS or Azure), develops and automates ETL/ELT pipelines with tools like dbt and Airflow, and supports reporting, analytics, data quality, and on-call maintenance of data products.
- Design and build innovative data solutions within an agile data engineering team
- Modernize the data platform to enhance product offerings and maximize the value of data for reporting, analytics, and decision-making
- Develop and maintain data solutions and products, including data transformation, data modelling, and reporting across on-premises and cloud environments
- Build scalable, flexible data lake/lakehouse architectures
- Leverage domain events for efficient, real-time data processing
- Adopt generative AI features such as Amazon Q and Copilot for analytics and self-service capabilities
- Build performant, scalable, and accessible solutions delivering actionable insights
- Automate data engineering processes, implement CI/CD pipelines, and optimize ETL/ELT flows
- Translate business requirements into technical solutions, document GAPs, and align with Architects
- Facilitate data discovery and data management using platforms such as Open Metadata
- Maintain KPI accuracy and documentation; support data quality and compliance standards
- Experiment with new approaches supporting the A&I department strategy
- Support and maintain data products, including release management, incident troubleshooting, and on-call support as necessary
Requirements
- 5+ years of experience in data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures
- Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments
- Strong knowledge of AWS (S3, Redshift) or Azure data services
- Experience with ETL/ELT processes and data ingestion
- Proven expertise using transformation tools such as dbt
- Experience with data pipeline orchestration tools such as Apache Airflow
- Experience with best practices applied to data, including testing and CI/CD
- Experience developing dashboards and reporting solutions using data visualization tools such as Power BI or Amazon QuickSight is advantageous
- Experience with generative AI applications in data analytics is advantageous
- Java experience is nice to have
Core Competencies
Demonstrates expertise in designing and implementing scalable data architectures, leveraging cloud services and modern data solutions to enhance analytics and decision-making. Proficient in automating data engineering processes and ensuring data quality and compliance standards.
Highest-signal resume keywords
- Data Engineering
- Data Lake/Lakehouse Architecture
- AWS Data Services
- ETL/ELT Processes
- Data Pipeline Orchestration
Hard Skills
- Data Transformation
- Data Modelling
- Data Reporting
- CI/CD Implementation
- KPI Documentation
- Data Quality Management
- Generative AI Applications
- Apache Iceberg
- Dbt
- Apache Airflow
Industry Keywords
- Agile Data Engineering
- Data Solutions
- Data Discovery
- Data Management
- Incident Troubleshooting
Tools & Technologies
- AWS S3
- AWS Redshift
- Power BI
- Amazon QuickSight
- Open Metadata