Senior AWS Data Engineer
Summary
Build and maintain cloud-native data pipelines and platforms on AWS, using Python, SQL, and services like S3, Lambda, and RDS to enable scalable, reliable data-driven decision making.
What You'll Be Doing
As a Senior Data Engineer, you will design, build, and maintain modern cloud-based data platforms that enable data-driven decision making.
🚀 Build Modern Data Pipelines
- Design, develop, and maintain cloud-native data pipelines capable of ingesting and transforming data from multiple sources, including APIs, FTP, SFTP, databases, and event-driven systems.
- Develop highly scalable batch and streaming data processing solutions.
- Build resilient, reusable, and maintainable ETL/ELT processes following modern engineering best practices.
- Implement monitoring, logging, and alerting mechanisms to ensure data quality, pipeline reliability, and operational visibility.
Engineer Reliable Data Platforms
- Design and manage complex analytical datasets that meet both business and technical requirements.
- Build scalable data models that support reporting, analytics, and downstream applications.
- Create and maintain database objects including tables, views, stored procedures, and automation scripts.
- Optimize SQL queries and data models to maximize performance and scalability.
- Support Data Governance initiatives through metadata management, documentation, and data cataloging.
☁️ Build Cloud-Native Solutions
- Develop solutions leveraging AWS services including:
- Amazon S3
- ECS
- Lambda
- RDS
- SNS
- SQS
- IAM
- CloudWatch
- Contribute to the design of secure, scalable, and highly available cloud architectures.
- Collaborate on Infrastructure as Code and cloud automation initiatives.
🤝 Collaborate Across Teams
- Work closely with Product Owners, Data Analysts, Software Engineers, and business stakeholders to understand requirements and deliver high-quality data solutions.
- Participate actively in Scrum ceremonies, sprint planning, backlog refinement, and continuous delivery activities.
- Support production environments through monitoring, troubleshooting, and incident resolution.
🚀 Drive Continuous Improvement
- Continuously improve the scalability, performance, security, and maintainability of data products.
- Promote engineering best practices, code quality, testing, and documentation.
- Stay up to date with emerging technologies, cloud services, and modern Data Engineering trends.
- Contribute ideas that improve developer productivity and platform reliability.
🛠️ What We're Looking For
Required Experience
✔️ Proven experience as a Data Engineer developing cloud-native data platforms.
✔️ Strong experience designing and implementing AWS-based data pipelines.
✔️ Excellent SQL skills, including complex query optimization and analytical database development.
✔️ Strong programming skills in Python, with hands-on experience using libraries such as:
- Pandas
- Boto3
✔️ Solid understanding of:
- Data Architecture
- Data Modeling
- Data Governance
- ETL / ELT
- Data Quality
- Metadata Management
✔️ Experience working with structured, semi-structured, and unstructured data.
✔️ Familiarity with graph databases is considered a plus.
Technical Stack
Cloud
- AWS
- S3
- ECS
- Lambda
- RDS
- SNS
- SQS
- IAM
- CloudWatch
Data Platforms
- Snowflake
- SQL
- dbt Core (preferred)
Programming
- Python
- Pandas
- Boto3
Orchestration
- AWS Step Functions
- Apache Airflow
- Prefect
DevOps
- CI/CD
- GitHub
- GitLab
- Docker (nice to have)
- Terraform
- CloudFormation
Analytics
- Tableau
⭐ Nice to Have
➕ Strong hands-on experience with Snowflake.
➕ Experience implementing CI/CD pipelines for Data Engineering.
➕ Experience with Infrastructure as Code using Terraform or CloudFormation.
➕ AWS Certification (Solutions Architect or equivalent).
➕ Snowflake Certification (SnowPro Core or equivalent).
➕ Experience working with modern Data Mesh or Data Lake architectures.
What Makes You Successful
We're looking for someone who is:
- Passionate about building high-quality data platforms.
- Curious, proactive, and always looking for better technical solutions.
- Comfortable working in Agile product teams.
- Analytical and able to solve complex technical challenges.
- Detail-oriented, with a strong focus on performance, scalability, and reliability.
- An excellent communicator who enjoys collaborating across technical and business teams.
- Committed to continuous learning and knowledge sharing.
- Someone who believes that great products are built by great teams—and who enjoys working in one.