ETL Data Engineering Practitioner with AWS @ Square One Resources
Summary
A senior Data Engineer (5+ yrs) designs and builds scalable ETL/ELT pipelines and cloud-based data platforms on AWS, working daily with Python, SQL, Spark/PySpark, big data and Data Warehouses/Lakes. The role mixes hands-on engineering with architecture, troubleshooting, stakeholder collaboration and mentoring.
Technology stackThe project focuses primarily on:
- AWS
- Python / SQL
- Apache Spark / PySpark
- ETL / ELT
- Big Data & distributed data processing
- Data Warehouses / Data Lakes
- Relational Databases
- Cloud-based data platforms
- Data orchestration and workflow automation
- 5+ years of professional experience in Data Engineering.
- Strong hands-on experience with AWS and cloud-based data platforms.
- Excellent knowledge of Python and SQL.
- Solid experience with ETL/ELT processes and data integration.
- Experience with Big Data technologies and distributed systems.
- Experience designing scalable Data Warehouses and/or Data Lakes.
- Strong database knowledge and experience with database performance optimization.
- Experience designing and implementing complex data engineering solutions.
- Understanding of data architecture, scalability, resilience and security.
- Ability to troubleshoot complex technical and performance-related issues.
- Experience taking technical ownership and influencing architectural decisions.
- Good communication skills and the ability to collaborate with both technical and business stakeholders.
- Experience mentoring other engineers or acting as a technical lead will be an advantage.
- Experience with Scrum Master responsibilities is a plus.
Technology stackThe project focuses primarily on:
- AWS
- Python / SQL
- Apache Spark / PySpark
- ETL / ELT
- Big Data & distributed data processing
- Data Warehouses / Data Lakes
- Relational Databases
- Cloud-based data platforms
- Data orchestration and workflow automation