AWS Data Engineer
Summary
Design and build scalable, secure data pipelines on AWS using Python, SQL, and orchestration tools like Airflow to deliver reliable, high-performance data solutions.
Company Overview
3 Cubed Business Consulting is headquartered in Singapore, providing end-to-end IT consulting, solutions, and services across Asia Pacific. We deliver impactful technology solutions aligned with our customers’ purpose and perform with passion.
Job Summary
You will design, develop, and maintain scalable, secure data pipeline solutions on cloud infrastructure, ensuring high reliability and performance. Collaborate with stakeholders and coach team members to deliver best-in-class business products throughout their lifecycle.
Responsibilities
- Deliver end-to-end data pipeline solutions on cloud infrastructure using the latest technologies and industry best practices
- Apply domain modeling techniques to build high-quality business products
- Structure software for clarity, testability, and ease of evolution
- Design scalable architectures that eliminate single points of failure
- Develop secure code to protect customers and systems from malicious threats
- Investigate and resolve issues promptly, preventing recurrence
- Manage software releases to achieve zero downtime for end-users
- Optimize data read/write operations to meet business needs
- Monitor system performance and apply appropriate problem-solving approaches
- Ensure system reliability and operational simplicity
- Continuously update technologies and architectural patterns to stay current
- Support products through their full lifecycle, including production support and incident management
- Coach team members on coding practices, design principles, and maintainable implementation patterns
- Manage stakeholder expectations and prioritize work across multiple streams effectively
Required competencies and certifications
- Formal training or certification in data engineering concepts with applied experience
- Recent hands-on professional experience as a data engineer
- Proficient coding skills in a recent version of Python
- Experience designing and implementing effective tests (unit, component, integration, end-to-end, performance)
- Excellent written and verbal communication skills in English
- Experience working with cloud technologies and distributed systems
- Experience with data transformation frameworks and data pipeline orchestration tools
- Experience managing large volumes of data and optimizing data processing
- Understanding of event-based architecture, data streaming, and messaging frameworks
Preferred competencies and qualifications
- Experience working in highly regulated environments or industries
- Experience with AWS cloud technologies
- Experience with data governance frameworks
- Understanding of incremental data processing and versioning
- Familiarity with RESTful APIs and web technologies including DBT, Airflow, SQL, and Python