Senior Data Engineer

At Altron Digital Business, we provide the enterprise-grade solutions that organisations need to operate, optimise, and transform into a resilient digital business.

Our purpose is to use technology to transform today into a simpler, safer and smarter tomorrow.

We are committed to providing the best solutions to save money and help our clients’ business grow with a robust IT ecosystem that supports digital transformation.

The Senior Data Engineer is responsible for designing, developing, deploying, and maintaining cloud-native data processing systems using AWS services. The role focuses on building serverless ETL pipelines, implementing Infrastructure as Code (IaC) with CloudFormation, managing analytical datasets in Athena, and enabling reporting through QuickSight, including SOX-related dashboards. The role ensures high data quality, compliance, observability, and reliability through automation, monitoring, and best practice engineering.

KEY RESPONSIBILITIES:

• Design and build scalable, serverless ETL pipelines using AWS Lambda (Python), S3, SQS, and EventBridge.
• Develop data transformation logic to support analytical, operational, and audit use cases.
• Build, optimise, and maintain Athena tables, views, and query performance.

Infrastructure as Code (IaC)

• Develop, maintain, and optimise CloudFormation templates for deploying AWS data services and infrastructure components.
• Ensure IaC follows modular, reusable, and parameterised standards.
• Use GitLab for version control and CI/CD deployment automation.
• Build and maintain CloudWatch dashboards, logs, metrics, and alarms for observability.
• Implement proactive monitoring and alerting to ensure stability of data pipelines.

QuickSight Reporting & Analytics

• Develop, maintain, and optimise QuickSight datasets, analyses, and dashboards.
• Build and automate SOX control reports and other compliance-related visualisations.
• Work with compliance, analytics, and business stakeholders to ensure datasets are accurate, complete, and auditable.
• Implement dataset refresh strategies, access controls, row-level security, and performance tuning for visuals.

Data Quality, Governance & Security

• Implement automated data validation, schema rules, exception handling, and quality checks.
• Apply AWS best practices for encryption, IAM, security controls, and data governance.
• Ensure solutions meet SOX compliance and internal audit requirements.

Collaboration & Technical Leadership

• Work cross-functionally with DevOps, Security, QA, and Data Analytics teams.
• Provide guidance on serverless architecture, ETL patterns, and DataOps best practices.
• Participate in design reviews, technical discussions, and continuous improvement initiatives.

Educational Qualifications

• Bachelor’s degree in computer science, Information Systems, Engineering, or equivalent experience.

Professional Certifications

• AWS certifications (AWS Developer, Solutions Architect, or Data Engineer) beneficial.

Experience

• 5–8 years in Data Engineering or Software Engineering with a strong data focus.
• 3+ years hands-on with AWS data and serverless components.
• 2+ years' experience with IaC and CI/CD (preferably CloudFormation + GitLab).
• Experience with analytics/reporting tooling (QuickSight) is required.

Technical & Functional Skills

• Strong programming ability in Python and SQL.
• Hands-on experience with AWS services:
• SQS (decoupled event-driven processing)
• EventBridge (workflow orchestration)
• Athena (tables, views, performance tuning)
• CloudFormation (IaC deployments)
• CloudWatch (logs, alarms, dashboards)
• QuickSight (datasets, analyses, dashboards, SOX reporting)
• Experience working with PySpark for distributed data transformations.
• Proficiency with GitLab for Git workflows and CI/CD pipelines.
• Solid understanding of serverless architecture and event-driven system design.
• Knowledge of data lake design, ETL/ELT patterns, partitioning, and optimisation.

Disclaimer

Dear Applicant, we appreciate your interest in joining our organization. It is imperative for us that you understand how we handle your information. We are committed to ensuring the security and confidentiality of the information you provide. Your personal details will be collected for the sole purpose of the application process and will be used strictly for that purpose. By applying, you acknowledge and consent to the collection, use, and protection of your personal information in accordance with our privacy policy. If you have any inquiries or concerns, our Human Resource department is available to provide clarification. We look forward to reviewing your application.

https://www.altron.com/privacy-policy

Altron is committed to diversity and Employment Equity within the workplace. In this regard, the relevant laws and principles associated with Employment Equity will be considered when appointing potential candidates.

Should your experience and qualifications align with the requirements, we will be in contact to discuss the next steps.

Should you not receive feedback within 2 weeks, please consider your application as not successful.

In the meantime, we encourage you to explore our company's website.