Data Engineer
Summary
Designs and builds secure, scalable APIs (REST/SOAP) for data exchange, integrates systems with third-party services, and ensures compliance and performance using Azure and Python.
The API Developer is responsible for designing, developing, and maintaining secure, scalable APIs that enable seamless integration between internal systems and external services. This role supports enterprise data architecture initiatives, microservices, and real-time data processing.
Key Responsibilities
- API Design & Development
- Develop RESTful and SOAP APIs for data exchange across platforms.
- Implement authentication and authorisation protocols (OAuth, API keys).
- Manage API lifecycle using API Gateway and monitoring tools.
- Integration
- Integrate APIs with internal systems and third-party services.
- Ensure secure and efficient API-based data ingestion and delivery.
- Work closely with data engineers, architects, and business stakeholders.
- Support microservices integration and asynchronous communication.
- Performance & Governance
- Optimise API performance and scalability.
- Implement compliance and security standards (e.g., POPIA).
- DevOps & CI/CD
- Apply version control (Git) and CI/CD pipelines for API deployments.
Required Skills & Experience
- Strong proficiency in API development (RESTful services).
- Experience with API Gateway and management platforms.
- Hands‑on experience with Python, C#, SQL; familiarity with R and Java is advantageous.
- Knowledge of Azure services (Data Factory, Databricks) and API monitoring.
- Understanding of ETL processes, data modelling, and data warehousing concepts.
Preferred Qualifications
- Bachelor’s degree in Computer Science, Information Technology, or related field.
- 3–5+ years of experience in API development or data engineering roles.
- Certifications in Azure or API Management tools.