Data engineer
Summary
Designs, builds, and maintains secure, scalable RESTful and SOAP APIs that connect internal systems with third-party services, supporting enterprise data architecture, microservices, and real-time data processing on Azure (Data Factory, Databricks). Day-to-day work spans API Gateway lifecycle management, OAuth/security and POPIA compliance, ETL, and Git-based CI/CD using Python, C#, and SQL.
The API Developer is responsible for designing, developing, and maintaining secure, scalable APIs that enable seamless integration between internal systems and external services. This role supports enterprise data architecture initiatives, microservices, and real-time data processing.
Key Responsibilities API Design & Development Develop RESTful and SOAP APIs for data exchange across platforms. Implement authentication and authorisation protocols (OAuth, API keys). Manage API lifecycle using API Gateway and monitoring tools. Integration Integrate APIs with internal systems and third-party services. Ensure secure and efficient API-based data ingestion and delivery. Work closely with data engineers, architects, and business stakeholders. Support microservices integration and asynchronous communication. Performance & Governance Optimise API performance and scalability. Implement compliance and security standards (e.g., POPIA). Dev Ops & CI/CD Apply version control (Git) and CI/CD pipelines for API deployments. Required Skills & Experience Strong proficiency in API development (RESTful services). Experience with API Gateway and management platforms. Hands‑on experience with Python, C#, SQL; familiarity with R and Java is advantageous. Knowledge of Azure services (Data Factory, Databricks) and API monitoring. Understanding of ETL processes, data modelling, and data warehousing concepts. Preferred Qualifications Bachelor’s degree in Computer Science, Information Technology, or related field. 3–5+ years of experience in API development or data engineering roles. Certifications in Azure or API Management tools.