Senior Software Engineer, Backend

About the role

The Applied AI team at Grab is focused on creating innovative internal platforms and frameworks that enhance the company's operational capabilities. In this position, you will take on the role of technical lead for the GrabGPT Gateway, which is the primary system responsible for managing all API traffic related to large language models (LLMs) throughout the organization. This is a pivotal role that combines technical expertise with leadership responsibilities, allowing you to shape the future of AI integration within Grab.

Key facts

• Location: Petaling Jaya, Malaysia


• Engagement: Full-time


• Team: Applied AI Team

What you'll do

• Design, develop, and maintain essential features of the gateway, including integrations with various providers, management of API keys, rate limiting, and tracking of associated costs.


• Create sophisticated routing systems that transform a unified API interface into formats specific to different providers, ensuring support for streaming data and automatic fallback mechanisms.


• Build backend services utilizing Go and Python to efficiently manage high-throughput and low-latency traffic associated with LLMs.


• Implement governance mechanisms, including distributed rate limiting using Redis, OIDC authentication for secure access, and chargeback processes leveraging PostgreSQL.


• Oversee cloud infrastructure management, Kubernetes deployments, and continuous integration/continuous deployment (CI/CD) pipelines for both staging and production environments.


• Lead post-mortem analyses following incidents, participate in on-call rotations, and address capacity issues related to service providers.


• Mentor and guide junior engineers, fostering a culture of test-driven development and best practices within the team.


• Collaborate closely with cross-functional teams to ensure seamless integration of AI capabilities into Grab's broader ecosystem.


• Stay updated with the latest advancements in AI and software engineering to continuously improve the team's output and efficiency.


• Contribute to the documentation of systems and processes to ensure knowledge sharing and maintainability.

Requirements

• A minimum of 3 years of professional experience in software engineering, demonstrating a strong foundation in backend development.


• Proficiency in programming languages Go and Python, with a solid understanding of their ecosystems.


• Hands-on experience with large language models, including familiarity with tools like LangChain and LangGraph.


• Experience working with cloud platforms such as AWS, alongside knowledge of Kubernetes and CI/CD practices.


• A solid grasp of distributed systems, algorithms, data structures, and multi-threading concepts.


• Familiarity with relational databases, including PostgreSQL, MySQL, or Oracle, and the ability to design efficient data models.


• Willingness to work onsite at the Petaling Jaya office, fostering collaboration and team cohesion.

Nice to have

• Experience with microservices architecture and design patterns.


• Knowledge of additional programming languages or frameworks that complement Go and Python.


• Familiarity with machine learning concepts and their application in real-world scenarios.


• Previous experience in a fast-paced startup environment or tech company.


• Contributions to open-source projects or active participation in developer communities.

Skills & tools

• Go (Golang)


• Python


• Large Language Models (LLMs)


• LangChain


• LangGraph


• Amazon Web Services (AWS)


• Kubernetes


• Redis


• PostgreSQL


• MySQL


• Oracle

Practical notes

• Employees enjoy a comprehensive benefits package, which includes Term Life Insurance and Medical Insurance, ensuring peace of mind and health security.


• Generous leave policies are in place, offering Parental leave, Birthday leave, and Love-all-Serve-all (LASA) volunteering leave to support work-life balance and community engagement.


• Access to the confidential Grabber Assistance Programme is available, providing support for personal and professional challenges.


• The work environment is designed to foster innovation and collaboration, making it an exciting place to grow your career in technology.

Grab is committed to diversity and inclusion, welcoming candidates from various backgrounds to apply and contribute to a vibrant workplace culture.