AI Backend Engineer
Summary
Gakk Media is hiring an on-site AI Backend Engineer in Dhaka to build and scale the backend for its unified AI platforms — chiefly a multi-provider LLM gateway (OpenAI, Claude, Gemini) with auth, streaming, and observability. Core stack: Python, FastAPI, Kong, Redis, Qdrant, LiteLLM/LangChain.
Job Title: AI Backend Engineer
Company: Gakk Media (BD) Limited
Location: West Panthapath, Dhaka+
Job Type: Full-Time (On-site)
Industry: Telecommunication | Software | IT Enabled Services
Objective:
We are looking for an AI Backend Engineer to join our growing AI team and help build, scale, and maintain the backend infrastructure powering our unified AI platforms. The ideal candidate has a solid foundation in backend engineering, a working knowledge of AI/ML systems, and the drive to experiment and ship real products. Hands-on experience with Qdrant Vector DB and building or managing an LLM Gateway is a must.
Key Responsibilities:
● Design and maintain a unified LLM gateway that integrates multiple AI providers (OpenAI, Anthropic Claude, Google Gemini, and others) under a single API layer
● Manage authentication, API key lifecycle, and multi-tenant access control for platform users
● Optimize response streaming from LLM providers to deliver low-latency, real-time chat experiences
● Run pre-trained model experiments for question-answering or semantic search.
● Monitor backend performance, debug production issues, and improve system observability with logging and alerting
● Stay up to date with new AI model releases and evaluate integrations into the platform
Requirements:
Education:
● Bachelor’s degree in Computer Science, Information Technology, or a related field. Exceptional will be considered.
Experience:
● Familiarity with pre-trained NLP models (Sentence Transformers, Mistral, MiniLM, T5, LLaMA, Gemma).
● Knowledge of Fast API, API Gateway Must, Hybrid caching.
● Knowledge of Git, Docker.
● Knowledge on LiteLLM, Langchain, Autogen
Required Skills:
● Must need to know Python, Kong Gateway, Redis caching
● Knowledge about machine learning / NLP concepts: embeddings model,, semantic search, similarity.
● Knowledge of data preprocessing: Pandas, NumPy.
● Strong attention to detail and willingness to learn.
● Familiarity with Git, Docker.
Additional Requirements:
● Age: 25 to 38 years.
● Strong communication skills in English (both written and spoken).
● Proactive problem-solver with excellent collaboration skills.
● Ability to work in a fast-paced, agile environment.
Compensation & Benefits:
● Weekly Holidays: 2 days/week (Friday & Saturday)
● Salary Review: Annually
● Festival Bonuses: 2 per year
● Leave Entitlement: Sick Leave & Annual Leave
● Performance Recognition: Yearly Awards Based on Performance
● Work Environment: 3 offices Premises, Friendly, collaborative, and supportive
● Others Benefits:
o Skill development and learning support (online courses, workshops)
o Employee wellness support and periodic team outings
o Opportunity to work on global digital products
o Career advancement within Gakk and its sister companies.
Skills
Sign in to read and join the discussion.