Senior Software Engineer, AI
NewBe an early applicantSummary
Senior IC engineer at a dental practice management SaaS company building an AI Receptionist (voice, SMS, web chat) for dental practices. Day-to-day: end-to-end ownership of Python/FastAPI backend services, PostgreSQL/Redis, and production LLM systems — conversation handling, evals, and guardrails — under HIPAA constraints, in-office in Gurugram with some US-hours overlap.
Senior Software Engineer, AI
- Build and maintain backend services and RESTful APIs in Python (FastAPI / Django)
- Design schemas and write efficient PostgreSQL queries; use Redis for caching and session state
- Work with async and event-driven patterns — queues, webhooks, WebSockets, background workers
- Own the operational side: logging, metrics, alerting, debugging production issues
- Write unit and integration tests for the business logic you ship
- Own the conversation layer for real-time voice — turn-taking, barge-in, and recovery when the agent talks over a caller or stalls mid-turn
- Debug non-deterministic failures in production: fabricated confirmations, invented practice policies, dropped context across turns
- Own patient identity resolution over the phone — misheard and misspelled names, shared phone numbers, multi-algorithm phonetic matching
- Version prompts and tool schemas like code: canary changes, measure impact, roll back regressions
- Own the eval and regression suite — golden conversation sets, replay of production calls, CI gating on prompt and model changes
- Design guardrails for patient-facing interactions: no medical advice, no unverified data disclosure, tool-call authorization, PHI excluded from logs and traces, escalation to a human when the agent should stop
- Own the model and voice vendor abstraction so a provider change is configuration, not a rewrite
- Keep voice, SMS, and web chat consistent — shared state and knowledge base, channel- appropriate behaviour
- Integrate with practice management systems (Dentrix, Open Dental, Eaglesoft) and internal PBN APIs
- Implement secure auth flows, including OTP-based patient verification
- Define SLOs for conversation success and turn latency; own incident response and postmortems for this surface
- Work with Product Management to turn requirements into working software, surfacing edge cases early
- Participate in sprint planning, standups, code reviews, and product reviews
- Document what you build; collaborate across time zones with US-based stakeholders
- 4+ years of professional software development experience
- Hands-on experience building backend services and APIs that ran in production
- Practical experience with LLM-based applications (GPT-4/4o, Claude, or similar) — prompt design, tool calling, handling model output in real systems. Substantial personal or open-source work counts; tutorial-level does not.
- Experience debugging and improving a system after it shipped
- Strong Python — our primary language across AI and backend
- APIs: RESTful services, webhooks, third-party integrations; FastAPI or Django preferred
- Databases: PostgreSQL — schema design, indexing, query performance; Redis or similar
- Async Python (asyncio) and event-driven architectures
- Cloud: working knowledge of AWS (or GCP/Azure) — compute, storage, managed DBs, queues
- Version control, code review, and CI/CD as normal parts of your workflow
- Shipped an LLM system to real users and debugged it in production; can describe a failure mode you found and fixed
- Specific view of what current models are unreliable at, and how that shapes what runs unsupervised versus behind a tool call or human review
- Multi-turn conversation design — state that survives interruptions, topic switches, and mid-call corrections
- Experience measuring LLM systems: offline evals, judge model calibration, or production quality metrics
- Working knowledge of token cost and latency trade-offs, including where streaming helps and where it adds complexity
- Frame the problem, not just solve it; write down architectural decisions and the tradeoffs you rejected
- Clear communication with technical and non-technical stakeholders
- Able to drive your own work to completion without close supervision
- Comfortable with a fast pace and evolving requirements
- Willing to work in-office in Gurugram and overlap with US hours when needed
- Conversational AI — chatbots, voice assistants, or IVR
- Voice/telephony (Twilio, Vonage) or STT/TTS APIs (Deepgram, ElevenLabs, AssemblyAI)
- LLM orchestration frameworks (LangChain, LlamaIndex) — or a considered view on skippingthem
- Healthcare / HIPAA compliance knowledge
- SaaS or B2B product company background; multi-tenant architecture