Senior Staff Software Engineer
Summary
Robert Half is seeking a Senior Staff Software Engineer in New York to build production LLM applications: Python backend services, APIs, and data pipelines powering RAG/vector-search agents with strict multi-tenant permissions over confidential documents such as virtual data rooms and M&A files.
6+ years of building and operating production software, with a record of leading complex technical work across teams.
• Strong hands-on Python, with experience in backend services, APIs, and large-scale data pipelines.
• Experience with production LLM applications that depend on retrieval: tool calling, RAG, embeddings, vector search, or context management.
• Strong foundations in permissions, multi-tenant data, and access control on what an agent can retrieve.
• Clear product and technical judgment. You can balance answer quality, latency, and cost, and explain the tradeoffs to engineering and product leaders. Nice to Have • Long-running agent workflows that search or read documents.
• A vector store at production scale. • Processing of large confidential documents and data tables. • Hybrid search, citations, and evaluation of retrieval quality.
• Virtual data rooms, M&A documents, or similar document-heavy work. • Tool interfaces that expose search to an agent.
Skills
Sign in to read and join the discussion.