Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

SoftServe Inc.

GenAI Systems Engineer — On-Prem & Enterprise AI

Posted Updated

Description

SoftServe is seeking an AI Engineer to design and deliver GenAI solutions on an on-premise platform (Arthur). You will build production-ready AI applications and integrate enterprise data with leading LLM providers.

You will design RAG and tool-enabled workflows, architect robust integrations via APIs and databases, and implement guardrails, testing, and observability to ensure reliability and security. The role demands strong Python and enterprise GenAI experience, with collaboration across

Design, develop and productionise GenAI/LLM applications and use cases. Build RAG, agentic AI and tool-enabled workflows using enterprise data and systems. Integrate AI solutions with APIs, databases, applications and external LLM providers. Develop effective prompt and context engineering approaches, including structured outputs and guardrails. Implement testing, LLM evaluation, monitoring and observability to ensure solution quality and reliability. Apply appropriate security, data privacy and Responsible AI controls. Collaborate with architects, platform engineers, business SMEs and other delivery teams. Contribute reusable components, integration patterns and engineering best practices. Strong Python and software engineering experience. Hands-on GenAI/LLM experience in production environments. Experience with RAG, embeddings and vector/semantic search. Familiarity with multiple LLM providers (Anthropic Claude, OpenAI, Google Gemini). Strong API and enterprise integration skills. Understanding of LLM evaluation, guardrails, observability and AI security. Experience with on-premise environments is desirable. Model-agnostic mindset to work across different LLMs.

Skills

Apply

See also

AI Engineering jobs by country — openings, pay and top skills →