GenAI & LLM Ops Engineer – Data Analytics (Vienna)
Posted Updated
Description
Vienna Insurance Group in Vienna is seeking a GenAI specialist to design and scale AI-powered products across the Group. You will work with data scientists, engineers, and product owners to translate complex problems into maintainable GenAI solutions.
The role emphasizes hands-on Databricks, MLflow, and RAG implementations, plus end-to-end LLMOps, evaluation, and governance. Strong Python skills and fluent English are required; German is a plus.
Collaborate with data scientists, data engineers, domain experts and product owners to design GenAI products across the Group. Design, build and operate RAG applications, copilots/assistants and actoric workflows on Databricks. Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops. Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate with human feedback. Develop agentic solutions using tool/function calling and orchestration frameworks such as LangChain and LangGraph. Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation. Degree in Computer Science, Software Engineering, Information Systems, Data Science or AI-related field. Strong Python and software engineering skills with production experience. Hands-on Databricks, MLflow and model deployment experience. Practical knowledge of RAG, tool use and agent architectures. Excellent communication and teamwork; very good English; German a plus.Skills
Sign in to read and join the discussion.