Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

InfoStride

NewBe an early applicant

Generative AI Engineer

Posted Updated

Summary

Senior Generative AI Developer (via InfoStride) for NC DHHS in Raleigh, NC — hybrid. Day to day: build and deploy production LLM applications, RAG pipelines, fine-tuned models, and AI agent workflows using Python, LangChain-style frameworks, FastAPI/Azure, vector/SQL/NoSQL databases, with a focus on AI security, Responsible AI, and PII protection.

Job ID: 814296

Job Title: Senior Generative AI Developer

Department: Department of Health and Human Services

Work Arrangement: Hybrid

Work Location: 1915 Health Services Way, Raleigh, NC 27607

Interview Type: Both Phone and In Person


Job Description:

NC DHHS is seeking a Senior Generative AI Developer to design, develop, and deploy secure, scalable, production-grade AI solutions using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), model fine-tuning, and enterprise data systems. The ideal candidate will have strong expertise in Python, cloud platforms, data engineering, and AI security, with a focus on Responsible AI, data privacy, and enterprise integration.

Key Responsibilities

• Develop and deploy LLM-powered applications, prompts, and AI agent workflows.

• Build RAG pipelines integrating vector, SQL, and NoSQL databases.

• Implement model fine-tuning and optimization techniques, including LoRA.

• Develop secure APIs and microservices using Python, FastAPI, or Azure Functions.

• Integrate structured and unstructured enterprise data while ensuring PII protection.

• Implement AI security controls, encryption, RBAC, and access management.

• Ensure Responsible AI practices, including bias detection, privacy, and hallucination mitigation.

• Maintain CI/CD pipelines and monitor AI performance, cost, reliability, and model drift.

• Collaborate with engineering, security, data, product, and governance teams.

• Maintain technical documentation and support compliance and audit requirements.

Required Qualifications

• 3+ years of experience in Generative AI or applied machine learning.

• 3+ years of experience with Azure, AWS, or GCP.

• 3+ years of Python development and LLM frameworks such as LangChain, Semantic Kernel, or LangGraph.

• 2+ years of experience building RAG pipelines and LLM applications.

• 2+ years of experience with vector databases such as Pinecone, Weaviate, Milvus, or FAISS.

• 5+ years of SQL, data modeling, and performance tuning experience.

• 2+ years of experience with NoSQL databases such as MongoDB, Cosmos DB, or DynamoDB.

• 2+ years of experience implementing AI security and Responsible AI practices.

• 5+ years of experience developing microservices using FastAPI, Node.js, or Azure Functions.

• 3+ years of Agile development experience.

Preferred Qualifications

• Experience with Azure AI Search, Azure Machine Learning, Databricks, or Hugging Face.

• Familiarity with Promptflow, Ragas, or AI evaluation frameworks.

• Experience with supervised fine-tuning and LoRA-based training.

• Knowledge of enterprise governance tools such as Microsoft Purview.

• Relevant certifications such as Azure AI-102, AWS ML Specialty, GCP ML Engineer, or SC-100.

Skills

What Senior AI Engineering jobs ask for — and how much of it you have →
Apply

See also

AI Engineering jobs by country — openings, pay and top skills →