Gen AI Architect
Summary
GenAI/LLM solution architect at Cybage in Pune: designs LLM system architecture and layered data models, builds high-volume ingestion pipelines (public APIs, BigQuery backfills, scrapers, entity resolution), RAG systems and data-security boundaries, documents HLD/LLD, and mentors the team. Core stack: BigQuery/SQL, LLMs, RAG.
Key Responsibilities:
- Define system architecture tailored for LLM execution, managing multi-layer database models (raw, stg, core, fact, mart) and context window design in close collaboration with the client POC
- Architect resilient ingestion pipelines for high-volume public APIs, BigQuery historical backfills, social scrapers, and AI-driven entity resolution engines.
- Establish strict physical data boundary rules between shared data pools and isolated client environments.
- Set protocols for system fallback behaviour, rate-limiting, cost caps, and agentic health monitoring.
- Deep expertise in AI-era database architecture (BigQuery/SQL), prompt/system design, data security, and high-throughput data pipelines, RAG systems
- Prepare HLD/LLD/Deployment diagram and other required documentation with the support from tech lead
- Provide overall technical oversight to the team
- Brainstorming with the client POCs for the future roadmap, create prototypes to check feasibility of upcoming GenAI innovations in the industry
- Mentor team in overall GenAI solutioning to ensure they are following industry best practices