Skip to content

Search jobs inside your AI agent. ClaudeChatGPTCursorGrok Bot

Connect

3Pillar Group

AI Data Architect REQ_22

Posted Updated
Discussion

Description

<div class="section page-centered" style="max-width:1080px;padding:20px 0px;color:rgb(0,0,0);font-family:Meta, sans-serif;background-color:rgb(246,246,246);"><div class="section page-centered" style="font-family:Verdana, Arial, Helvetica, sans-serif;font-size:11px;"><span style="font-size:12px;">3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI.</span><br /><span style="font-size:12px;"> </span><br /><strong><span style="font-size:12px;">AI Data Architect</span></strong><br /><span style="font-size:12px;"> </span><br /><span style="font-size:12px;">We are looking for an AI Data Architect to design, build, govern, and evolve the single source of truth that powers every AI initiative in our organization.</span><br /><span style="font-size:12px;">This platform will serve as the foundational nervous system for conversational AI assistants, dashboard intelligence, autonomous AI agents, RAG-powered applications, predictive ML models, and any AI product we build today or in the future. The resource will architect the system, drive implementation, own the data contracts that agents and AI applications depend on, enforce security and access governance for both human and agent consumers, and continuously monitor and improve the accuracy and reliability of AI outputs that flow from this platform. </span></div><div class="section page-centered" style="font-family:Verdana, Arial, Helvetica, sans-serif;font-size:11px;"><h3><span style="font-size:12px;">Requirements:</span></h3><div class="posting-requirements plain-list"><span style="font-size:12px;">Architect and own the enterprise AI data platform — the unified, governed layer that ingests, transforms, stores, and serves all data consumed by AI systems across the organisation.</span><br /><span style="font-size:12px;">Design multi-domain data models (lakehouse, data mesh, event-driven) that are structured from day one to serve AI workloads: clean lineage, versioned schemas, well-documented contracts, and low-latency serving APIs.</span><br /><span style="font-size:12px;">Strong exposure to different Data architectures, data lake & data warehouse</span><br /><span style="font-size:12px;">Define tools & technologies to develop automated data pipelines, write ETL processes, develop dashboard & report and create insights</span></div></div><div class="section page-centered" style="font-family:Verdana, Arial, Helvetica, sans-serif;font-size:11px;"><h3><span style="font-size:12px;"><b>Responsibilities</b></span></h3><div class="posting-requirements plain-list"><div><strong><span style="font-size:12px;">Technical Skills</span><br /><span style="font-size:12px;">Primary Skills:</span></strong><span style="font-size:12px;"> Python, SQL, Snowflake/Databricks, AWS (S3, Glue, EKS, Bedrock, Kinesis, Redshift), Docker, Kubernetes, Terraform, GitHub Actions, LangChain, LlamaIndex, LLM APIs (OpenAI, AWS Bedrock, Claude, HuggingFace), (Pinecone, FAISS, ChromaDB, OpenSearch), knowledge graphs (Neo4j).</span><br /><span style="font-size:12px;"> </span><br /><strong><span style="font-size:12px;">Secondary Skills:</span></strong><span style="font-size:12px;"> MLflow, FastAPI, CI/CD pipelines, observability tooling (CloudWatch, Grafana, or equivalent), data lineage and metadata management platforms.</span></div><div><span style="font-size:12px;"> </span></div><ul><li><span style="font-size:12px;">15+ years of hands-on data engineering and architecture experience, alongside building production AI/ML and LLM-era data infrastructure.</span></li><li><span style="font-size:12px;">Strong Experience with either Databricks or Snowflake; experience with both is desirable.</span></li><li><span style="font-size:12px;">Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architectures</span></li><li><span style="font-size:12px;">Expertise in designing and writing ETL processes in Python / Java / Scala</span></li><li><span style="font-size:12px;">Own the full data stack: real-time streaming (Kafka, Spark Structured Streaming), batch processing (Databricks, PySpark, Delta Lake), cloud storage and compute (AWS, Azure), and data quality /metadata management.</span></li><li><span style="font-size:12px;">Drive modernisation of legacy pipelines (on-prem ETL, batch DWH) to cloud-native, AI-ready architectures with measurable improvements in cost, latency, and delivery velocity.</span></li><li><span style="font-size:12px;">Proven experience designing enterprise-scale AI data platforms that serve multiple AI consumers —not just one application or pipeline.</span></li><li><span style="font-size:12px;">Hands-on experience with vector stores, semantic models, knowledge graphs, and retrieval infrastructure in production environments.</span></li><li><span style="font-size:12px;">Working knowledge of LLMOps: model serving pipelines, MLflow, CI/CD for AI, automated evaluation, and production monitoring.</span><br /><span style="font-size:12px;"> </span><br /><span style="font-size:12px;"> </span><br /><br /></li></ul></div></div><div class="section page-centered" style="font-family:Verdana, Arial, Helvetica, sans-serif;font-size:11px;"><h3><span style="font-size:12px;">AI Experience</span></h3><div class="posting-requirements plain-list"><strong><span style="font-size:12px;">RAG, Vector & Retrieval Infrastructure</span></strong><br /><span style="font-size:12px;">Design the retrieval infrastructure that powers RAG-based AI applications: embedding pipelines, vector stores (Pinecone, FAISS, ChromaDB, OpenSearch), chunking strategies, and hybrid retrieval layers combining semantic search with structured queries.</span><br /><span style="font-size:12px;"> </span><br /><strong><span style="font-size:12px;">Agentic Behaviour Observability & Output Accuracy</span></strong><br /><span style="font-size:12px;">Own the observability stack for AI agent behaviour: instrument agents to capture inputs, retrieved context, tool calls, reasoning traces, and outputs — creating a complete audit trail of every agentic action driven by platform data.</span><br /><span style="font-size:12px;">Design and operate evaluation frameworks that continuously measure AI output quality: factual accuracy, context faithfulness, retrieval relevance, hallucination rates, and task completion success— across all AI consumers of the platform.</span><br /><span style="font-size:12px;"> </span><br /><strong><span style="font-size:12px;">Architecture Standards & Engineering Enablement</span></strong><br /><span style="font-size:12px;">Define and maintain the reference architecture for the AI data platform — documenting design patterns, data contracts, integration standards, and decision records (ADRs) that all engineering teams follow.</span><br /><span style="font-size:12px;">Establish data engineering standards: pipeline testing frameworks, code review practices, CI/CD automation, infrastructure-as-code (Terraform), reusable component libraries, and observability instrumentation.</span></div></div><div class="section page-centered" style="font-family:Verdana, Arial, Helvetica, sans-serif;font-size:11px;"><h3><span style="font-size:12px;"><b>Benefits</b></span></h3><div class="posting-requirements plain-list"><ul><li><p><span style="font-size:12px;">Medical Insurance benefits as per company policy. </span></p></li><li><p><span style="font-size:12px;">Dental insurance as per company policy.</span></p></li><li><p><span style="font-size:12px;">Vision insurance as per company policy.</span></p></li><li><p><span style="font-size:12px;">Employer paid Disability, Life, and AD&D insurance</span></p></li><li><p><span style="font-size:12px;">Unlimited PTO </span></p></li><li><p><span style="font-size:12px;">Paid parental leave </span></p></li><li><p><span style="font-size:12px;">401K</span></p></li><li><p><span style="font-size:12px;">Flexible work policy</span></p></li><li><p><span style="font-size:12px;">12 Paid Holidays</span></p></li></ul></div></div></div>

Skills

Apply

See also

Architecture jobs by country — openings, pay and top skills →