Senior Data Engineer (GenAI / AWS) | Claude Agent SDK | Amazon Bedrock | Python | 14+ years of experience
Posted Updated 81
views
Summary
Contract role (3+ months, extension possible) for a senior data engineer building GenAI document-processing pipelines on AWS: Step Functions/Lambda/S3/Textract/Comprehend pipelines, vector databases and RAG knowledge bases, AI agents via Claude Agent SDK on Amazon Bedrock AgentCore, with CI/CD in GitHub Actions; 14+ years' experience and Python required.
Senior Data Engineer (GenAI / AWS)
Duration: 3+ Months (Extension Possible)
Experience: 14+ years Cloud Platform: AWS Primary Language: Python
Key Responsibilities
- Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
- Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
- Implement document chunking, embeddings, vector indexing, and semantic search.
- Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
- Integrate knowledge bases with AI agents for contextual information retrieval.
- Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
- Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
- Optimize data pipelines for scalability, reliability, security, and performance.
All your information will be kept confidential according to EEO guidelines.