Data Engineer – AWS (LARA + ELA + Advanced AI Data Ingestion)
Posted Updated 6
views
Summary
Data engineer in Bangalore building AWS data-lake ingestion pipelines that feed analytics and AI/GenAI use cases — parsing, chunking, and embedding documents into AI-ready datasets using Glue, S3, Lambda, Step Functions, Kinesis, Python, and PySpark.
Design ingestion pipelines feeding analytics and AI/GenAI use cases.
- Ingest structured and unstructured data from multiple sources into the AWS data lake
- Prepare AI-ready datasets, including document parsing, chunking and embedding pipelines
- Build reusable, metadata-driven ingestion frameworks
Requirements
- Must have: 4+ yrs, AWS (Glue, S3, Lambda, Step Functions, Kinesis), Python, PySpark.
- Nice to have: Bedrock, vector databases, OpenSearch