Data Engineer
Posted Updated 11
views
Roles & Responsibilities
Responsibilities
- Design and build backend services usingPythonandFastAPI
- Develop, test, and deployGenAI applicationsin a production setting
- Build and maintainLLM pipelines(e.g., OpenAI, Hugging Face Transformers, Lang Chain)
- Construct scalabledata pipelinesfor ingesting and structuring archival content
- Interface withgraph databases(e.g., Neo4j, Memgraph) for relationship mapping
- Collaborate with AI/ML engineers, designers, and other stakeholders to integrate LLM outputs with UI and user workflows
- Implement CI/CD pipelines and manageon-premise or VM-based deployment
Requirements
- Good understanding of a global import export environment & the documentation requirement for the same
- Familiarity in working across ERP systems and system integrations.
- Strong proficiency inPython, with experience inFastAPI
- Experience developing and deployingLLM-based applications(Azure OpenAI API, Hugging Face, etc.)
- Background indata engineering—working with large-scale unstructured text, ETL workflows
- Familiarity withgraph databasesand knowledge representation
- Exposure toCI/CD pipelinesand deploying services inon-premiseorvirtual machineenvironments
- Track record of takingGenAI applicationsfrom development to real-world usage