GenAI Engineer
Posted Updated
Description
Job Summary
We are seeking a highly skilled AI Engineer with expertise in High-Performance Computing (HPC), Apache Spark, Databricks, and Generative AI technologies. The ideal candidate will design, develop, and deploy scalable AI/ML solutions, optimize large-scale data processing pipelines, and build innovative GenAI applications leveraging Large Language Models (LLMs).
Key Responsibilities
- Design and develop AI/ML solutions for large-scale enterprise applications.
- Build and optimize distributed data processing pipelines using Apache Spark and Databricks.
- Develop and deploy Generative AI applications using LLMs such as GPT, Llama, Claude, and Mistral.
- Implement Retrieval-Augmented Generation (RAG) frameworks and vector databases.
- Utilize High-Performance Computing (HPC) environments to accelerate AI model training and inference.
- Fine-tune foundation models and optimize model performance for production workloads.
- Develop scalable data engineering and MLOps pipelines.
- Collaborate with Data Scientists, Data Engineers, and Business Stakeholders to deliver AI-driven solutions.
- Monitor, troubleshoot, and optimize AI applications in production environments.
Required Skills
AI & Generative AI
- Generative AI, Large Language Models (LLMs)
- Prompt Engineering
- RAG (Retrieval-Augmented Generation)
- LangChain, LlamaIndex
- Fine-tuning and Model Evaluation
- AI Agents and Multi-Agent Systems
Data Engineering & Big Data
- Apache Spark (PySpark)
- Databricks
- Delta Lake
- Data Modeling and ETL/ELT Pipelines
- SQL and NoSQL Databases
Programming
- Python
- SQL
- REST APIs
High-Performance Computing
- HPC Clusters
- Distributed Computing
- Parallel Processing
- GPU Computing (NVIDIA CUDA preferred)
Cloud & MLOps
- Azure / AWS / GCP
- MLflow
- Docker
- Kubernetes
- CI/CD Pipelines
- Git
Skills
- Agentic AI
- AI
- API
- AWS
- Azure
- Big Data
- CI/CD
- Cloud
- CUDA
- Data Engineering
- Data Modeling
- Databricks
- Delta Lake
- Distributed Computing
- Docker
- ELT
- ETL
- Fine Tuning
- GCP
- Generative AI
- Git
- GPU
- HPC
- Kubernetes
- LangChain
- LlamaIndex
- LLM
- Machine Learning
- Mistral
- MLflow
- MLOps
- Model Evaluation
- NoSQL
- Prompt Engineering
- PySpark
- Python
- RAG
- REST
- Spark
- SQL
- Vector Databases
Sign in to read and join the discussion.