Senior AI Engineer (Perm)
Job Title: Senior AI Engineer
Reports to: Practice Head: Data, AI and Automation
ROLE OVERVIEW
As an AI Engineer, you will be responsible for designing, developing, and deploying AI-driven solutions using advanced language models like GPT-3.5 and GPT-4. You will work closely with cross-functional teams to build applications that solve complex business challenges, optimize model performance, and ensure accuracy through rigorous evaluation metrics. Additionally, you will stay up-to-date with the latest AI advancements and contribute to the continuous improvement of our AI capabilities, while also mentoring junior team members.
TECHNICAL KNOWLEDGE
Strong knowledge and extensive experience in:
- Designing, developing, and maintaining applications powered by LLM models such as OpenAI’s GPT 3.5 or GPT 4 and various other providers.
- Utilizing orchestration libraries such as Langchain to build RAG (Retrieval-Augmented Generation) applications.
- Working with SQL and Azure SQL databases for data manipulation and retrieval.
- Implementing and managing vector databases such as Pinecone, Weaviate, and Chroma for retrieval capabilities within applications.
Strong knowledge and understanding of:
- Advanced retrieval techniques and chunking strategies within RAG applications to improve model efficiency.
- Evaluating AI models using robust metrics to ensure high accuracy and performance.
BEHAVIOURAL COMEPTENCIES
- Self-motivated, proactive, and results-oriented.
- Strong analytical and problem-solving skills.
- Ability to work in a fast-paced, dynamic, and collaborative environment.
- Comfortable with ambiguity and able to adapt to change.
- Ability to work independently and as part of a team.
- Passion for learning new technologies and staying up to date with the latest trends in data science and machine learning.
- Excellent written and verbal communication and collaboration skills.
- Shows promising leadership abilities.
- Strong business acumen.
RESPONSIBILITIES
- Work independently on complex projects.
- Design and implement complex predictive models or algorithms to drive business growth and improve customer experiences.
- Identify patterns and trends in data to drive insights and recommendations for business decisions.
- Design experiments and A/B testing to validate hypotheses and assess impact of data-driven solutions.
- Mentor and provide guidance to junior and intermediate data scientists.
- Be involved in project management and strategic decision-making.
- Be involved in data pipeline architecture design and implementation Collaborate with cross-functional teams to gather requirements, design solutions, and implement models.
- Communicate findings and recommendations to non-technical stakeholders in a clear and concise manner.
MINIMUM EXPERIENCE NEEDED TO BE SUCCESSFUL IN THIS ROLE
- A minimum of 5 years of software development experience, with a proven track record of deploying robust applications.
- Strong proficiency in Python and familiarity with SQL and SQL Databases.
- Experience with Langchain and its components such as Document Loaders, Text Splitters, Retrievers, Chains & Agents.
- Experience with vector embeddings either through third-party providers like OpenAI or other open sources embeddings models like Word2Vec.
- Experience with vector databases such as Pinecone, Weaviate, Chroma, or similar.
- Understanding of advanced retrieval techniques and chunking strategies within RAG applications is highly desirable.
- Knowledge of Generative AI evaluation metrics and managing hallucinations.