LLM / Airflow Consultant
Posted Updated
Description
About the role
At Ad4Octógono, we are looking for an Experienced Consultant to join a key artificial intelligence and data processing project located in Madrid.
We are looking for a technical profile with at least 2 years of experience to integrate into a project focused on data flow orchestration and the optimization of AI-based information retrieval systems.
What you'll do
- Process orchestration: Design, maintain, and supervise data flows and business process pipelines using Apache Airflow as the central tool.
- Information retrieval and indexing: Configure and optimize search and ranking environments with OpenSearch, applying recalculation and relevance algorithms such as BM25.
- AI solution integration: Collaborate in the implementation and fine-tuning of systems based on Large Language Models (LLM).
- Analysis and modeling: Apply statistical knowledge for the evaluation of results, improvement of precision in information retrieval (retrieval), and analysis of model performance.
Essential Knowledge
- Apache Airflow: Solid experience in data pipeline orchestration.
- OpenSearch: Proficiency in its use and application of the BM25 algorithm for retrieval, indexing, and ranking of results.
- AI and LLMs: Practical experience working with Artificial Intelligence systems, especially focused on the integration of Large Language Models.
- Statistics: Good analytical and statistical foundation applied to data processing.
Skills
Sign in to read and join the discussion.