AI/ML Engineer
About the Role
Build a natural-language query feature that lets field users at a global pharmaceutical company ask about their data in plain English, for example whether a customer is in their territory, and get answers limited to the data each user may see. The platform, Copilot in Power BI or Databricks AI/BI Genie, is selected early in the project based on the client's licensing. Your focus is answer accuracy: you will build the question set from the users' most common workflows, tune the feature, and measure accuracy through user acceptance testing.
What You Will Do
- Set up natural-language query on the selected platform, Copilot in Power BI or Databricks AI/BI Genie, over a curated semantic model.
- Build the question set from the field users' five most common workflows and agree on the expected answers with the client.
- Tune instructions, example queries, descriptions and verified answers until the agreed questions are answered correctly.
- Confirm that answers are limited to the data each user may see.
- Run answer-accuracy validation in user acceptance testing against the agreed question set, and fix failures.
- Hand over the question set, the test results and the tuning notes.
What You Bring
- 7 to 10 years in data, analytics or machine learning engineering, including hands-on delivery of at least one LLM application over business data.
- Hands-on experience building natural-language query solutions over structured data with Databricks AI/BI Genie, Copilot in Power BI or custom text-to-SQL.
- Experience measuring answer accuracy against a fixed question set with expected answers, and re-running it after every change.
- Knowledge of how these tools enforce each user's data permissions, and experience testing them with restricted user accounts.
- Strong SQL.
- Bachelor's degree in engineering, computer science, data science or a related field.
Nice to Have
- Experience with both Databricks AI/BI Genie and Copilot in Power BI.
- Unity Catalog, metric views and Power BI semantic models.
- Pharmaceutical or other regulated-industry data.
Certifications (Preferred)
- Preferred: Databricks Certified Generative AI Engineer Associate.
- Also valued: Databricks Certified Data Analyst Associate.