AI Search Analyst (Remote, Full-Time) [HR224] (PK)
Description
As an AI Search Analyst, you will track and evaluate how a leading UK online electrical retailer performs across AI-powered search platforms, turning insights into meaningful business decisions. As more customers turn to AI assistants for product recommendations, understanding AI visibility and its commercial impact is becoming increasingly important.
You will lead AI search measurement as part of an embedded AEO/GEO programme, collaborating closely with the AEO/GEO Lead, commercial analytics, paid search, trading and senior marketing stakeholders.
You will develop robust measurement frameworks, strengthen attribution and deliver actionable insights that enable senior leaders to assess performance, identify opportunities and understand how AI search contributes to revenue.
Responsibilities
- Lead end-to-end AI search measurement, competitive benchmarking and performance reporting.
- Conduct weekly AI visibility benchmarks across ChatGPT, Gemini, Perplexity, Copilot and Google AI experiences, covering large appliances, TVs and audio, mobiles, small appliances and smart home categories.
- Automate prompt testing, scoring and data collection using LLM APIs and AI visibility platforms.
- Build and maintain clean, structured and easily accessible datasets.
- Assess AI-generated responses for citations, product recommendations, ranking positions, sentiment and factual accuracy against competitors.
- Apply statistical techniques to evaluate data variance, sample sizes, confidence intervals and changes in AI models.
- Track AI-driven traffic, conversions and revenue through GA4 and BigQuery.
- Measure the effectiveness of AEO/GEO initiatives and structured data improvements using controlled comparisons where possible.
- Analyse the relationship between AI search, paid search and organic search performance.
- Develop and maintain Looker Studio dashboards for marketing and retail stakeholders.
- Deliver weekly performance updates, highlighting key findings and actionable recommendations.
- Prepare targeted performance reports for Black Friday and major product launches.
- Identify and investigate inaccuracies in AI-generated information relating to pricing, delivery, price matching and customer reviews.
- Work closely with analytics, paid search, trading and marketing teams to turn insights into business actions.
Requirements
- 3+ years of experience in digital, marketing or ecommerce analytics.
- Strong Python and SQL skills, including API scripting and automated data collection.
- Experience with GA4, BigQuery and Looker Studio, or an equivalent analytics stack.
- Confident Excel skills.
- Solid understanding of statistics, including sampling, variance, significance and limitations of observational data.
- Experience with, or a clear interest in, LLM APIs and evaluating model outputs.
- Understanding of SEO or paid search data and its relationship with revenue.
- Ability to independently build and maintain data pipelines.
- Ability to analyse complex, changing datasets and communicate clear, evidence-based insights to senior stakeholders.
- Strong analytical rigour and the ability to explain findings to non-technical audiences.
- A sceptical, evidence-led mindset with the confidence to challenge weak attribution assumptions.
Nice to Have
- Hands-on experience with AI visibility platforms such as Profound, Peec AI, Ahrefs Brand Radar or Semrush's AI toolkit.
- Experience with LLM evaluation methods, including automated scoring of model responses.
- Experience working in retail businesses with significant seasonal demand peaks.
- Background in consumer electricals or high-consideration retail.
- Experience with experiment design or causal inference in marketing.
Skills
As published by lever · 16 questions
Basics
In which location did you find the job?, Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL
Short answers (1)
- Please share your LinkedIn profile URL. Ensure that your profile has a clear and recent profile picture, as it will be used for identity verification and to identify you throughout the recruitment process.
Pick from a list (15)
- Please respond truthfully. How many years of professional experience do you have in digital analytics, marketing analytics or ecommerce analytics?
- Please respond truthfully. What is your level of professional experience using Python for API scripting, automated data collection and building data pipelines?
- Please respond truthfully. What is your level of professional experience using SQL to query, analyse and manage datasets?
- Please respond truthfully. What is your level of professional experience using GA4 to analyse website traffic, conversions and revenue attribution?
- Please respond truthfully. What is your level of professional experience using BigQuery or an equivalent analytics data platform?
- Please respond truthfully. What is your level of professional experience applying statistical methods such as sampling, variance, significance testing and confidence ranges to business analysis?
- Please respond truthfully. What is your level of professional experience building and maintaining Looker Studio dashboards or equivalent business intelligence dashboards?
- Please respond truthfully. What is your level of spoken and written English?
- Are you comfortable working the fixed shift hours of 8:00 AM – 5:30 PM UK time, Monday to Friday, ensuring at least 6 hours of overlap with UK business hours?
- We are looking for candidates who can start within the next 30 days. ⚠️ Providing false or misleading information will result in disqualification. Candidates progressing to the next stage will be required to upload proof of their notice period or last working day before meeting the client. When is your earliest realistic start date?
- What is your current salary in USD PER YEAR? We will cross-check references later in the process. optional
- What is your minimum expected salary in USD PER YEAR? optional
- Are you applying under your own identity, and do you confirm that you will personally complete all interviews and assessments and perform the work yourself if hired?
- Are you open to negotiation?
- Do you acknowledge that submitting more than one application for the same role, or providing any false or misleading information, will automatically and permanently disqualify you from the recruitment process?
Sign in to read and join the discussion.