Data Analyst
Summary
Analyze and optimize AI-powered chatbot performance for a federal client, using SQL, Python, and BI tools to track metrics, improve LLM responses, and streamline operations.
At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations.
Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to Work, we offer a collaborative and caring community where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more.
Join us to drive positive, lasting change that moves missions and the government forward!
Key Responsibilities:
Data Analysis & AI Performance
- Analyze chatbot performance metrics such as user satisfaction, deflection rates, response accuracy, latency, and token usage.
- Monitor LLM model performance to detect quality issues, edge cases, and opportunities for prompt or response optimization.
- Perform deep-dive analyses on user feedback, conversation patterns, and intent classification to improve the product.
- Design and execute A/B tests to measure the impact of new features, prompt changes, and model configurations.
Operations & Process Optimization
- Manage and optimize end-to-end workflows for model deployment, monitoring, and incident response.
- Build automated alerting systems for operational metrics, SLAs, and AI performance thresholds.
- Coordinate cross-functional workflows across data science, engineering, product, and business teams.
- Identify and resolve data quality issues, pipeline bottlenecks, and system inefficiencies through root cause analysis.
Analytics & Reporting
- Create and maintain dashboards in SQL, Python, and BI tools (Databricks, Splunk, Dynatrace).
- Develop executive-level reports on chatbot performance, user trends, ROI, and contact center impact.
- Build data documentation, metadata standards, and analytics playbooks for stakeholder self-service.
- Track and report KPIs such as user engagement, task completion, escalation patterns, and cost per interaction.
Business Intelligence & Requirements
- Translate business problems into data-driven solutions with measurable success criteria.
- Conduct qualitative and quantitative research to uncover user needs and feature opportunities.
- Write user stories with data-backed acceptance criteria, wireframes, and process flows.
- Lead requirements sessions and synthesize inputs into actionable insights and prioritized roadmaps.
AI-Specific Focus Areas
- Monitor guardrail effectiveness, content safety, and compliance with Responsible AI policies.
- Analyze multi-turn conversation flows for issues like topic drift and response inconsistency.
- Evaluate RAG performance including citation accuracy and knowledge base coverage.
- Track model cost drivers such as token consumption and resource usage to optimize efficiency.
Here is what you need:
- US Citizen (Public Trust eligible)
-
Strong data analysis skills: SQL and Python.
-
Working understanding of AI/ML concepts: LLMs, prompt engineering, model evaluation metrics, NLP fundamentals.
-
Experience with BI/visualization tools: Databricks, Splunk, Tableau, PowerBI, or similar.
-
Knowledge of conversational AI, chatbot analytics, and customer experience metrics.
-
Ability to communicate complex technical findings clearly and translate insights into executive-ready recommendations.
Preferred experience:
- Hands-on experience with GenAI chatbot analytics for high-volume user environments (1M+ monthly users).
- Direct involvement in LLM performance monitoring, guardrail testing, or RAG evaluation.
- Prior work optimizing AI operational workflows such as model deployment or incident response.
- Experience designing A/B tests or conducting deep-dive analysis on conversational data.
- Familiarity with operational monitoring tools such as Splunk or Dynatrace.
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
The pay range for the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland is:
$100,200—$203,400 USD
What We Believe
As a company wholly dedicated to serving the US federal government, we bring together the best talent to help reinvent how federal agencies operate and deliver greater value for their mission and the American people. We have an unwavering commitment to creating a culture in which all our people are respected, feel a sense of belonging, and have equal opportunity. As a business imperative, every person at Accenture Federal Services has the responsibility to create and sustain a culture where everyone feels welcomed and included. This is grounded in our core values and our experience that hiring and developing great people who reflect different perspectives, experiences, and backgrounds is key to driving innovation and delivering the results that our clients and the country count on.
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities. For details, view a copy of the Accenture Federal Services Equal Opportunity Policy Statement.
Accenture Federal Services is an Equal Employment Opportunity employer. Additionally, as an Affirmative Action Employer for Veterans and Individuals with Disabilities, Accenture Federal Services is committed to providing veteran employment opportunities to our service men and women.
Requesting An Accommodation
Accenture Federal Services is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture Federal Services and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process. Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired.
If you are being considered for employment opportunities with Accenture Federal Services and need an accommodation for a disability or religious observance during the interview process or for the job you are interviewing for, please speak with your recruiter.
Other Employment Statements
Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.
Candidates who are currently employed by a client of Accenture Federal Services or an affiliated Accenture business may not be eligible for consideration.
Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process.
The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Additionally, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the Company's legal duty to furnish information.
California requires additional notifications for applicants and employees. If you are a California resident, live in or plan to work from Los Angeles County upon being hired for this position, please click here for additional important information.
As published by greenhouse
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
- State choose one
- Are you at least 18 years of age? choose one
- Are you legally authorized to work in the United States? choose one
- Many AFS positions require US citizenship. Please indicate your citizenship status so we can determine eligibility for specific roles. choose one · optional
- Will you now or in the future require sponsorship for employment visa status (for example, H-1B visa status)? choose one
- Have you entered into a non-disclosure or non-compete agreement or understanding of any kind? choose one
- Have you worked at Accenture in the past? choose one
- How did you hear about us? choose one
- Do you hold a security clearance? choose one
- At your current employer, are you currently working on a project with Accenture or have you worked on a project with Accenture in the past 24 months? choose one
- Are you a current employee of the U.S. Government (including U.S. Congress or military) or any state or local government? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). NOTE: answer yes if you have accepted the “Fork-in-the-Road” offer, separated with a Deferred Retirement Plan, or are on administrative leave pending separation from the Government. choose one
- Will you be serving as enlisted personnel in either the Reserves or the National Guard while working for AFS? choose one
- Were you an employee of the U.S. Government (including U.S. Congress or military) or any state or local government within the past 10 years? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). choose one
- Do you have any family members or people you have close relationships with who work for Accenture Federal Services? choose one
- If yes, please list the full name of the employee(s) and your relationship to them. optional
- Affirmation choose one