Data Engineer
Summary
Accenture Federal Services is hiring a Data Engineer in Washington, DC to build, maintain, and optimize batch and streaming data pipelines on Google Cloud (BigQuery, Dataflow/Beam, Dataproc/Spark, Pub/Sub, Composer/Airflow) supporting analytics and AI workloads for US federal government clients. US citizenship and Public Trust clearance eligibility required.
Key Responsibilities
Core Data & AI Pipeline Development
- Build, maintain, and optimize batch and streaming data pipelines to support analytics and AI workloads.
- Ingest structured, semi structured, and unstructured datasets from APIs, databases, SaaS systems, streaming feeds, and file based sources.
- Transform, clean, enrich, and standardize data using Dataflow (Apache Beam), Dataproc (Spark), BigQuery SQL, and Python.
- Deliver high quality curated datasets into BigQuery for analytics, reporting, and machine learning training.
- Build and maintain ML ready feature pipelines supporting Data Scientists and ML Engineers.
Data Quality, Governance & Operations
- Implement data quality checks, schema validation, and automated testing within pipelines.
- Monitor pipeline health and apply observability best practices using Cloud Monitoring and Cloud Logging.
- Apply governance, security, and compliance standards including IAM roles, encryption, data masking, and auditing.
- Enforce schema evolution policies, metadata management, and lineage tracking using Dataplex/Data Catalog.
- Maintain documentation for datasets, transformations, pipeline logic, and operational procedures.
Engineering & Collaboration
- Write efficient, maintainable Python, SQL, Beam, and Spark code.
- Manage ingestion flows using Pub/Sub, GCS, APIs, Datastream, and database connectors.
- Optimize BigQuery tables, partitions, clustering, materialized views, and query performance.
- Implement and maintain DAGs with Cloud Composer (Airflow).
- Troubleshoot pipeline failures, latency issues, and data quality gaps.
- Participate in code reviews, architectural discussions, and agile sprint ceremonies.
- Collaborate with Data Architects, Data Scientists, ML Engineers, and business stakeholders.
- Develop and maintain Infrastructure as Code using Terraform and CI/CD deployment pipelines.
Required Qualifications
- Must be a U.S. Citizen with ability to obtain a Public Trust clearance.
- Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Data Engineering, or related technical field.
- 3–6+ years of hands on experience in data engineering or a similar technical field.
- Minimum three years of experience leading technical teams to achieve outcomes.
- Experience developing and implementing technical standards for cloud and on prem environments.
- Proven experience building production data pipelines on cloud platforms, preferably GCP.
- Hands on experience with BigQuery, GCS, Dataflow (Apache Beam), Dataproc (Spark), and Pub/Sub.
- Experience preparing ML ready datasets for model training.
- Strong background in SQL, Python, distributed data processing, and data modeling.
- Experience with governance, security, and compliance frameworks including IAM, encryption, data masking, and auditing.
- Familiarity with the following tool categories (VAEC Operational Tools):
- Google Cloud Security tools
- Google Cloud Monitoring & Logging tools
- Google Cloud Networking
- Google Storage services
Preferred Experience
- Master’s degree in a technical field.
- Previous experience in Federal Government environments.
- Knowledge of regulated environments such as FedRAMP, HIPAA, PCI, NIST 800 53, and CIS benchmarks.
- Security certifications such as CISSP or CCSP.
- Experience with Vertex AI workflows or comparable ML platforms.
- Familiarity with Dataplex, data governance frameworks, and metadata management.
- Experience with Apache Kafka or other streaming technologies.
- Experience with Datastream for change data capture (CDC).
- Knowledge of regulated industries such as public sector, healthcare, or finance.
- Strong communication skills and the ability to convey complex data concepts clearly.
- Experience with BI tools such as Looker or Looker Studio.
- Experience with third party tools such as Armis, BigFix, CrowdStrike, Tenable Nessus, Turbot, ServiceNow, Dynatrace, Splunk, and more.
- Hands on experience with DevOps tools and methodologies, including Ansible, GitHub, Jira, Terraform, CI/CD, and cloud migration tools.
- Knowledge in ML enablement, feature stores, and ML pipeline patterns.
- Experience with data quality and testing frameworks such as Great Expectations or dbt tests.
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Connecticut, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Ohio, Vermont, Virginia, Washington, and the District of Columbia. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
Skills
- Agile
- AI
- Airflow
- Analytics
- Ansible
- API
- BigQuery
- CI/CD
- Cissp
- Cloud
- Cloud Security
- Crowdstrike
- Data Engineering
- Data Governance
- Data Modeling
- Data Pipelines
- Data Quality
- dbt
- DevOps
- Dynatrace
- Fedramp
- GCP
- GitHub
- Hipaa
- IAM
- Infrastructure as Code
- Jira
- Kafka
- Looker
- Looker Studio
- Machine Learning
- Metadata Management
- Nessus
- Networking
- Nist
- Observability
- Python
- SaaS
- ServiceNow
- Spark
- Splunk
- SQL
- Terraform
- Test Automation
- Vertex AI
As published by greenhouse · 16 questions
Basics
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
Short answers (1)
- If yes, please list the full name of the employee(s) and your relationship to them. optional
Pick from a list (15)
- State
- Are you at least 18 years of age?
- Are you legally authorized to work in the United States?
- Many AFS positions require US citizenship. Please indicate your citizenship status so we can determine eligibility for specific roles. optional
- Will you now or in the future require sponsorship for employment visa status (for example, H-1B visa status)?
- Have you entered into a non-disclosure or non-compete agreement or understanding of any kind?
- Have you worked at Accenture in the past?
- How did you hear about us?
- Do you hold a security clearance?
- At your current employer, are you currently working on a project with Accenture or have you worked on a project with Accenture in the past 24 months?
- Are you a current employee of the U.S. Government (including U.S. Congress or military) or any state or local government? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below). NOTE: answer yes if you have accepted the “Fork-in-the-Road” offer, separated with a Deferred Retirement Plan, or are on administrative leave pending separation from the Government.
- Will you be serving as enlisted personnel in either the Reserves or the National Guard while working for AFS?
- Were you an employee of the U.S. Government (including U.S. Congress or military) or any state or local government within the past 10 years? This includes entities owned or controlled by the U.S. Federal Government, such as Amtrak, the United States Postal Service, and USAID (see list of exceptions below).
- Do you have any family members or people you have close relationships with who work for Accenture Federal Services?
- Affirmation