Data Engineer, Finance (R6329)
Summary
Shield AI is hiring a Data Engineer to build the governed data foundation for its Finance org on Databricks — building pipelines, semantic-layer infrastructure, and AI-enabled data services, with FinOps cost management. Core stack: SQL, Python/PySpark, Databricks, Delta Lake, and cloud data platforms.
Job Description:
Shield AI is seeking a Data Engineer to build the reliable, governed data foundation for Finance's next generation of planning and decision support. Working on our Databricks platform, you will own reusable integrations, semantic-layer infrastructure, and production data services that support analytics and AI-enabled applications. You will combine engineering rigor with AI-assisted development to increase delivery speed, reliability, and cost efficiency.
What you'll do:
- Build and operate scalable pipelines and integrations connecting enterprise data to Finance products.
- Develop semantic-layer infrastructure and governed data access for analytics, planning, and AI applications.
- Establish end-to-end pipeline observability, data-quality controls, and resilient operations.
- Engineer the services and integrations behind Databricks Genie and other AI-enabled Finance workflows.
- Use AI coding assistants to accelerate development while validating correctness, security, and performance.
- Apply FinOps practices to manage platform spend and optimize cost without compromising service quality.
- Partner with analytics engineers and enterprise teams on architecture, data contracts, and sustainable ownership.
Required qualifications:
- Hands-on production data engineering experience with SQL and Python or PySpark.
- Experience with cloud data platforms, orchestration, data modeling, and governed serving patterns.
- Ability to design for observability, recoverability, security, and maintainability.
- Proficiency with AI coding assistants and independent validation of generated work.
- Practical experience enabling AI capabilities on enterprise data, ideally in Databricks; adjacent Snowflake Cortex or comparable experience is welcome.
- Strong cross-functional collaboration and production ownership.
Preferred qualifications:
- Experience with Databricks, Delta Lake, cloud infrastructure, and deployment automation.
- Experience developing AI application backends, model integrations, or LLM-based workflows.
- Experience with FinOps, financial data, or enterprise-system integrations.
Skills
As published by lever · 17 questions · 8 written answers
Basics
Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website
Short answers (1)
- Please state your full legal name:
Pick from a list (8)
- Are you authorized to work in the United States?
- Will you require sponsorship for employment now or in the future?
- Shield AI provides technology, services, and support to the United States military and allied forces with their various missions. If selected for employment with Shield AI, your contributions will directly relate to and/or support these missions. Are there any reasons why you would not be able to fully contribute in support of the U.S. military and allied forces?
- How did you hear about us?
- Are you a transitioning service member?
- If yes, what partnership program are you working with? optional
- Are you local to or willing to relocate? optional
- What office(s) would you be willing to relocate to? (Select all that apply) optional
Written answers (8)
- If yes, what type of sponsorship? optional
- (Optional) If you selected other or would like to expand on the above, feel free to do so below: optional
- If "Industry Conference" or "Other," please provide more details: optional
- If other, please provide further details optional
- When are you available to start your fellowship? optional
- When are you available for full time work? optional
- What full time job(s) are you applying for?
- If you selected international, what location(s)? optional