Data Engineer
Posted Updated
Summary
Design, build, and maintain scalable ETL/ELT data pipelines and real-time streaming solutions for a defense contractor, supporting data scientists and analysts. Work is fully onsite in a SCIF at STRATCOM in Omaha, NE, and requires an active Top Secret/SCI clearance and 5+ years of data or software engineering experience.
About Agile Defense
At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.
Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.
Requisition #: 1956
Job Title: Data Engineer
Location: Omaha, NE
Clearance Level: Top Secret/SCI required
Job Description
- Design, build, and maintain highly scalable, reliable, and efficient data pipelines for extracting, transforming, and loading (ETL/ELT) data from various sources into data warehouses, data lakes, and other storage systems.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the efficient flow of data across various platforms and systems. Develop, deploy, and maintain real-time data streaming solutions to process and deliver data with low latency (using tools like Apache Kafka, Flink, or Spark Streaming).
- Optimize and automate data workflows, ensuring that data pipelines are efficient, reliable, and capable of handling increasing data volumes.
- Oversee the development of data models and schema designs to ensure accurate, accessible, and high-performance data storage for analytics and reporting.
- Ensure data quality, integrity, and consistency by implementing data validation, monitoring, and error-handling mechanisms.
- Monitor and troubleshoot performance bottlenecks in data systems, resolving issues with data processing and data access.
- Stay current with emerging trends and best practices in data engineering, recommending new tools, technologies, and methods to enhance existing infrastructure.
- Mentor and guide junior data engineers, promoting best practices in data engineering and fostering a collaborative, high-performance team environment.
Education and Background
- Typically has a Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (masters degree preferred)., and 5+ years of experience in data engineering or software engineering, with demonstrated experience in designing and managing complex data pipelines., or equivalent relevant work experience; e.g., each year of work experience may be substituted for each year of education required.
Years of Experience
5+ years
Required Skills
- Strong understanding of data validation, model testing, and performance evaluation techniques.
- Experience with data visualization and storytelling using tools such as Tableau, Plotly, or Matplotlib.
- Excellent technical communication skills, with the ability to explain complex concepts to non-technical audiences.
Preferred Skills
- 4+ years of experience in applied data science, machine learning engineering, or data pipeline development.
- Proficient in Python, SQL, and distributed data frameworks (e.g., Spark, Databricks, PySpark).
- Experience developing ML models from training to deployment using industry-standard tools and libraries (e.g., scikit-learn, TensorFlow, XGBoost, MLflow).
- Familiarity with MLOps, API development, and secure cloud-based environments (e.g., AWS, Azure, Palantir Foundry).
Working Conditions
Onsite in a SCIF in STRATCOM
Our Core Values
Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together.
What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.
- Happy - Be Infectious. Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.
- Helpful - Be Supportive. Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.
- Honest - Be Trustworthy. Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.
- Humble - Be Grounded. Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.
- Hungry - Be Eager. Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.
- Hustle - Be Driven. Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
Skills
As published by lever · 22 questions · 5 written answers
Basics
Resume/CV, Full name, Email, Phone, Current location, Current company
Short answers (2)
- What is your full street address? (Street, City, State, Zip)
- What is your desired salary?
Pick from a list (14)
- Do you have a Department of Defense (DOD) Recognized Security Clearance?
- What level of DOD clearance do you have?
- Are you authorized to work in the United States?
- Will you now or in the future require sponsorship for employment visa status (e.g., H-1B visa status)?
- Are you open to relocating for this position, or another position with Agile Defense?
- Are you a current employee of Agile Defense or any of its subsidiaries, affiliates, or acquired companies?
- Have you ever been employed by Agile Defense or any of its subsidiaries, affiliates, or acquired companies?
- How did you hear about us?
- Do you have a higher education degree?
- What is your highest level of education?
- Do you have any active industry related certifications?
- Are you a current or former U.S. Government employee or U.S. armed forces?
- Are you currently subject to any post-employment obligations from a current or former employer that could restrict your ability to perform this role if hired?
- I certify that the information provided is accurate to the best of my knowledge and understand that additional details may be requested later in the hiring process.
Written answers (5)
- If you were referred, please list the referrer's name and any other details here: optional
- What active industry related certifications do you have?
- If yes, please briefly describe the type of obligation and its duration (you may exclude employer names and confidential terms). If no, please respond with "N/A".
- If hired, would you have any ongoing outside employment, consulting, or business activities that could conflict with this role or the company’s interests?
- If yes, please briefly describe. If no, please respond with "N/A".
Attachments (1)
- Please upload a copy of your certification(s) if applicable optional