Data Integration Engineer
Novul Solutions Data Integration Engineer
Summary
Builds and maintains data pipelines and integrations for DISN network topology and operational data in a DoD mission environment, working heavily with Confluent Kafka, Elasticsearch/Logstash, and Kibana dashboards. Day-to-day work spans ETL development in Python, Java, and SQL within Agile/Scrum teams, plus technical documentation and security compliance.
Position Summary
We are seeking a Data Integration Engineer to support data engineering, system integration, and analytics efforts for DISN network topology and operational data. This role focuses on building and maintaining data pipelines, integrating distributed data sources, supporting Kafka and Elastic platform workflows, and enabling advanced data correlation and visualization.
The ideal candidate will have experience in software or data engineering, ETL pipeline development, Kafka or Elastic integrations, Kibana dashboarding, and Agile team collaboration. This position supports a DoD mission environment and requires strong technical documentation, communication, and security compliance awareness.
Primary Responsibilities:
- Support the integration, enrichment, and correlation of DISN network topology data for advanced analytics and operational insight.
- Develop, test, and deploy data pipelines and integration solutions across distributed systems and cloud environments.
- Build and maintain solutions using Python, Java, JavaScript, SQL, and related technologies.
- Gather requirements and collaborate with stakeholders to design data enrichment pipelines.
- Integrate diverse data sources into Confluent Kafka and Elastic platforms.
- Develop and maintain Kibana visualizations, dashboards, and analytics views.
- Support Kafka integrations between Elasticsearch, Logstash, and other systems.
- Participate in technical discussions with internal teams, external stakeholders, and mission partners.
- Work within Agile/Scrum teams to support sprint deliverables, peer collaboration, and project objectives.
- Communicate effectively with geographically distributed team members.
- Troubleshoot installation, infrastructure, integration, and system issues.
- Identify, report, and help mitigate technical risks.
- Develop and maintain technical documentation, including DoD requirements, interface documents, security artifacts, and system engineering documentation.
- Ensure solutions align with DoD security standards, guidelines, and platform sustainment requirements.
- Support operational reliability by helping resolve platform and integration challenges.
Requirements
Basic Qualifications:
- Bachelor’s degree with 4–8 years of related experience, or master’s degree with 2–6 years; equivalent experience may be considered.
- 4+ years of experience in software engineering, data engineering, business analysis, or data analysis.
- Hands-on experience with Python, Java, SQL, and working knowledge of JavaScript/HTML.
- Experience with Agile/Scrum teams and tools such as JIRA and Confluence.
- Experience with Git, Bitbucket, or similar version control tools.
- Experience with data analytics and visualization tools such as Kibana, Power BI, Tableau, or ELK.
- Experience designing, developing, and optimizing ETL processes, data pipelines, and data integrations.
- Experience with Kafka, Elastic, Elasticsearch, Logstash, or similar integration platforms.
- Background in data modeling, data enrichment, data unification, or analytics.
- Understanding of networking concepts, internet protocols, and network-centric environments.
- Experience developing and deploying software on UNIX/Linux command line platforms.
- Strong communication, coordination, and cross-functional collaboration skills.
Preferred Qualifications:
- Experience with CI/CD, DevOps, automated delivery, and containerized deployment pipelines.
- Experience with Kafka, Elastic, Spark, NiFi, ksqlDB, or Kafka Streams.
- Hands-on experience with Kafka connectors and Kafka integrations with Elasticsearch/Logstash.
- Experience designing streaming data applications and real-time data processing solutions.
- Experience with Docker, Kubernetes, AWS, or GovCloud environments.
- Experience configuring cloud infrastructure, networking, and security policies.
- Experience with full software lifecycle automation, including design, testing, deployment, and production release.
- Experience building automated testing pipelines using Ansible, Selenium, JMeter, JUnit, or similar tools.
- Experience developing software in DoD or DISA environments.
- Familiarity with DoD security standards, STIGs, and security compliance requirements.
- Ability to support DoD requirements, traceability matrices, project plans, software systems engineering documents, and interface documents.
- Familiarity with AI/ML concepts and data platform integration.
- Ability to work effectively in remote and geographically dispersed teams.
Benefits
Core Benefits:
- Paid Time Off PTO):TEN (10) Paid days off & FIVE (5) Floating days off.
- Holidays: 11 Paid Holidays. Flex time can be utilized instead of holiday time usage.
- Payroll: Paid Bi-Monthly.
- 401(k): Partnered with the SECOND LARGEST Retirement plan provider in the U.S. Guaranteed 3% match. Eligibility – 21 years of age or older, after 3 months of employment
- Individual or company-wide performance and recognition awards (Quarterly
Health Benefits:
- UNITED HEALTHCARE PPO, extensive national coverage.
- INCLUDES: Medical/Dental/Vision/HSA.
- Eligible on the first of the month, immediately after the start date.
- Submit the enrollment form within 30 days of your start date otherwise, you will have to wait until October for the new year enrollment.
Quality of Life Benefits:
- Training & Career Development Reimbursement of Tuition and training needed to support career development.
- $150 monthly reimbursement contribution paid monthly towards parking expenses.
- Receipts must be submitted by the close of business on the 25th of each month.
- Reimbursements will be paid on the first payroll AFTER reimbursements are submitted each month.
Special Benefits:
- Performance bonus – Project-based
- Yearly bonus – Company based