Data Engineer
Summary
Build and maintain SQL-based data pipelines, stored procedures, and SSIS packages; write Python utilities and unit tests; ensure data quality and performance in a Microsoft SQL Server environment.
- Develop small enhancements in SQL/DBT / SSIS or Python utilities following patterns and reviews.
- Add validation checks and logging; contribute to documentation and basic runbooks.
- Write basic unit tests; package and deploy via guided CI/CD workflows.
- Assist with data profiling, defect reproduction, and fixes within sprint.
- Design, code and maintain new and existing complex SQL stored procedures and functions. Review SQL code written by other developers to ensure compliance to coding standards and best practices as well as maximum performance.
- Work with other engineers to troubleshoot, repair and performance tune databases. Perform data analysis and data profiling tasks to provide support and recommendations for development and design decisions.
- Create SSIS packages for data transformation, cleansing, caching, aggregation, staging, and transfer. Define, prepare, execute, and implement data validation and unit testing methods to ensure data quality.
- Troubleshoot problems that may come up with database environments: performance issues; replication issues; or operational issues. Maintain re-useable development standards that help implement each solution and/or enhancements to existing systems to meet current and future needs.
- Work with Technical and business teams to understand the business requirements, functional and technical specifications.
Outcomes & KPIs
- Deliver S/M sized items to DoD with increasing independence and quality.
Qualifications
- 0–3 years' experience (or equivalent projects) in SQL and at least one of SSIS / DBT/Python.
- Understanding of Git fundamentals; familiarity with BI/reporting (Tableau/SSRS) is a plus.
Tools & Stack (Pod)
- Data: SQL Server, SSIS, DBT, Python, Fivetran
- BI/Reporting: Tableau, SSRS
- Governance: Collibra (lineage/catalog), Apigee / OutSystems (where applicable)
Education & Experience
- 3+ years working with relational DBs in a production environment, Microsoft SQL Server versions, and SSIS packages
- 3+ years' experience working in an Agile / SCRUM environment required