Data Engineer
Posted Updated
Summary
Designs, builds, and maintains scalable data pipelines and architectures for federal government IT programs, integrating and transforming data from various sources and optimizing database performance. Works with data scientists and analysts using Python/Java/Scala, SQL, cloud platforms (AWS/Azure/GCP), and databases like Oracle, SQL Server, and PostgreSQL.
Business Technology Integrators (BTI) is a Service-Disabled Veteran-Owned Small Business (SDVOSB) with more than 25 years of experience delivering innovative and reliable IT and engineering solutions to the Federal Government. BTI supports mission-critical programs across defense and civilian agencies, with core expertise in cybersecurity, program management, enterprise IT, and technical oversight services.
Roles and Responsibilities
As a Data Engineer, the primary responsibility is to design, construct, and maintain scalable data pipelines and architectures to facilitate the collection, storage, and processing of large datasets.
This role involves working closely with data scientists and analysts to provide accessible and reliable data for analytics and reporting.
Data Engineers are tasked with integrating and transforming data from various sources, ensuring data quality, and optimizing database performance.
Additionally, they must stay current with industry trends and technologies to continuously improve data processes and systems.
Collaboration with cross-functional teams to understand data needs and implement data governance strategies is also a crucial aspect of the role.
Roles and Responsibilities
As a Data Engineer, the primary responsibility is to design, construct, and maintain scalable data pipelines and architectures to facilitate the collection, storage, and processing of large datasets.
This role involves working closely with data scientists and analysts to provide accessible and reliable data for analytics and reporting.
Data Engineers are tasked with integrating and transforming data from various sources, ensuring data quality, and optimizing database performance.
Additionally, they must stay current with industry trends and technologies to continuously improve data processes and systems.
Collaboration with cross-functional teams to understand data needs and implement data governance strategies is also a crucial aspect of the role.
Experience/Qualifications:
- Undergraduate college degree from an accredited college or university in computer science, statistics, mathematics, or other discipline related to the requirements of this project, or equivalent experience.
- At least 4 years of experience in data engineering, ETL (Extract, Transform, Load) processes, and data warehousing solutions.
- Strong proficiency in programming languages such as Python, Java, or Scala, as well as SQL for querying databases.
- Familiarity with technologies (e.g., AWS, Azure, Google Cloud).
- Experience with databases (e.g., Oracle, SQL Server, PostgreSQL, MySQL, NoSQL databases) and data modeling techniques.
- Knowledge of data privacy and security standards, along with experience in data governance practices.