Data Engineer
Posted Updated 1
view
Summary
Designs and maintains cloud-based data pipelines and ETL processes for a federal agency, ensuring reliable data flow and analytics using AWS services like Glue, Redshift, and Spark.
This is a remote position.
JOB SUMMARY:
Genesis Consulting has an immediate opportunity for an experienced Data Engineer to join our team and support a Federal Agency project centered around Data Management and Analytics. The ideal candidate will be responsible for designing, building, and maintaining data pipelines and ETL processes to ensure the efficient movement and transformation of data across cloud-based platforms. This role requires a strong technical background in data engineering and a passion for optimizing data workflows in a collaborative environment.
DUTIES AND RESPONSIBILITIES:
- Design and build robust data pipelines and ETL processes to support data ingestion, transformation, and integration from various sources into cloud-based data warehouses.
- Implement data validation, cleansing, and quality assurance processes to ensure the integrity and reliability of data for analytics and reporting purposes.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions that enhance analytical capabilities.
- Optimize data storage and processing solutions in AWS Cloud, utilizing services such as AWS Glue, Redshift, S3, and Apache Spark.
- Develop and maintain documentation for data workflows, data models, and architectural designs to ensure transparency and best practices in data engineering.
- Monitor and troubleshoot data pipeline performance, identifying and resolving issues to ensure continuous and reliable data operations.
- Stay current with emerging technologies and tools in data engineering and cloud computing to implement innovative solutions that meet business needs.
Requirements
MINIMUM QUALIFICATIONS/EXPERIENCE:
- Minimum of 5 years of experience in data engineering or related fields in a public sector or federal government setting, with a strong focus on ETL processes and data pipeline development.
- Proficiency in programming languages such as Python, SQL, and Scala, with practical experience in data processing frameworks.
- Hands-on experience with cloud platforms, specifically AWS, and tools like AWS Glue, Apache Spark, DataStage, and Redshift.
- Strong understanding of data governance and compliance standards, particularly in federal environments.
- Excellent analytical and problem-solving skills, with the ability to work independently and manage multiple priorities.
- Effective communication skills, with the ability to collaborate with technical and non-technical stakeholders.
MINIMUM EDUCATION:
Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field
REQUIRED CERTIFICATIONS:
None Required
OTHER:
- U.S. Citizenship Required.
- Ability and willingness to obtain security clearance.