Principal Data Engineer
Summary
Design and maintain scalable data pipelines using Databricks, dbt, AWS services, Python, and Java, while mentoring junior engineers and collaborating with stakeholders.
Responsibilities
- Design, build, and maintain scalable, efficient data pipelines and systems
- Evaluate and prototype new tools and technologies, assessing risks and benefits
- Build and maintain scalable data pipelines and models using Databricks, dbt, and SQL
- Develop robust data solutions leveraging AWS services including Redshift, RDS, S3, Glue, Lambda, DMS, and CloudWatch
- Implement data transformations and integrations using Python and Java
- Implement infrastructure-as-code using Terraform
- Monitor and optimize system health using CloudWatch and Splunk
- Mentor junior engineers and conduct code reviews
- Collaborate with cross-functional stakeholders in agile environments
Requirements
- Bachelor\'s degree in Computer Science, Engineering, or a related technical field
- 10+ years of professional experience in data engineering
- Deep expertise in Databricks
- Strong hands-on experience with AWS native services
- Proficiency in dbt, SQL (PostgreSQL), Python, and Java
- Proven leadership experience in technical teams
- Must be a US Citizen and able to obtain Public Trust clearance
Preferred Qualifications
- Experience with Kafka for streaming and data pipelines
- Experience with Docker and Kubernetes
- Proficiency with Splunk for log aggregation
- Experience using Terraform for infrastructure automation
- Advanced SQL skills including performance tuning
Benefits
- Remote Work
- Medical, Dental, and Vision
- 401(k) with 4% matching
- Liberal PTO vacation policy
- Generous Annual Continuing Education
- Annual Wellness Budget
- Bonus Incentive Programs
About the Company
Capital Technology Group (CTG) provides expert consulting services in software development, digital transformation, data analytics, and cybersecurity for federal and commercial clients.