Data Engineer
Summary
Data Engineer on a Data & AI team modernizing a next-generation data platform: migrating legacy C#/.NET ingestion to AWS (S3, Lambda, Glue, Step Functions, API Gateway) and building ETL/ELT pipelines, APIs, and a Databricks Lakehouse using Python/C# and SQL Server.
About This Role.
We are looking for a hands-on Data Engineer to join a growing Data & AI team and help modernize and scale a next-generation data platform. This role will focus on migrating legacy C#/.NET-based ingestion processes to a cloud-native AWS architecture and building a modern analytical platform using Databricks/Lakehouse technologies.
About This Role.
We are looking for a hands-on Data Engineer to join a growing Data & AI team and help modernize and scale a next-generation data platform. This role will focus on migrating legacy C#/.NET-based ingestion processes to a cloud-native AWS architecture and building a modern analytical platform using Databricks/Lakehouse technologies. The ideal candidate has strong experience building scalable data pipelines, APIs, ETL/ELT workflows, and distributed data systems.
Key Responsibilities
- Design and build scalable ingestion pipelines using AWS S3, Lambda, Glue, Step Functions, and API Gateway.
- Develop Python and/or C#/.NET data-processing and integration solutions.
- Build APIs and file-based ingestion mechanisms for client data.
- Develop data mapping and transformation workflows into SQL Server.
- Help design and implement a Databricks Lakehouse platform.
- Optimize ETL/ELT pipelines for performance, reliability, and scalability.
- Support and modernize existing C#/.NET ingestion processes.
- Troubleshoot production data-pipeline issues.
- Implement data governance, security, and compliance practices for a multi-tenant SaaS environment.
- Collaborate with Software Engineering, Architecture, Product, Analytics, and Data Science teams.
Required Skills
- Strong AWS data engineering.
- Python and/or C#/.NET.
- SQL Server.
- ETL/ELT; API and file-based ingestion.
- Familiarity with Databricks, Spark, and Lakehouse architecture.
Nice to Have
- Azure DevOps/CI/CD, Amazon Bedrock/AgentCore, data governance and security, real-time processing, ML/AI pipelines, and multi-tenant SaaS experience.
Qualification
- Bachelor’s degree in Computer Science, IT, or a related field.
Experience
- 3+ years in Data Engineering.
Skills
Sign in to read and join the discussion.