Data Engineer: Build Scalable Pipelines & Data Lakehouse
Posted Updated
Description
Sonatype is seeking a data engineer to build and maintain reliable data pipelines, develop analytics-ready data models, and ensure data quality across platforms. You will work with Spark, AWS services, and NoSQL stores while applying SQL and Python/Java/Scala skills across collaborative teams.
The role emphasizes CI/CD, documentation, and opportunities to influence our data lakehouse architecture and platform roadmap, in a cloud-first environment that values autonomy and learning.
Build and maintain reliable data pipelines and ETL/ELT workflows. Develop and optimize data models for analytics and internal tools. Work with team members to deliver clean, trusted datasets. Support core data platform tools like Spark and AWS (S3, SNS, SQS, ECS/Fargate, EMR). Monitor data pipelines for quality, performance, and reliability. Write clear documentation and contribute to test coverage and CI/CD processes. Help shape our data lakehouse architecture and platform roadmap. Bachelor's degree in Computer Science, Engineering, or related field. 2–4 years of experience in data engineering or backend data roles. Strong skills in Java, Scala, or another backend programming language. Python (PySpark/pandas) skills. Experience with SQL and distributed data systems (e.g., Spark, Kafka, SQS). Familiarity with NoSQL stores like Cassandra, HBase, or similar. Understanding of data modeling for analytics and reporting. Proficient in English with strong communication skills—able to explain or demo work to non-engineers. Self-driven — picks up new technologies and frameworks with little guidance. Debugs methodically; breaks complex problems into smaller steps. Open to feedback — iterates and improves through code reviews. Uses AI-assisted engineering tools (Claude Code, Codex, Cursor, etc.) as part of daily workflow. Reliable internet connection to sustain video, audio, and screen sharing. Parental leave Diversity and Inclusion groups Flexible workingSkills
Sign in to read and join the discussion.