Senior Data Engineer: Big Data, Spark & Data Platforms
Posted Updated
Who recruits here Pro
Up to three recruiters at Ookla with their work email, so you can write to a person.
Part of Pro. How it works
Description
Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team and help process the world's best collection of data on mobile and fixed internet performance. You will build tools, libraries and pipelines to support data scientists and analysts across platforms like Spark, Redshift, and Airflow.
You should have a strong data-focused programming background and be passionate about accuracy and performance, with a willingness to mentor teammates while delivering
Develop high volume data processing jobs across various platforms including Redshift, Athena, Iceberg, Spark and Airflow Work closely with Data Scientists to turn theory and methodology into viable products Identify bottlenecks in system performance and make recommendations on improving process efficiency Support and collaborate with data scientists, analysts, and product managers You are enthusiastic about mentoring and guiding junior team members, helping them understand architectural principles, best practices, and effective ways of working. Bachelor's degree in Computer Science or related field or equivalent experience Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java) Strong background and 6+ years of direct experience working with Python Experience with high volume distributed data processing in Spark Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse) management Excellent troubleshooting and analysis skills Excited to learn and work with new technologies in a dynamic environment Strong communication skills both in person and via virtual mediums Strong time management skills and a self driven work ethic Experience with AWS cloud services is a plus Experience with event driven architecture and streaming data pipelines is a plus Background check requiredSkills
Sign in to read and join the discussion.