Data Engineer Role in Databricks
Summary
Data engineer at Fluent, Inc. building and maintaining Databricks data pipelines for audience segments using SQL, Python, and Spark. Day to day includes orchestrating Databricks jobs, exploring real-time processing, ensuring data observability, and collaborating with Data Science and commercial teams.
As a member of Fluent's innovative team, you will focus on data engineering tasks including orchestrating jobs in Databricks. Your expertise in tools like SQL, Python, and Spark will help maintain high-quality code while supporting audience segmentation using cutting-edge methodologies. Collaborate closely with Data Science and commercial teams to translate business needs into actionable requirements.
Key Responsibilities: • Develop and maintain data pipelines for audience segments • Utilize Databricks features for efficient data engineering • Investigate real-time processing capabilities of Databricks • Share knowledge through tech talks and team training • Maintain a high-quality codebase with data observability
Requirements: • Bachelor's or Master's degree in Computer Science • 4+ years of experience in Data Engineering • 2+ years with Databricks environment • Proficient in SQL, Python, Spark, and distribution • Experience with AI coding assistants
Accelerate your data engineering career by joining Fluent's dynamic team and exploring the latest in Databricks technology.