data engineer in media intelligence
Summary
Senior data engineer at Samba, a media intelligence company in Warsaw, leading the design and operation of large-scale data pipelines, datasets, and infrastructure using Python, Spark/PySpark, Airflow, Databricks, and AWS/GCP, with ownership of data quality, incidents, backfills, and mentoring other engineers.
Описание: Samba is a media intelligence company that provides real-time insights into what people watch, read, and think about across screens. Its consent-based data represents consumer attention at scale and helps the world’s biggest brands make smarter decisions.
Задачи:
- Lead the design and development of scalable, high-performance data pipelines and infrastructure powering analytics
- Resolve complex technical issues by understanding how different disciplines relate
- Lead the design, build, and maintenance of high-scale production datasets
- Ensure delivery of versioned outputs and reliable customer-facing reports
- Manage the full lifecycle of data features, including adding attributes, updating business logic, and safely rolling out changes from staging through performance checks to production
- Execute complex backfills and reprocessing
- Architect efficient data ingestion, transformation, and storage solutions that ensure performance, reliability, and security
- Proactively reduce compute and storage costs
- Serve as technical lead for production incidents, investigate root causes, implement permanent fixes, and validate data recovery across the ecosystem
- Advise others on complex matters and build relationships with key contacts outside the area of expertise
- Develop policies and ideas while mentoring and guiding engineers
- Improve monitoring and observability of data processes, debugging, error detection, and system reliability at scale
Требования:
- Typically 8+ years of related experience with a Bachelor’s degree, 6 years with a Master’s degree, or 3 years with a PhD
- Advanced knowledge of Python and a deep understanding of Apache Spark or PySpark
- Expertise in Apache Airflow and Databricks
- Extensive experience with cloud-based data infrastructure, including AWS or GCP, and modern data lake architectures
- Strong knowledge of data modeling, database design, and query optimization for relational and non-relational databases
- Proven track record of driving code quality, testing, and software design best practices in data engineering
- Ability to adapt communication style and use persuasion when delivering messages related to the wider business
Условия:
- Base salary of 312000 PLN - 395000 PLN per year for roles performed in Warsaw; the offered salary depends on location, experience, and performance
- Compensation may also include bonuses, short-term incentives, and long-term incentives
- Health insurance, wellness offerings, life and disability insurance, a retirement savings plan, paid holidays, paid time off (PTO), and other employee benefits