Senior Big Data Pipeline Engineer
Posted
Description
Design scalable big data pipelines as a Senior Data Engineer on a fully remote team, using Python, SQL, and cloud platforms.
This senior position supports advanced analytics and machine learning initiatives through reliable data infrastructure. You will build batch and real-time processing solutions, work with vast datasets, and improve data access. Collaboration with data scientists and analysts remains central to understanding requirements and delivering efficient systems.
Key Responsibilities:
- Design and optimize scalable batch and real-time data pipelines
- Build cloud data warehouses and data lakes
- Implement ETL and ELT processes from varied sources
- Ensure data quality, integrity, and reliability
- Monitor infrastructure and address performance issues proactively
Requirements:
- Six or more years in data engineering or related work
- Bachelor's degree in Computer Science, Engineering, or related field
- Big data pipeline experience with Spark, Hadoop, or Hive
- Proficiency in SQL and relational or NoSQL databases
- Python, Scala, or Java programming skills
Apply senior data engineering expertise across pipelines, cloud infrastructure, SQL, and big data processing in a remote setting.
Skills
Sign in to read and join the discussion.