Senior Big Data Platform Engineer Role
Posted 1
view
Summary
Senior engineer who designs and supports scalable big data pipelines and leads on-prem-to-AWS migrations. Day to day involves building real-time streaming workflows with Kafka and Spark Streaming, implementing ETL (SSIS), and managing AWS services such as EMR, S3, and Airflow with Netezza and SQL optimization expertise.
Join us as a Senior Big Data Platform Engineer, focusing on Netezza and AWS. This role emphasizes the development and support of advanced data pipelines in a high-energy enterprise setting.
We are seeking a Senior Engineer with deep expertise in Big Data technologies, including Netezza, Kafka, and Spark Streaming. This position involves leading data migrations to AWS and supporting data architecture modernization efforts. You will collaborate closely with teams to implement ETL processes and maintain optimal data workflows.
Key Responsibilities: • Design and support scalable data pipelines leveraging AWS technologies • Spearhead migration projects transitioning from On-Prem to AWS • Implement ETL processes using tools such as SSIS • Manage AWS services, focusing on EMR, S3, and Airflow • Build real-time data workflows using Spark Streaming
Requirements: • Extensive experience with Netezza, Airflow, and AWS EMR • Strong competency in Big Data tools and architectures • Skilled in data ingestion and SQL optimization • Ability to troubleshoot and ensure system reliability • Experience working in cross-functional teams
Apply your skills in data engineering and cloud technology to help us innovate.
We are seeking a Senior Engineer with deep expertise in Big Data technologies, including Netezza, Kafka, and Spark Streaming. This position involves leading data migrations to AWS and supporting data architecture modernization efforts. You will collaborate closely with teams to implement ETL processes and maintain optimal data workflows.
Key Responsibilities: • Design and support scalable data pipelines leveraging AWS technologies • Spearhead migration projects transitioning from On-Prem to AWS • Implement ETL processes using tools such as SSIS • Manage AWS services, focusing on EMR, S3, and Airflow • Build real-time data workflows using Spark Streaming
Requirements: • Extensive experience with Netezza, Airflow, and AWS EMR • Strong competency in Big Data tools and architectures • Skilled in data ingestion and SQL optimization • Ability to troubleshoot and ensure system reliability • Experience working in cross-functional teams
Apply your skills in data engineering and cloud technology to help us innovate.