Data Engineer, Amazon Traffic Engineering Mid
Summary
Data Engineer joining Amazon's Traffic Engineering organization in Vancouver to build next-generation bot detection and mitigation. Day-to-day work involves processing traffic data at scale with Python, SQL, Spark, Airflow, and AWS services (EMR, Redshift, Kinesis), including real-time streaming pipelines and behavior-based ML models.
Data Engineer, Amazon Traffic Engineering
We are seeking a talented Data Engineer to join Amazon's Traffic Engineering organization in developing next-generation bot detection and mitigation capabilities. As a Data Engineer, you'll be at the forefront of revolutionizing how we understand and leverage Traffic data used in Bot detection and mitigation. This is a critical challenge at the intersection of ML and cybersecurity.
Skills, with evidence
- Airflow / orchestration As the bridge between raw data and meaningful insights, you'll work with a diverse array of technologies, including Python, EMR, Spark, and Airflow. must have
- Python Your expertise will solve crucial challenges in data processing and analytics. must have
- SQL 1+ years of developing and operating large-scale data structures for business intelligence analytics using SQL experience. must have
- Spark You'll tackle complex problems like real-time data processing, ensuring data accuracy across multiple platforms, and creating scalable solutions that can handle exponential growth in data volume. must have
- AWS Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions. must have · not practised here
- Streaming With GenAI/LLM-powered bots now capable of mimicking human behavior, evading traditional detections, and monetizing attacks, we must revolutionize our approach from reactive to real-time protection.
- 1+ years of developing and operating large-scale data structures for business intelligence analytics using data modeling experience
- Governance & security You'll be a key player in maintaining data governance and compliance, implementing sophisticated access controls, and ensuring data security through encryption and audit mechanisms. not practised here
- Machine learning This role offers the unique opportunity to implement first-of-its-kind real-time behavior-based ML models that will safeguard Amazon's global infrastructure. not practised here
