Data Engineer Role in Amazon's Bot Management
Posted 6
views
Summary
Data engineer on Amazon's bot-management/traffic engineering team, building and operating high-throughput real-time and batch data pipelines that feed ML features used to detect and fight automated threats. Core stack: Python, Kinesis/Kafka streaming, AWS S3 and Redshift, working closely with science teams on data contracts.
Elevate your career with Amazon as a Data Engineer specializing in Traffic Engineering. Design robust data infrastructure for vital machine learning features critical for automating bot management.
This engineering-focused role centers around creating and optimizing data pipelines that manage real-time and batch processing. You'll collaborate closely with Scientists to understand and fulfill their data requirements, ensuring features are consistently available for model training and evaluation. Your work will involve using cutting-edge technologies and methodologies for data governance.
Key Responsibilities: • Architect and maintain high-throughput data pipelines • Develop and operate feature engineering processes • Implement streaming data flows using Kinesis and Kafka • Work with Science teams to establish effective data contracts • Ensure operational excellence and monitoring of pipelines
Requirements: • 3+ years in data engineering roles • Strong background in ETL and data warehousing • Familiarity with streaming data technologies • Proficient in at least one programming language like Python • Experience with AWS tools such as S3 and Redshift
Be an integral part of building Amazon's ML infrastructure in the fight against automated threats.
This engineering-focused role centers around creating and optimizing data pipelines that manage real-time and batch processing. You'll collaborate closely with Scientists to understand and fulfill their data requirements, ensuring features are consistently available for model training and evaluation. Your work will involve using cutting-edge technologies and methodologies for data governance.
Key Responsibilities: • Architect and maintain high-throughput data pipelines • Develop and operate feature engineering processes • Implement streaming data flows using Kinesis and Kafka • Work with Science teams to establish effective data contracts • Ensure operational excellence and monitoring of pipelines
Requirements: • 3+ years in data engineering roles • Strong background in ETL and data warehousing • Familiarity with streaming data technologies • Proficient in at least one programming language like Python • Experience with AWS tools such as S3 and Redshift
Be an integral part of building Amazon's ML infrastructure in the fight against automated threats.
