Data Engineer: Scalable Pipelines, Airflow & Cloud
Posted Updated
Description
Red Alpha Cybersecurity is seeking aspiring Data Engineers who want to design robust data pipelines and enable data-driven solutions. You’ll collaborate with data scientists, analysts, and software engineers to deliver production-grade infrastructure.
Responsibilities include building scalable data pipelines, monitoring health, optimizing storage across Postgres, MSSQL, MinIO/S3 and Neo4j, and implementing orchestration with Airflow or AWS Step Functions. Proficiency in Python is a plus.
Design, build, and maintain scalable, reliable data pipelines to support diverse business and AI applications Take ownership of pipeline health. Proactively monitor performance, debug issues, and improve data quality Collaborate with cross-functional teams to translate data needs into technical solutions Implement data pipeline orchestration using tools such as Apache Airflow or AWS Step Functions Optimise data storage and retrieval across RDBMS (Postgres, MSSQL), object stores (MinIO/S3), and graph databases (Neo4j) Design data schemas (normalized, denormalized, star-schema) and enforce proper access and backup protocols Support analytics, product development, and AI POCs with clean, well-managed data structures Apply scripting (Python) and open-source tools to automate data workflows and ETL processes Design, build, and maintain scalable data pipelines. Collaborate with cross-functional teams to translate data needs. Take ownership of pipeline health and data quality.Skills
Sign in to read and join the discussion.