Data Engineer - Scala + Python

Technical Skills

Programming & Systems

• Strong proficiency in Python, Java, or Scala
• Deep experience with Linux/Unix systems and scripting

Data & Distributed Systems

• Strong experience with Apache Spark and big data ecosystems
• Experience with data ingestion and streaming technologies (Kafka, NiFi, or similar)

Orchestration

• Hands-on experience with Apache Airflow (or equivalent) for workflow orchestration

Cloud & Infrastructure

• Strong experience with AWS services (compute, storage, IAM, networking)
• Experience with Infrastructure as Code (Terraform, CloudFormation)
• Familiarity with containers and Kubernetes is a plus

Observability & Reliability

• Experience with monitoring/logging tools (Splunk, Prometheus, Grafana)
• Strong troubleshooting and performance tuning skills in distributed environments