Data Engineer

Requirements:

• 6-9 years of experience in data engineering.
• Expert-level proficiency and hands-on experience in Python and Scala.
• Experience in SQL.
• Deep hands-on expertise with Apache Spark.
• Proven experience working with and implementing the Lakehouse Architecture using the Medallion Model (Bronze, Silver, Gold layers).
• Proven experience with MySQL, PostgreSQL, and MongoDB.
• Solid understanding of various ETL/data streaming architectures, including Kappa and Lambda architectures.
• Hands-on with Data Observability and Monitoring using Grafana and Prometheus.
• Hands-on experience with message brokers such as Kafka and/or Google Pub/Sub.
• Strong knowledge of data modeling principles (designing fact tables, dimension tables, and data marts).
• Hands-on in deployment using Kubernetes.
• Experience working in a multi-cloud environment, specifically with AWS and/or GCP.
• Practical experience with cloud-native or modern query engines like BigQuery, Trino, and/or Redshift.