Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

CoStar Realty Information

NewBe an early applicant

Senior Data Engineer: Lakehouse & Real-Time Pipelines

Posted Updated

Description

CoStar Realty Information seeks a Senior Data Engineer to design and build scalable data solutions on a Lakehouse platform, partnering with data scientists, analysts, product managers and engineers across the Domain Group. You will craft robust pipelines using DBT, Airflow, Snowflake, Databricks and AWS, and develop real-time streaming architectures with Kafka and Flink in an AWS cloud environment.

The role emphasizes modern data modelling, cost-efficient cloud data warehousing, and governance

Design and build reusable, scalable data solutions on a Lakehouse platform. Develop robust data pipelines using DBT, Airflow, Snowflake, Databricks and AWS services. Create real-time data pipelines with Kafka and Flink for low-latency use cases. Integrate data from SaaS, APIs, and streaming sources on cloud architecture. Architect data solutions on AWS, Snowflake and Databricks with cost efficiency. Build and optimise Lakehouse table formats (Iceberg), including partitioning and schema evolution. Model data in alignment with evolving business needs in an agile environment. Write and optimise SQL and Spark workloads for performance and cost efficiency. 5+ years of hands-on commercial experience in software or data engineering. 4+ years of strong development experience in SQL and Python. Proven experience with data integration and orchestration tools, including Apache Airflow, DBT, and AWS Glue. Expert on modern cloud data platforms and architectures, such as Snowflake, Databricks, and Lakehouse architecture Experience designing and building data solutions on AWS cloud infrastructure. Experience working with semi-structured and unstructured data. Strong data modelling skills with the ability to evolve models in an agile environment. Hands‑on experience building streaming and real-time pipelines with Apache Kafka and Apache Flink. Knowledge of infrastructure-as-code tools such as CDK, CloudFormation, or Terraform. Degree in computer science, engineering, mathematics, statistics, or a related technical field Equity / stock options

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →