Senior Data Engineer

• Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of
• Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering teams
• You will personally design and build the pipelines for massive datasets, taking them all the way from inception to exploration to production and customer use
• We’re on a mission to change how organizations perceive and use people data. And we hold true to our core values of: (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Win When Our Customers Win; and (5) Act with integrity and trust
• Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset
• Work closely with our data science team to run ML models on top of billions of data points
• Build supporting data services and applications to orchestrate and monitor our data systems
• Some technology you will use:
• Cloud platform - GCP
• Programming languages - Java, Python, and Kotlin
• Data warehouse & databases - BigQuery, Postgres, Scylla/Cassandra
• Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
• Orchestration - Airflow

Benefits

• Medical, dental, and vision
• Retirement benefits
• Commuter benefits
• Long-term disability and life
• Paid time off
• Paid sick and volunteer days
• Paid parental leave
• Floating holidays
• Stock options
• Fully-stocked kitchen
• Pet-friendly office
• Remote-enabled

• Experience at a sub-200 person company
• 4-8 years of professional data engineering experience
• Significant experience working with Apache Beam/Spark/Flink or MapReduce
• You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
• You are comfortable making trade-offs between quality, complexity, and speed-of-delivery
• Expert knowledge of distributed data processing
• Familiarity with different datastores, their differences, and appropriate usages
• You can simplify complex problems into simple solutions
• You communicate as well as you code
• Strong Object-oriented programming ability in a JVM language
• Proven experience taking a large project from ideation to production
• Working knowledge of cloud-native data engineering infrastructure
• Experience leading greenfield projects