Senior Data Engineer
Responsibilities:
- Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset
- Work closely with our data science team to run ML models on top of billions of data points
- Build supporting data services and applications to orchestrate and monitor our data systems
Some technology you will use:
- Cloud platform - GCP
- Programming languages - Java, Python, and Kotlin
- Data warehouse & databases - BigQuery, Postgres, Scylla/Cassandra
- Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
- Orchestration - Airflow
Requirements:
- 4-8 years of professional data engineering experience
- Significant experience working with Apache Beam/Spark/Flink or MapReduce
- Strong Object-oriented programming ability in a JVM language
- Expert knowledge of distributed data processing
- Familiarity with different datastores, their differences, and appropriate usages
- Experience at a sub-200 person company
- You communicate as well as you code
- You can simplify complex problems into simple solutions
- You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
- You are comfortable making trade-offs between quality, complexity, and speed-of-delivery
Preferred Qualifications:
- Proven experience taking a large project from ideation to production
- Experience leading greenfield projects
- Working knowledge of cloud-native data engineering infrastructure
Additional Information:
The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across California and Colorado. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. We also offer a comprehensive benefits package, which you can explore on our careers site
Compensation range:Skills
As published by lever · 6 questions · 2 written answers
Basics
Resume/CV, Full name, Pronouns, Email, Phone, Current location, Current company, LinkedIn URL, GitHub URL, Portfolio URL, Other website
Short answers (1)
- What is your required base salary per the range listed (and OTE for sales roles)?
Pick from a list (3)
- Are you authorized to work in the United States?
- Will you now or in the future require Windfall to file a petition or application for employment-based visa status on your behalf to begin or continue employment with our company? If you have non-immigrant status, for example F-1 or H-1, your answer to this question should be “yes.”
- This position is a hybrid role in San Francisco or Denver. We will first be prioritizing candidates who are already in either areas. Where do you live currently?
Written answers (2)
- How did you hear about Windfall? (e.g. LinkedIn, social network, referral, etc) If a referral, please state the referral's name.
- This role requires strong experience in data engineering and OOP experience in a JVM language. Please tell us about your tech stack.