Lead Data Engineer (Hybrid, office is based in Austin, Texas)
Summary
Lead the build-out of a unified data platform for a cyber-insurance company, designing pipelines, standards, and governance to turn raw data into business insights across the insurance value chain.
- Working with multiple stakeholder communities to understand our data needs and create pipelines to take data between different layers in the platform
- Ensuring the technical infrastructure is in place and appropriate to support managing the data platform and associated activities such as pipelines
- Creating standards and patterns to ensure that future development adhere to a high-quality fit for purpose framework
- Defining features and capabilities to move the dial on data usage within the insurance industry
- Providing governance and consultancy to users of the data platform and data related questions
- 5+ years working in a Data Engineering role
- Knowledge of Python and Spark
- Strong SQL knowledge
- Experience analyzing, cleaning, migrating and modeling data
- Experience using Azure or another cloud provider (AWS, GCP)