Senior Software Engineer (Data Infrastructure)
Posted Updated
- This role will work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval) and work directly with all business units across the company to design and develop both external and internal products
- Handling massive volumes of data for Applied Intuition’s platform needs is a critical area and we are looking for someone who can be hands-on in supporting our data products and verticals across the company
- At Applied Intuition, we encourage all engineers to take ownership over technical and product decisions, closely interact with external and internal users to collect feedback, and contribute to a thoughtful, dynamic team culture
- You’ll scale infrastructure to support all deployment types (cloud, hybrid, on-prem) and across regions
- Be involved in the end to end data lifecycle, from the external-facing product to the underlying platform and infrastructure for it
- Build features to tune processing pipeline for fast data ingestion and indexing depending on customer’s needs and workloads
- Enable product workflows that expose performant query interfaces and offer easy-to-use integration hooks
- Develop and deploy high-quality software using modern tooling and frameworks, especially open-source technologies
- We are looking for infrastructure engineers with expertise in scaling open-source data infrastructure to join the Data & ML infra group
- Knowledge of the open source landscape with judgment on when to choose open source versus build in-house
- A Bachelor’s degree in Computer Science, Software Engineering, or equivalent
- Experience with large-scale open source data technologies (Spark, Kafka, Hudi, Flyte, etc.)
- Experience with containerization and other modern software development workflows
- Experience with enterprise software, including on-prem and/or cloud environments
- Don’t meet every single requirement? If you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles
- Expertise with modern programming languages (Python, C++, GoLang, Scala, etc.)
- Expertise with Kubernetes
- Deep knowledge of data quality, data profiling and cleansing techniques
- Experience with other open-source data technologies not listed above
- 3+ years of professional experience