Cloud Data Engineer II (Databricks)

About AAIS

Since 1936, American Association of Insurance Services (“AAIS”) has served the property and casualty insurance industry as the only national not-for-profit advisory organization governed by its member companies. We are committed to evolving with changes in the insurance industry, adding value to our members, regulators, and the industry with responsive products and insights.

Purpose

The Cloud Data Engineer II independently designs, builds, and supports AAIS's cloud-based data platform. This role owns complete features and work packages within the data engineering environment while contributing across related capabilities. The primary focus is on scaled data ingestion, transformation, processing, and delivery of high-quality data products.

The ideal candidate combines hands-on technical proficiency with dependable delivery. They work effectively across functions, apply engineering standards independently, identify risks early, and help improve how the team builds and operates solutions.

Responsibilities

Solution Delivery

• Independently deliver data features, integrations, pipelines, and automation from design through production support.
• Translate business and technical requirements into practical designs, implementation tasks, test plans, and support documentation.
• Estimate work, manage dependencies, communicate progress, and deliver within sprint and release commitments.

Quality, Security & Operations

• Apply coding, architecture, security, data protection, change management, and operational standards.
• Build automated tests, monitoring, alerting, deployment controls, and support procedures appropriate to the solution.
• Investigate incidents and defects, identify root causes, and implement corrective actions to reduce recurring issues.

Engineering Collaboration & Delivery

• Coordinate with engineers, business partners, vendors, and platform owners to deliver solutions successfully.
• Participate in design reviews and peer code reviews, providing constructive technical feedback.
• Contribute to Agile sprint planning, estimation, and technical documentation, with code maintained in GitHub and work tracked in Azure DevOps.
• Contribute reusable patterns, best practices, and continuous improvements to delivery practices.
• Perform additional duties as assigned or requested.

Knowledge, Skills, and Abilities

• Demonstrated experience delivering data and analytics solutions as a Data Engineer in a cloud-native environment, using Python as a primary development language.
• Recent hands-on experience developing with AWS-native capabilities, MongoDB Atlas, Databricks, and Power BI.
• Experience with API integration, CI/CD pipelines, observability, data pipelines, automation, and cloud security.
• Ability to operate independently while collaborating effectively across technical and business teams.
• Strong written and verbal communication skills, including the ability to explain technical concepts to non-technical audiences.
• Strong critical-thinking and problem-solving skills, with the ability to manage multiple priorities and meet deadlines.
• Must demonstrate a high degree of integrity, ethics, discretion, and dedication to the mission of the organization.
• Ability to work effectively both independently and in a team environment.
• Ability to communicate effectively across multiple channels and asynchronously in a remote-first working environment.