Staff Software Engineer- AI Platform
Summary
Staff engineer on Aledade's AI Core Platform team, building and operating shared infrastructure that lets internal applications and AI agents securely access foundation models — model gateways, provider integrations, routing/fallback, observability, cost controls, and governance on cloud platforms like AWS, using server-side languages such as Java, Python, or Go.
As a Staff Software Engineer on Aledade's AI Core Platform team, you will help build and operate the shared infrastructure that enables applications and AI agents across Aledade to securely and reliably access foundation models.
You will work on the platform capabilities behind model access, including model gateways, cloud AI services, provider integrations, routing and fallback, usage controls, observability, reliability, and model governance.
We’re looking for engineers who think beyond implementing individual features and consider the full lifecycle of production platform systems: architecture, scalability, failure modes, security, observability, operational readiness, cost, and developer experience. You will help evolve the platform as AI adoption grows across Aledade, building reusable and self-service capabilities rather than one-off solutions.
You will work closely with engineers, product partners, security, infrastructure teams, and teams building AI applications and agents. Successful engineers in this role are comfortable operating in ambiguous problem spaces, making pragmatic technical decisions, and building secure, maintainable, observable, and resilient systems.
Primary Duties:
- Identify and develop scalable and performant solutions.
- Work across discipline to shape product strategy and execution.
- Develop the foundations of code architecture and quality.
- Mentor and coach engineers.
- Set and uphold the standard for engineering processes to support high-quality engineering.
Minimum Qualifications:
- BS/BTech (or higher) in Computer Science, Engineering or a related field required.
- 8+ years of production-level experience as an engineer building highly scalable systems.
- 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
- 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
- Experience architecting, developing, and deploying large-scale distributed systems at scale.
- Experience with cloud technologies, e.g., AWS, Azure, GCP.
- Experience building continuous integration and continuous development (CI/CD) pipelines.
- Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).
Preferred KSAs:
- Experience building or operating production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services.
- Experience with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies.
- Strong experience with cloud infrastructure, preferably AWS, and technologies such as Kubernetes, containers, and infrastructure as a code.
- Experience designing observability and operational practices for production systems, including metrics, distributed tracing, logging, alerting, SLOs, dashboards and failure handling.
- Experience designing APIs and self-service platform capabilities used by other engineering teams.
- Experience with Identity, access control, secrets management, security and governance for shared infrastructure.
- Experience with cost management, usage attribution, quotas, budgets, or capacity management for shared platforms.
- Experience operating systems that handle sensitive or regulated data.
- Ability to evaluate architectural tradeoffs across reliability, performance, security, cost, scalability and developer experience.
Physical Requirements:
Skills
As published by lever · 10 questions · 1 written answer
Basics
Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website
Short answers (1)
- What is your desired salary for this position?
Pick from a list (8)
- Are you legally eligible to work in the United States?
- Do you currently require the company’s sponsorship or need the company’s assistance to obtain or maintain authorization to work legally in the United States? This includes, but is not limited to, H-1B visas (lottery and transfers), TN visas, E-3 visas, or other company-sponsored visas.
- In the future, will you require the company’s sponsorship or need the company’s assistance to obtain or maintain authorization to work legally in the United States? This includes, but is not limited to, H-1B visas (lottery and transfers), TN visas, E-3 visas, or other company-sponsored visas.
- Please list the state that you plan to be physically located in while employed with our company? For employment at Aledade, it is required to be located within the United States; even for remote based roles. optional
- Are you subject to an agreement with a former employer or other party (such as non-competition agreement) that might, in any way, restrict your ability to work for our Company?*
- Would you like to opt-in to receiving text messages for this role regarding the hiring process (e.g., interview requests and reminders)? Note: Selecting “No” will not eliminate you from consideration. Message and data rates may apply. You can opt-out at any time by replying “STOP.”
- By clicking "Submit Application" I agree to the Aledade Applicant Privacy Policy & Terms of Service - https://www.aledade.com/privacy-policy-applicants optional
- By clicking "Submit Application" I certify that all statements made in this application are true and complete. I understand that any falsification, misrepresentation, or omission of fact is sufficient cause for my removal from consideration for employment or my dismissal if hired optional
Written answers (1)
- How did you learn about Aledade?
