Principal Software Engineer
Responsibilities
- Define the technical vision and reference architecture for AI platforms supporting chatbots, agents, orchestration, and related enterprise services.
- Translate product and business requirements into scalable platform capabilities, including agent hosting, model access, AI gateways, observability, and operational tooling.
- Drive platform decisions around LLM serving, model endpoints, caching, batching, latency-versus-cost tradeoffs, and multi-model support.
- Lead architecture for manufacturing integrations and industrial data connectivity, including patterns for SCADA, Data Historian, MES, ERP, LIMS, APIs, event streams, and document-based knowledge sources.
- Own platform reliability, scalability, and cost by defining SLIs/SLOs, capacity planning, cost attribution, and FinOps practices.
- Collaborate with Product Owners, Principal Engineers, and stakeholders to define roadmap, acceptance criteria, and delivery milestones.
- Lead and mentor engineers delivering platform services, integrations, CI/CD for agents and models, and marketplace/catalog capabilities.
- Establish standards for security, compliance, and model governance, including data handling, access controls, logging, auditability, and traceability.
- Be hands-on when needed to prototype architectures, review designs, troubleshoot production incidents, and participate in code and design reviews.
Technology and domain experience
- Manufacturing systems and industrial data sources such as SCADA, Data Historian, MES, ERP, and LIMS.
- Cloud and data platforms including AWS, Databricks, Apache Spark, PySpark, Scala, Python, and SQL.
- Real-time and event-driven integration using Apache Kafka, Debezium, or similar streaming technologies.
- GenAI and MLOps capabilities such as MLflow, model serving, experiment tracking, prompt management, deployment automation, and governance.
- AI application frameworks and orchestration tools such as LangChain, LangGraph, LlamaIndex, DSPy, Amazon Bedrock, and OpenAI APIs.
- Knowledge retrieval patterns including RAG, embeddings, vector databases, knowledge graphs, and metadata-driven search.
- Production engineering practices including Kubernetes, containers, microservices, API gateway patterns, CI/CD, automated testing, and observability.
- Agile/SAFe delivery using JIRA, Confluence, and DevOps tooling.
Basic Qualifications
- Master's / Bachelors degree in Computer Science, Engineering, or equivalent practical experience.
- 13-17 years of engineering experience building or platforming cloud services or developer platforms, with 3+ years leading engineering teams or technical programs.
- Proven experience designing and operating cloud-native platforms using Kubernetes, containers, microservices, and related distributed system patterns.
- Hands-on experience with LLM serving or adjacent model-serving patterns, including inference endpoints, routing, scaling, batching, and latency/cost optimization.
- Practical knowledge of API gateway patterns, authentication and authorization, and secure integrations.
- Familiarity with cost attribution and FinOps concepts for cloud and AI workloads.
- Strong track record partnering with product managers and senior technical stakeholders to deliver platform capabilities and roadmaps.
- Excellent communication skills with the ability to explain technical tradeoffs clearly to both technical and non-technical audiences.
- Experience with observability and SRE practices, including metrics, tracing, logging, incident management, and production support.
Preferred Qualifications
- Direct experience with manufacturing applications, industrial data platforms, or regulated manufacturing environments.
- Experience with agentic AI platforms, agent hosting frameworks, and workflow orchestration tools.
- Familiarity with the broader LLM ecosystem, including model providers, orchestration libraries, and governance frameworks.
- Experience implementing AI gateways, centralized model access controls, policy layers, or audit systems.
- Experience with FinOps tooling and cost-allocation models for platform services.
- Experience shipping developer experience capabilities such as SDKs, CLIs, templates, and documentation.
Soft Skills
- Excellent analytical and troubleshooting skills.
- Strong verbal and written communication skills.
Skills
- Acceptance Criteria
- Agentic AI
- Agile
- AI
- API
- API Gateway
- Authentication
- Automation
- AWS
- AWS Bedrock
- CI/CD
- Cloud
- Cloud Native
- Confluence
- Databricks
- Debezium
- Developer Experience
- DevOps
- Embeddings
- ERP
- Event Driven Architecture
- FinOps
- Generative AI
- Jira
- Kafka
- Kubernetes
- LangChain
- LangGraph
- LIMS
- LlamaIndex
- LLM
- Microservices
- MLflow
- MLOps
- Observability
- OpenAI
- PySpark
- Python
- SCADA
- Scala
- Spark
- SQL
- SRE
- Test Automation
- Vector Databases
- Workflow Orchestration
