Senior Embedded AI & Real-Time OS Architect
Summary
Architect at a global technology company's Pisa R&D centre designing OS, middleware and AI-scheduler technology so AI inference runs deterministically and efficiently on resource-constrained embedded devices (CPUs/GPUs/NPUs). Heavy C/C++ work at the Linux kernel/RTOS level (Zephyr, FreeRTOS) with TensorFlow Lite/LiteRT model deployment.
Senior Embedded AI & Real-Time OS Architect
Location: Pisa, Italy (Fully On-site)
Employment: Permanent, Full-Time
Seniority: Senior Expert / Principal Engineer
About the Opportunity
European Tech Recruit is working with a leading global technology company to recruit a Senior Embedded AI & Real-Time OS Architect for its R&D centre in Pisa, Italy.
This is an exciting opportunity to work on next-generation embedded AI technologies across intelligent systems, digital energy and electric vehicles.
The team is looking for an experienced architect who can bridge AI inference, operating systems and real-time scheduling, developing technologies that enable AI workloads to run efficiently and predictably on resource-constrained embedded devices.
A key focus of this position is designing AI schedulers capable of guaranteeing deterministic, real-time inference performance when multiple AI requests or applications run concurrently.
Key Responsibilities
- Design operating system and middleware architectures that integrate AI inference with deterministic, real-time execution.
- Develop and optimise AI scheduling solutions for embedded and edge devices, ensuring predictable inference latency under concurrent workloads.
- Improve the reliability, responsiveness and end-to-end latency of critical computation pipelines involving AI inference.
- Develop OS-level technologies for efficient AI inference and heterogeneous resource scheduling across CPUs, GPUs and NPUs.
- Analyse and optimise resource utilisation, memory management and hardware performance to minimise contention and interference.
- Design distributed, service-oriented architectures for robotics, embodied AI and other intelligent embedded systems.
- Collaborate with international R&D teams on next-generation embedded AI technologies.
Essential Requirements
- Master's degree or PhD in Computer Science, Computer Engineering, Electronic Engineering or a closely related discipline.
- Hands-on experience designing AI schedulers for edge devices, with a focus on deterministic execution and guaranteed real-time inference performance under multiple concurrent requests or applications.
- Strong understanding of Machine Learning and Deep Learning, including CNNs, DNNs, SVMs and LLMs.
- Practical experience deploying and optimising AI models on embedded hardware using frameworks such as TensorFlow Lite, LiteRT or equivalent technologies.
- Strong knowledge of Linux Kernel internals and/or Real-Time Operating Systems such as Zephyr or FreeRTOS, ideally including scheduling, memory management or other kernel subsystems.
- Excellent C and C++ programming skills, with previous experience in Assembly and device driver development.
- Deep understanding of embedded hardware architectures, including SoCs, memory hierarchies, caches, MMUs, interrupt controllers and memory virtualisation.
- Experience managing hardware resource contention and interference in heterogeneous computing environments.
- Knowledge of distributed service-oriented architectures for robotics or embodied AI, including techniques for improving determinism and reducing latency.
- Experience using AI coding assistants or agents as part of daily software design, development and testing workflows.
- Fluent English and willingness to travel internationally for periods of up to two weeks.
Desirable Experience
- Low-level performance analysis and optimisation of embedded systems.
- Optimisation of LLM inference on edge devices.
- Experience with AI workload scheduling across heterogeneous hardware platforms.
- Research or architectural experience in real-time embedded AI, robotics, automotive or intelligent devices.
Why Consider This Opportunity?
You'll join an established R&D environment working on challenging problems at the intersection of operating systems, AI and embedded hardware.
This is a highly technical position offering the opportunity to influence the architecture of future intelligent embedded platforms, collaborate with international experts and contribute to advanced research with real-world applications.
Please note: This role is based fully on-site in Pisa, Italy. Candidates must be willing to work from the R&D centre; remote working is not available.
Interested?
If you have a strong background in embedded AI, real-time scheduling and operating systems, we'd be keen to hear from you.
Apply directly or contact Ethan at European Tech Recruit for a confidential discussion.
Skills
Sign in to read and join the discussion.