freehire launches on Product Hunt on 26 August.

Follow →

Principal AI SoC Runtime Software Architect

Own the software architecture for a heterogeneous AI SoC and define the end-to-end runtime across sensor ingest, preprocessing, AI inference, postprocessing, and application delivery. Coordinate workloads and data movement across CPU cores, AI accelerators, vision and multimedia engines, and embedded processors while establishing memory-sharing, synchronization, API, observability, resilience, and recovery architectures.

Responsibilities

  • Define the SoC-wide execution model for coordinating workloads across heterogeneous compute and media engines.
  • Set the architecture and technical direction for the AI inference runtime.
  • Own the end-to-end dataflow architecture for sensor-to-application pipelines.
  • Define the SoC-wide memory and buffer-sharing architecture across user space, the kernel, and hardware engines.
  • Define interface contracts among the runtime, kernel drivers, firmware, and hardware engines.
  • Partner with the compiler team to define the compiler-runtime contract.
  • Establish system-wide observability and performance architecture.
  • Define runtime resilience and validation architecture.

Requirements

  • Extensive experience designing and building production runtime systems, embedded middleware, multimedia frameworks, or performance-critical systems software.
  • Strong C/C++ programming skills and experience architecting production runtime software across APIs, libraries, drivers, firmware, and hardware interfaces.
  • Understanding of heterogeneous and asynchronous execution, synchronization, concurrency, scheduling, and resource management.
  • Understanding of device memory, DMA, IOMMU/SMMU, cache coherency, memory mapping, shared buffers, and kernel/user-space memory interfaces.
  • Experience optimizing data movement and execution across multiple hardware engines.
  • Experience designing stable runtime APIs with compatibility, versioning, error handling, diagnostics, and recovery behavior.
  • Ability to debug cross-layer correctness and performance problems using profiling and tracing.
  • Technical leadership across component and organizational boundaries.
  • Preferred experience includes AI inference runtimes, Linux kernel development, robotics, edge AI, camera pipelines, GStreamer, compiled-model artifacts, and embedded Linux SDKs.

Benefits

  • Medical coverage
  • Dental coverage
  • Vision coverage
  • Paid time off
  • Flexible work arrangements
  • Professional development opportunities
  • Performance-based incentives
  • Equity participation

See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available