Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI SoC Runtime Software Architect

$200k

Velaura

Role Overview

We are looking for a Principal AI SoC Runtime Software Architect to own the software architecture that turns Velaura’s heterogeneous AI SoC into a coherent, high-performance execution platform.

This role will define and lead development of the end-to-end runtime spanning sensor ingest, preprocessing, AI inference, postprocessing, and delivery of results to robotics and other physical and edge AI applications. The runtime will coordinate execution and data movement across the SoC’s CPU cores, AI accelerator, vision and multimedia engines, and other embedded processors. The complete runtime must coordinate heterogeneous workloads, manage ownership, synchronization, and safe reuse of shared data buffers, minimize data movement, provide predictable low-latency execution, recover from failures, and expose cohesive APIs and observability to applications and SDK components.

The ideal candidate combines deep runtime and systems-software expertise with a strong understanding of heterogeneous compute, Linux kernel and driver interfaces, DMA and shared-memory architectures, and performance-sensitive AI or multimedia pipelines. This will be a hands-on principal architect and technical lead who directs engineers across runtime, kernel, driver, firmware, multimedia, and SDK development.

Responsibilities

  • Define the SoC-wide execution model for coordinating workloads across heterogeneous compute and media engines, including dependency management, resource arbitration, priority and QoS, and concurrent pipeline behavior.
  • Set the architecture and technical direction for the AI inference runtime, including compiled-model execution, integration with industry-standard AI execution frameworks, and interfaces to applications and the broader Velaura SDK.
  • Own the end-to-end dataflow architecture for sensor-to-application pipelines, ensuring that camera, media, preprocessing, inference, and postprocessing components operate as an efficient and coherent system.
  • Define the SoC-wide memory and buffer-sharing architecture across user space, the kernel, and heterogeneous hardware engines, establishing clear ownership, coherency, isolation, synchronization, and lifecycle semantics.
  • Define the division of responsibility and interface contracts among the runtime, kernel drivers, firmware, and hardware engines, including execution, completion, telemetry, fault management, and recovery semantics.
  • Partner with the compiler team to define the compiler–runtime contract, ensuring compiled artifacts contain the metadata and execution information needed for the runtime to load, validate, execute, profile, and maintain compatibility across releases.
  • Establish a system-wide observability and performance architecture that correlates behavior across software and hardware layers and enables optimization against latency, throughput, bandwidth, power, utilization, and predictability goals.
  • Define the runtime resilience and validation architecture, including fault-containment and recovery policies, architecture-level acceptance criteria, and qualification across correctness, concurrency, compatibility, performance, and sustained workloads.

Required Qualifications

  • Extensive experience designing and building production runtime systems, embedded middleware, multimedia frameworks, or other performance-critical systems software.
  • Strong C/C++ programming skills and demonstrated ability to architect and contribute hands‑on to production runtime software spanning application‑facing APIs, user‑space libraries, and low‑level driver, firmware, and hardware interfaces.
  • Strong understanding of heterogeneous and asynchronous execution, including command submission, queues, events, dependencies, synchronization, concurrency, scheduling, and resource management.
  • Strong understanding of device memory, DMA, IOMMU/SMMU, cache coherency, memory mapping, shared buffers, buffer lifetimes, and kernel/user‑space memory interfaces.
  • Experience optimizing end‑to‑end data movement and execution across multiple hardware engines rather than focusing solely on individual kernels or accelerator performance.
  • Experience designing stable runtime APIs with well‑defined compatibility, versioning, error handling, diagnostics, and recovery behavior.
  • Demonstrated ability to debug complex cross‑layer correctness and performance problems using disciplined, data‑driven methods, profiling, and tracing.
  • Demonstrated technical leadership across component and organizational boundaries, including translating system requirements into clear architectures, interfaces, implementation guidance, and validation strategies.

Preferred Qualifications

  • Direct experience developing or extending AI inference runtimes or execution providers, such as ONNX Runtime, TensorRT‑like runtimes, OpenVINO, TensorFlow Lite delegates, Qualcomm QNN/SNPE, TVM runtimes, or comparable systems for NPUs, GPUs, DSPs, or other accelerators.
  • Linux kernel development or upstream contribution experience involving device, accelerator, media, or shared‑memory subsystems.
  • Experience with robotics, autonomous systems, edge AI, ROS 2, camera pipelines, ISP integration, V4L2/media, GStreamer, or other sensor‑driven workloads.
  • Familiarity with compiled‑model artifacts, quantized execution, tensor layouts, graph partitioning, memory planning, and compiler/runtime integration.
  • Experience with embedded Linux SDKs, production deployment, long‑term runtime/API compatibility, or the security and isolation requirements of multi‑process accelerator systems.

$200,000 - $500,000 a year

Compensation & Benefits

At Velaura, we believe exceptional talent deserves exceptional rewards. Compensationfor this role includes a competitive base salary, performance‑based incentives, andequity participation, allowing team members to share in the company’s long‑termsuccess.

Your base pay will depend on your skills, qualifications, experience, and location.

In addition to compensation, Velaura offers a comprehensive benefits package that may include medical, dental, and vision coverage; paid time off; flexible work arrangements; professional development opportunities; and other benefits designed to support the well‑being and growth of our team.

Velaura is committed to pay equity and transparency and regularly benchmarks compensation to ensure we remain competitive in the market.

Why Velaura?

Velaura is building next‑generation compute technology for cloud, edge, and PhysicalAI. Our solutions will enable robots, autonomous systems, drones, and other intelligentmachines to operate efficiently in the physical world.
This is an opportunity to help build foundational technology at a time when the industry is undergoing fundamental change. You will work alongside experienced leaders, architects, engineers, and operators who have delivered industry‑defining products across mobile, cloud, semiconductor, and AI platforms. If you enjoy solving difficult problems, working across disciplines, and helping shape thefuture of Physical AI, we would love to hear from you.

Equal Employment Opportunity and Accommodations

Velaura is an Equal Opportunity Employer that is committed to inclusion and diversity.Qualified applicants will receive consideration for employment without regard to race,color, religion, national origin, gender, sexual orientation, gender identity, disability orprotected veteran status. We also take affirmative action to offer employment
opportunities to minorities, women, individuals with disabilities, and protected veterans.

Velaura is committed to working with qualified individuals with physical or mentaldisabilities. Applicants who would like to contact us regarding the accessibility of ourwebsite or who need special assistance or a reasonable accommodation for any part ofthe application or hiring process may contact us at: View email address on click.appcast.io. This contact
information is for accommodation requests only. Evaluation of requests for reasonableaccommodation will be determined on a case‑by‑case basis.

#J-18808-Ljbffr

Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Principal AI SoC Runtime Software Architect in Santa Clara, CA vacancy
  • $272k - $431.25k

     ...We are now looking for a CPU System Software Architect!Do you want to be a part of the Artificial...  ...at the forefront of accelerating agentic AI, building data centers, and enabling other...  ...architecting the most advanced CPUs and SoC's in the world for these applications... 
    Principal
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $195.2k - $361.2k

     ...explored architectures, algorithms, and software inspired by the brain's...  ...power the coming era of physical AI systems-beyond the reach of GPUs...  ...systems. In this role, you will architect and lead the development of the firmware, runtime, and performance infrastructure,... 
    Suggested
    Full time
    Work at office
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    3 days ago
  • $272k - $431.25k

     ...tapping into the unlimited potential of AI to define the next era of computing. An...  ...legacy of innovation! We are seeking a Principal SW Architect, Networking to build the future of AI...  ...development of AI networks alongside hardware, software, and applicationsGuaranteeing... 
    Principal
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $241.8k - $409.2k

    GPGPU Software Architect/ Principal Engineer XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles,...  ...compatible with CUDA, encompassing Runtime, Driver, Compiler, Profiler,... 
    Principal
    Full time

    XPENG

    Santa Clara, CA
    2 days ago
  • NVIDIA seeks a Principal SoC Architect to lead the next generation of Edge AI, robotics, and autonomous driving platforms. You will own the architectural definition...  ...The role is cross-disciplinary, partnering with software, safety, and hardware teams to deliver low-... 
    Principal

    Nvidia Corporation

    Santa Clara, CA
    1 day ago
  • NVIDIA is seeking a Principal SoC Architect to lead the architectural definition of high‑performance edge AI, robotics, and autonomous driving platforms. You will own end‑to‑end...  ...collaboration across hardware and software teams in Santa Clara. This role demands 15+... 
    Principal

    NVIDIA

    Santa Clara, CA
    1 day ago
  • NVIDIA is seeking a CPU System Software Architect in Santa Clara, California. In this role, you will collaborate with top engineers to define the next generation of CPUs and System on Chips for advanced AI applications. You’ll be responsible for guiding hardware architecture... 

    NVIDIA

    Santa Clara, CA
    12 hours ago
  • $159.05k - $199.3k

     ...powering the future of physical AI. Founded in 2017 and now...  ...the role We are looking for a software engineer with deep experience...  ...on production‑grade embedded runtime environments. You’ll work across...  ...with ML accelerators, GPU, CPU, SoC architecture and micro‑architecture... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    3 days ago
  • $224k - $356.5k

    We are looking for a Senior System Software Architect to help build NVIDIA Halos, our full-stack safety platform for physical AI: autonomous vehicles, humanoids, industrial robots...  ..., and platform software for NVIDIA SoCs and edge AI platforms.Design & develop I/O... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $262k - $364k

     ...architecture and engineering roadmap of common software for Accelerator platforms.Design, develop,...  ...platforms.Facilitate and drive AI transformation across Accelerator software...  ...) or other high-speed IO protocols and ML SOC architecture.Google's software engineers develop... 
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $172.8k - $304.9k

     ...Engineering Group, Engineering Group > ASICS Engineering General Summary Qualcomm is looking for an experienced SoC architect to work on the next generation AI products in the datacenter. We are looking for a data center engineer whose expertise spans security, RAS and/... 
    Principal
    Work experience placement
    Work from home

    Qualcomm

    Santa Clara, CA
    5 days ago
  • Do you want to be part of the AI revolution? Do you want to think out of the box, thriving on challenges in AI industry...  ...DescriptionWe are looking for a world-class Machine Learning System Software Architect to join our SoC team at Baidu’s Sunnyvale office. The successful candidate... 
    Work at office

    Baidu

    Sunnyvale, CA
    12 hours ago
  • $255.85k - $361.2k

     ...about shaping the future of technology and software innovation? As a Software Enabling and...  ...across enterprise, cloud, client,, AI, gaming, graphics and analytics. Your contributions...  ...experts responsible for delivering IP, SOCs, runtimes, and platforms to support the CPU and... 
    Principal
    Full time
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    1 day ago
  •  ...semiconductors, specifically SoCs and chiplets. From...  ...you drive, to the AI in the cloud,...  ...You’ll Do as a Principal Engineer of Security...  ...this technical leader architects and builds...  ...implementation of software products, including correctness, runtime performance, memory... 
    Principal
    Work experience placement
    Remote work
    Night shift

    ARTERIS IP

    Campbell, CA
    2 days ago
  •  ...generation computing experiences—from AI and data centers, to PCs,...  ...position blends system and SoC/computer architecture expertise...  ...heterogeneous hardware and software environments for various market...  ...connect concepts across domains, architect complex features, and guide... 

    AMD

    San Jose, CA
    4 days ago
  • Do you want to be part of the AI revolution? Do you want to think out of the box,...  ...DescriptionWe are looking for a world-class SOC Silicon Architect to join our SoC team at Baidu’s...  ...Work with Baidu’s AI SoC marketing and software architects to define technical Requirements... 
    Work at office
    Night shift

    Baidu

    Sunnyvale, CA
    12 hours ago
  •  ...demand for new data centers and AI compute is rapidly...  ...Overview We are seeking a Principal Network Architect to own the datacenter scale...  ...that both digital design and software teams implement against. This...  ...semantics exposed to the runtime, in partnership with the software... 
    Principal
    Full time

    Socket.dev

    Sunnyvale, CA
    2 days ago
  • $150k - $225k

     ...Clara, CAUS Research and Development - Runtime Platform /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks....  ...and DDSExperience with automotive HPC SoCs (Nvidia preferred)Experience with QNX$... 
    Full time

    Plus.ai

    Santa Clara, CA
    2 days ago
  • $272k - $431.25k

     ...strength is to innovate how we architect and develop our GPU for the changing AI and accelerated...  ...methodology. We are looking for a Principal System Architect with a...  ...-volume System-on-Chip (SoC) platforms. The ideal...  ...design, firmware, and software teams to successfully... 
    Principal
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

    DriveOS is the software platform that powers millions of autonomous vehicles...  ...acceleration libraries for AI, computer vision pipelines,...  ...with software engineers and architects in system software, virtualization...  ...problems and influence NVIDIA SoC and GPU designsWhat we need to... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $231.1k - $358.2k

    DescriptionJob Title: Sr. Principal SoC ArchitectJob Location: San Jose...  ...Description: Company: SiMa.ai is the software-centric, embedded edge...  ...are looking for a Chief SoC Architect to help define next generation...  ...software, compilers, and runtime. Partner deeply with silicon... 
    Principal
    Full time
    Work at office

    SiMa Technologies

    San Jose, CA
    1 day ago
  • $350k

     ...with leveraging hardware and software to create a unique viewing experience...  ...skilled Lead Systems Software Architect who leads complex...  ...design (video/audio pipelines, SoCs, memory, power, thermals). You...  ...the platform hooks needed for AI-assisted troubleshooting. Ensure... 
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    3 days ago
  • $184k - $287.5k

     ...Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center...  ...communication technologies to accelerate AI and HPC workloads.Explore innovative solutions...  ..., SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...performance computing, cloud, and AI. Whether you’re designing next...  ...: AMD is hiring a Sr. Software System Designer to Research, design...  ...GPU platforms, container runtimes, and orchestration frameworks...  ..., C++, or Python;CPU, GPU, or SoC architecture;Code optimization... 
    Internship

    AMD

    Santa Clara, CA
    7 hours ago
  • $184k - $287.5k

     ...for a highly motivated, creative engineer to join the GPU Software team. As a GPU/SOC system software engineer, you will work with a team of very...  ...2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...a computing model focused on visual and AI computing. For two decades, NVIDIA has pioneered...  ...Modeling group is looking for Architects, Software Engineers, and AI application developers...  ...various architecture efforts across GPU's and SOC's. In this position, you will be working... 
    Full time

    Nvidia

    Santa Clara, CA
    12 hours ago
  •  ...the potential of generative AI to power the transformation of...  .... We are at the forefront of software and hardware innovation, pushing...  ...3 days per week.The role: Principal System Software Engineer, AI...  ...Experience with deep learning runtimes (such as ONNX Runtime, TensorRT... 
    Principal
    3 days per week

    d-Matrix

    Santa Clara, CA
    2 days ago
  • $272k - $431.25k

     ...We are now looking for a Principal Software Engineer for LPX System Software! NVIDIA’s LPX System...  ...layers, core system libraries, drivers, and runtime components that workloads enter the...  ...also help define how we engineer. We treat AI coding agents as a primary part of the workflow... 
    Principal
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    12 hours ago
  • $216k - $345k

    We are seeking a Staff/Principal Solutions Architect to define and lead the technical strategy for semiconductor...  ..., and embedded compression.Influence SoC and IP build reviews to ensure...  ...observability, and debug-abilityDrive adoption of AI/ML techniques for yield learning,... 
    Principal
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $157.94k - $209.27k

     ...transforming how enterprise technology, data, automation, and AI work together across the company.Our business...  ..., AI agents, and future digital experiences.The Principal Enterprise Data & AI Information Architect will lead the design of that foundation.This individual... 
    Principal
    Full time
    Work at office
    Work from home
    Flexible hours

    TiVo Corporation

    San Jose, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI SoC Runtime Software Architect. Be the first to apply!