Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI SoC Runtime Software Architect

$200k

Velaura AI, Inc.

Role Overview We are looking for a Principal AI SoC Runtime Software Architect to own the software architecture that turns Velaura’s heterogeneous AI SoC into a coherent, high-performance execution platform. This role will define and lead development of the end-to-end runtime spanning sensor ingest, preprocessing, AI inference, postprocessing, and delivery of results to robotics and other physical and edge AI applications. The runtime will coordinate execution and data movement across the SoC’s CPU cores, AI accelerator, vision and multimedia engines, and other embedded processors. The complete runtime must coordinate heterogeneous workloads, manage ownership, synchronization, and safe reuse of shared data buffers, minimize data movement, provide predictable low-latency execution, recover from failures, and expose cohesive APIs and observability to applications and SDK components. The ideal candidate combines deep runtime and systems-software expertise with a strong understanding of heterogeneous compute, Linux kernel and driver interfaces, DMA and shared-memory architectures, and performance-sensitive AI or multimedia pipelines. This will be a hands‑on principal architect and technical lead who directs engineers across runtime, kernel, driver, firmware, multimedia, and SDK development. Responsibilities Define the SoC-wide execution model for coordinating workloads across heterogeneous compute and media engines, including dependency management, resource arbitration, priority and QoS, and concurrent pipeline behavior. Set the architecture and technical direction for the AI inference runtime, including compiled-model execution, integration with industry-standard AI execution frameworks, and interfaces to applications and the broader Velaura SDK. Own the end-to-end dataflow architecture for sensor-to-application pipelines, ensuring that camera, media, preprocessing, inference, and postprocessing components operate as an efficient and coherent system. Define the SoC-wide memory and buffer-sharing architecture across user space, the kernel, and heterogeneous hardware engines, establishing clear ownership, coherency, isolation, synchronization, and lifecycle semantics. Define the division of responsibility and interface contracts among the runtime, kernel drivers, firmware, and hardware engines, including execution, completion, telemetry, fault management, and recovery semantics. Partner with the compiler team to define the compiler–runtime contract, ensuring compiled artifacts contain the metadata and execution information needed for the runtime to load, validate, execute, profile, and maintain compatibility across releases. Establish a system-wide observability and performance architecture that correlates behavior across software and hardware layers and enables optimization against latency, throughput, bandwidth, power, utilization, and predictability goals. Define the runtime resilience and validation architecture, including fault‑containment and recovery policies, architecture-level acceptance criteria, and qualification across correctness, concurrency, compatibility, performance, and sustained workloads. Required Qualifications Extensive experience designing and building production runtime systems, embedded middleware, multimedia frameworks, or other performance‑critical systems software. Strong C/C++ programming skills and demonstrated ability to architect and contribute hands‑on to production runtime software spanning application-facing APIs, user-space libraries, and low‑level driver, firmware, and hardware interfaces. Strong understanding of heterogeneous and asynchronous execution, including command submission, queues, events, dependencies, synchronization, concurrency, scheduling, and resource management. Strong understanding of device memory, DMA, IOMMU/SMMU, cache coherency, memory mapping, shared buffers, buffer lifetimes, and kernel/user-space memory interfaces. Experience optimizing end-to-end data movement and execution across multiple hardware engines rather than focusing solely on individual kernels or accelerator performance. Experience designing stable runtime APIs with well‑defined compatibility, versioning, error handling, diagnostics, and recovery behavior. Demonstrated ability to debug complex cross‑layer correctness and performance problems using disciplined, data‑driven methods, profiling, and tracing. Demonstrated technical leadership across component and organizational boundaries, including translating system requirements into clear architectures, interfaces, implementation guidance, and validation strategies. Preferred Qualifications Direct experience developing or extending AI inference runtimes or execution providers, such as ONNX Runtime, TensorRT‑like runtimes, OpenVINO, TensorFlow Lite delegates, Qualcomm QNN/SNPE, TVM runtimes, or comparable systems for NPUs, GPUs, DSPs, or other accelerators. Linux kernel development or upstream contribution experience involving device, accelerator, media, or shared‑memory subsystems. Experience with robotics, autonomous systems, edge AI, ROS 2, camera pipelines, ISP integration, V4L2/media, GStreamer, or other sensor‑driven workloads. Familiarity with compiled‑model artifacts, quantized execution, tensor layouts, graph partitioning, memory planning, and compiler/runtime integration. Experience with embedded Linux SDKs, production deployment, long‑term runtime/API compatibility, or the security and isolation requirements of multi‑process accelerator systems. $200,000 - $500,000 a year Compensation & Benefits At Velaura, we believe exceptional talent deserves exceptional rewards. Compensationfor this role includes a competitive base salary, performance‑based incentives, andequity participation, allowing team members to share in the company’s long‑termsuccess. Your base pay will depend on your skills, qualifications, experience, and location. In addition to compensation, Velaura offers a comprehensive benefits package that may include medical, dental, and vision coverage; paid time off; flexible work arrangements; professional development opportunities; and other benefits designed to support the well‑being and growth of our team. Velaura is committed to pay equity and transparency and regularly benchmarks compensation to ensure we remain competitive in the market. Why Velaura? Velaura is building next‑generation compute technology for cloud, edge, and PhysicalAI. Our solutions will enable robots, autonomous systems, drones, and other intelligentmachines to operate efficiently in the physical world. This is an opportunity to help build foundational technology at a time when the industry is undergoing fundamental change. You will work alongside experienced leaders, architects, engineers, and operators who have delivered industry‑defining products across mobile, cloud, semiconductor, and AI platforms. If you enjoy solving difficult problems, working across disciplines, and helping shape thefuture of Physical AI, we would love to hear from you. Equal Employment Opportunity and Accommodations Velaura is an Equal Opportunity Employer that is committed to inclusion and diversity.Qualified applicants will receive consideration for employment without regard to race,color, religion, national origin, gender, sexual orientation, gender identity, disability orprotected veteran status. We also take affirmative action to offer employment opportunities to minorities, women, individuals with disabilities, and protected veterans. Velaura is committed to working with qualified individuals with physical or mentaldisabilities. Applicants who would like to contact us regarding the accessibility of ourwebsite or who need special assistance or a reasonable accommodation for any part ofthe application or hiring process may contact us at: View email address on click.appcast.io. This contact information is for accommodation requests only. Evaluation of requests for reasonableaccommodation will be determined on a case‑by‑case basis. #J-18808-Ljbffr Velaura AI, Inc.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal AI SoC Runtime Software Architect in Santa Clara, CA vacancy
  • $200k - $300k

     ...an early engineering team at an AI semiconductor startup focused on...  ...and on-device computing. As the principal runtime architect, you will define and build the software layer that coordinates sensor processing...  ...a runtime on an embedded SoC, with hands-on knowledge of... 
    Principal

    Wintermeyer Ventures

    Santa Clara, CA
    1 day ago
  • $262.5k - $394k

    Principal Software Architect, Finance Technology Platform Sunnyvale, California, United States Corporate...  ...designing and building a multi-tenant, AI-native platform that powers financial...  ...including harness engineering: agent runtimes, tool/function calling, structured output... 
    Principal
    Contract work
    Temporary work
    Local area
    Relocation

    Apple

    Sunnyvale, CA
    6 hours ago
  • Ampere Computing LLC is seeking an AI Accelerator Principal Software Engineer - Runtime Library to lead design, development, and optimization of AI runtime software for Ampere accelerators, enabling efficient inference across models and frameworks. You will own end-to-... 
    Principal

    Ampere Computing LLC

    Santa Clara, CA
    16 hours ago
  • $174k - $252k

    Senior Software Engineer, Performance, SOC Architect Share Senior Software Engineer, Performance, SOC Architect corporate_fare Google place Sunnyvale, CA...  ...hardware features. Collaborate across Hardware, Driver, Runtime, and Performance Analysis teams and many other... 
    Suggested

    Google LLC

    Sunnyvale, CA
    16 hours ago
  • $220k - $275k

     ...Job Description Job Description Principal System Architect - AI, SOCs At the forefront of the latest semiconductor technology & security we're...  ...how AI-powered infrastructure is secured from silicon to software. Backed by Tier-1 VC's & commercial partnerships - yes,... 
    Principal
    Ongoing contract
    Local area
    Work visa

    CyberCoders

    San Jose, CA
    23 days ago
  • $272k - $431.25k

     ...tapping into the unlimited potential of AI to define the next era of computing. An...  ...legacy of innovation! We are seeking a Principal SW Architect, Networking to build the future of AI...  ...development of AI networks alongside hardware, software, and applicationsGuaranteeing... 
    Principal
    Full time

    Nvidia

    Santa Clara, CA
    16 hours ago
  • You Are: You are an experienced SoC design, verification, or implementation engineer with...  ...to enable next-generation computing, AI, networking, automotive, and mobile platforms...  ...on technical leader who can independently architect, integrate, verify, and troubleshoot complex... 
    Principal

    Synopsys, Inc.

    Sunnyvale, CA
    1 day ago
  • $165.45k - $259.75k

     ...Principal Software ArchitectHP is seeking a Principal Software Architect to define and guide the architecture of modern software platforms...  ..., enterprise workflows, AI-enabled capabilities, and production...  ...with AI/ML frameworks and runtimes such as PyTorch, TensorFlow,... 
    Principal
    Temporary work
    Local area
    Flexible hours
    Shift work

    HP Development Company, L.P.

    Palo Alto, CA
    1 day ago
  • $120.8k - $193.3k

    DescriptionJob Title: Principal Engineer, Apps...  ...Description: SiMa.ai is seeking a Principal...  ...execution.Architect and develop AI and...  ...complex hardware/software integration issues...  ...TensorFlow, ONNX, ONNX Runtime, and OpenCV.Experience...  ...platforms, SoCs, or AI accelerators... 
    Principal
    Full time
    Work at office

    SiMa Technologies

    San Jose, CA
    2 days ago
  • $182k - $273k

    AI Accelerator Software Principal Engineer - Runtime Library Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient AI compute. As a pioneer in the... 
    Principal
    Local area

    Ampere Computing LLC

    Santa Clara, CA
    16 hours ago
  • $224k - $356.5k

    We are looking for a Senior System Software Architect to help build NVIDIA Halos, our full-stack safety platform for physical AI: autonomous vehicles, humanoids, industrial robots...  ..., and platform software for NVIDIA SoCs and edge AI platforms.Design & develop I/O... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • Do you want to be part of the AI revolution? Do you want to think out of the box, thriving on challenges in AI industry...  ...DescriptionWe are looking for a world-class Machine Learning System Software Architect to join our SoC team at Baidu’s Sunnyvale office. The successful candidate... 
    Work at office

    Baidu

    Sunnyvale, CA
    3 days ago
  • $138.84k - $208k

     ...infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is...  ...hiring process.This position may require access to technology and/or software subject to U.S. export control laws and regulations, including... 
    Principal
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    16 hours ago
  • $190k - $240k

     ...Job Description Job Description Principal Hardware Engineer - AI, SOCs At the forefront of the latest semiconductor technology & security we're...  ...how AI-powered infrastructure is secured from silicon to software. Backed by Tier-1 VC's & commercial partnerships - yes,... 
    Principal
    Ongoing contract
    Local area

    CyberCoders

    San Jose, CA
    23 days ago
  • $164.47k - $269.1k

     ...data center innovation. As a Data Center SoC Power Architect, you will play a critical role in...  ...leading compute platforms that power cloud, AI, and high-performance computing...  ...across silicon, system, firmware, and software domains, you will drive architectural innovations... 
    Full time
    Internship
    Local area
    Immediate start
    Worldwide
    Shift work

    Intel

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center...  ...communication technologies to accelerate AI and HPC workloads.Explore innovative solutions...  ..., SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    16 hours ago
  • $150k - $180k

    Santa Clara, CASoftware Engineering - Runtime Platform /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered...  ...and DDSExperience with automotive HPC SoCs (Nvidia preferred)Experience with QNX$... 
    Full time

    Plus.ai

    Santa Clara, CA
    16 hours ago
  • Do you want to be part of the AI revolution? Do you want to think out of the box,...  ...DescriptionWe are looking for a world-class SOC Silicon Architect to join our SoC team at Baidu’s...  ...Work with Baidu’s AI SoC marketing and software architects to define technical Requirements... 
    Work at office
    Night shift

    Baidu

    Sunnyvale, CA
    3 days ago
  • $152k - $241.5k

     ...a computing model focused on visual and AI computing. For two decades, NVIDIA has pioneered...  ...Modeling group is looking for Architects, Software Engineers, and AI application developers...  ...various architecture efforts across GPU's and SOC's. In this position, you will be working... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...will work across ML frameworks, compilers, runtimes, and low-level kernels to implement new...  ...deliver end-to-end capabilities.Contribute to software architecture and roadmap decisions by... 

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $231.1k - $358.2k

    DescriptionJob Title: Sr. Principal SoC ArchitectJob Location: San Jose...  ...Description: Company: SiMa.ai is the software-centric, embedded edge...  ...are looking for a Chief SoC Architect to help define next generation...  ...software, compilers, and runtime. Partner deeply with silicon... 
    Principal
    Full time
    Work at office

    SiMa Technologies

    San Jose, CA
    4 days ago
  • $184k - $287.5k

     ...for a highly motivated, creative engineer to join the GPU Software team. As a GPU/SOC system software engineer, you will work with a team of very...  ...2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...the potential of generative AI to power the transformation of...  .... We are at the forefront of software and hardware innovation, pushing...  ...3 days per week.The role: Principal System Software Engineer, AI...  ...Experience with deep learning runtimes (such as ONNX Runtime, TensorRT... 
    Principal
    3 days per week

    d-Matrix

    Santa Clara, CA
    16 hours ago
  • $272k - $431.25k

    We are now looking for a Principal Software Engineer for LPX System Software! NVIDIA’s LPX System Software...  ..., core system libraries, drivers, and runtime components that workloads enter the...  ...also help define how we engineer. We treat AI coding agents as a primary part of the... 
    Principal
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago
  • Salesforce is seeking a Principal Engineer focused on architecture for the Event Technology...  ...vision, oversee platform integrity, and drive AI integrations that improve developer...  ...product, and UX to deliver scalable, secure software and high-performance user experiences for... 
    Principal

    Salesforce

    Palo Alto, CA
    6 hours ago
  • Company DescriptionAxiado is an AI-enhanced security processor...  ...DescriptionRole Summary As a Lead System Architect at Axiado, you will define the...  ...bridging silicon (ASIC/SoC), board-level hardware platforms, and low-level system software/firmware. Leveraging your deep... 
    Principal

    Axiado Corporation

    San Jose, CA
    2 days ago
  • $214.1k - $309.8k

     ...next generation Agentic SOC for a world where...  ...adversaries increasingly use AI to accelerate attacks,...  ...TeamAs a Senior Staff Software Engineer on Cisco’s Security...  ...spanning agent runtime, orchestration, governed...  ...meaningful improvement.• Architect for public cloud, on-premises... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    4 days ago
  •  ...With a proven track record in architecting and delivering cutting-edge solutions...  ...in system architecture, SoC design, verification...  ....Strong knowledge of hardware/software co-design, cloud-enabled workflows...  ...orchestration).Familiarity with AI/ML, security, and data analytics... 
    Full time
    Work at office
    Local area

    NXP Semiconductors

    San Jose, CA
    3 days ago
  • $240k - $320k

     ...DescriptionAs the Senior Principal Engineer - ADAS & AV Data Loop & AI Flywheel, you will...  ...authority driving the software, data loop, and MLOps machinery...  ..., embedded runtime SOC teams) to define, drive...  ...SOCs).Hands-on experience architecting cloud-native distributed... 
    Principal
    Full time
    Work experience placement
    Local area
    Flexible hours

    Robert Bosch

    Sunnyvale, CA
    3 days ago
  • $157.94k - $209.27k

     ...transforming how enterprise technology, data, automation, and AI work together across the company.Our business...  ..., AI agents, and future digital experiences.The Principal Enterprise Data & AI Information Architect will lead the design of that foundation.This individual... 
    Principal
    Full time
    Work at office
    Work from home
    Flexible hours

    TiVo Corporation

    San Jose, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI SoC Runtime Software Architect. Be the first to apply!