Software Engineer, AI accelerator Runtime

Responsibilities

• Design and implement the low-level device runtime for OpenAI’s custom silicon.
• Build kernel-launch scheduling, command submission, queueing, dependency tracking, and completion handling.
• Manage device memory spaces, allocation, virtual-to-physical mappings, data movement, and lifetimes across concurrent workloads.
• Implement synchronization primitives, events, barriers, streams, and ordering guarantees.
• Define interfaces between the runtime, drivers, firmware, compiler-generated code, kernels, and higher-level execution systems.
• Use event-based, cycle-accurate simulators to develop, validate, debug, and performance-tune runtime behavior.
• Diagnose concurrency, memory-ordering, deadlock, race, correctness, and performance issues across software and hardware boundaries.
• Build tests, tracing, profiling, observability, and reproducible workloads for runtime correctness and performance.
• Partner with architecture and silicon teams to improve hardware-software interfaces based on workload and simulator insights.

Requirements

• Strong low-level systems programming experience in C, C++, Rust, or comparable environments.
• Experience building runtimes, drivers, firmware, operating-system components, accelerator software, or adjacent systems infrastructure.
• Understanding of concurrency, synchronization, asynchronous execution, queues, events, and memory-ordering semantics.
• Understanding of memory management, address spaces, DMA, caching, coherency, and hardware-software interfaces.
• Hands-on experience with event-based, cycle-accurate simulators or closely related architectural and performance models.
• Ability to reason quantitatively about scheduling, latency, throughput, utilization, contention, and resource tradeoffs.
• Skill debugging failures spanning software abstractions, device interfaces, and hardware behavior.
• Ability to collaborate across compiler, kernel, architecture, verification, firmware, and silicon teams.
• Candidates may need to meet legal-status requirements under U.S. export control laws and regulations.