Inference Technical Lead, Sora
$380kOpenAI
About the Team
The Sora team is pioneering multimodal capabilities for OpenAI's foundation models. We're a hybrid research and product team focused on integrating multimodal functionalities into our AI products, ensuring they are reliable, user-friendly, and aligned with our mission of broad societal benefit.
About the Role
We're looking for a GPU Inference Engineer to contribute to improvements in model serving efficiency for Sora. This is a high-impact role where you'll drive initiatives to optimize inference performance and scalability. You'll also be engaged in model design, to help assist our researchers in developing inference-friendly models.
This role is critical to scaling the team's broader goals - it will directly enable leadership to focus on higher-leverage initiatives by building a stronger technical foundation.
In this role you will:
Perform engineering efforts focused on improving model serving, inference performance, and system efficiency
Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability
Partner closely with research and product teams to ensure our models perform effectively at scale
Design, build, and improve critical serving infrastructure to support Sora's growth and reliability needs
You might thrive in this role if you:
Have deep expertise in model performance optimization, particularly at the inference layer
Have a strong background in kernel-level systems, data movement, and low-level performance tuning
Are excited about scaling high-performing AI systems that serve real-world, multimodal workloads
Can navigate ambiguity, set technical direction, and drive complex initiatives to completion
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.
Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Compensation Range: $380K
- ...AGI that benefits all of humanity. About the Role As a Technical Lead on the Future of Computing Research team, you will work together... ...team of engineers responsible for implementing the low-level inference stack, including kernel development and runtime systems....SuggestedWork at officeRelocation package
- ...Staff Technical Lead for Inference & ML Performance San Francisco fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at...Suggested
- ...specializing in AI infrastructure is seeking a skilled professional to build scalable infrastructure for AI model training and inference. You will lead architectural decisions and work with core systems that power their GPU optimization platform. Candidates should have...Suggested
- ...Tech Lead, Data & Inference Engineer Georgia, Georgia, United States About the Job Tech Lead, Data & Inference Engineer Our client... ...take pride in facilitating conversations that align with your technical expertise, creative problem-solving mindset, and long-term...SuggestedFull time
$197.3k - $225.1k
...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for... ...cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-...SuggestedFull timePart timeLocal area$142.2k - $204.6k
...P-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that powers Databricks' Foundation Model API. You'll work at the intersection of research and production, ensuring our large language...Local areaWorldwide$187.5k - $395k
...Software Engineer, Inference Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step...- ...About the Job We are seeking a highly technical Inference Engine Engineer to optimize the performance and efficiency of our core inference engine. In this role, you will focus on designing, implementing, and optimizing GPU kernels and supporting infrastructure for...WorldwideFlexible hours
- ...generative and vision models require infrastructure beyond traditional backend engineering - including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing...InternshipImmediate start
$170k - $216k
...Driver's software stack at a massive scale. We solve complex technical challenges to build services and tools for a broad range of customers... ...Engineering Manager. You will: Build and evolve ML inference infrastructure for simulations. Be responsible for the...Full timeRemote work- ...About the Team Our Inference team brings OpenAI's most capable research and technology to the world through our products. We empower consumers, enterprise and developers alike to use and access our start-of-the-art AI models, allowing them to do things that they've...
- About the Team Our team analyzes inference stack performance across the application, model, and fleet layers to identify bottlenecks and drive faster, cheaper inference. We combine systems profiling, benchmarking, and analysis to understand where time and cost are spent...
- ...learn and adapt quickly Prior startup or founding experience is a plus About the Role Specialize in low-latency, high-throughput inference for OCR and multimodal models. Own profiling, batching, and autoscaling across single-tenant and multi-tenant environments. Responsibilities...Work at officeVisa sponsorshipRelocation package
- ...Technical Alliances Lead Operant AI | Full-Time | Hybrid Set-up in the SF Bay Area About Operant AI Operant AI is the industry'... ...in partner conversations - capable of diving deep into AI inference infrastructure, runtime environments, orchestration layers...Full timeDay shift
$175k - $225k
...A* and Atomic with participation from other leading venture capital firms. The Role We're looking for an AI Inference Engineer who lives at the boundary of high-performance... ...Why Sauron You'll be joining a deeply technical team obsessed with building real-world...Local areaRemote work- ...About the Role We're looking for a Tech Lead Manager (TLM) to own and drive the AI... ...approximately 70% of your time on hands-on technical work and 30% on people management and... ...discussions for model training and inference infrastructure, set standards for...Remote workFlexible hours
- ...-on builders-intellectually curious, deeply technical leaders eager to shape the future of AI and ML at Whatnot. You'll lead the development and scaling of the core infrastructure... ...training and high-throughput GPU inference. This is a role that requires strong technical...Work experience placementWork at officeLocal areaRemote workWork from homeHome office
- A leading AI research firm in San Francisco is seeking a Technical Lead to join its Future of Computing Research team. This role involves evaluating silicon platforms and optimizing model architectures while working in a hybrid model. Ideal candidates have expertise in...Relocation package
$425k
...representation architecture aims for efficient training, fast inference, and high spatial resolution. The Position We’re... ...real world with just their imagination. This is a lead-by-doing role at the intersection of ML, technical architecture, and company vision: a chance to shape...$220k
Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience...- ...Montreal Employment Type Full time Location Type Hybrid Department Inference Model Serving Who are we? Our mission is to scale intelligence... ...advanced NLP applications? We are looking for Members of Technical Staff to join the Model Serving team at Cohere. The team is responsible...Full timeWork experience placementWork at officeRemote workFlexible hours
- Fathom is seeking a Model Performance Engineer in San Francisco to optimize the speed, cost, and reliability of its model inference stack while building fine-tuning infrastructure. The ideal candidate will have extensive experience with LLM frameworks, quantization techniques...
$405k
...at the seam between the Safeguards organization and the Cloud Inference team: taking classifiers, detection signals, and enforcement policies... ...Have strong communication skills and can explain complex technical and risk tradeoffs to non-technical stakeholders across Policy...Work at officeVisa sponsorshipFlexible hours$320k
...Staff + Sr. Software Engineer, Cloud Inference San Francisco, CA | Seattle, WA About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our...Work at officeVisa sponsorshipFlexible hours- A leading AI technology company in San Francisco is seeking a Tech Lead Manager focused on machine learning performance. In this role, you will manage and mentor a team while driving optimization projects. Ideal candidates have over 5 years of software engineering experience...
- A cutting-edge AI infrastructure startup is seeking a Kubernetes DevOps Engineer to join their innovative team in San Francisco. The role involves building and maintaining production-grade Kubernetes clusters across various environments, focusing on high-performance GPU...
$167.2k - $209k
A leading cloud service provider is seeking a Senior Engineer 2 for their AI Inference Data Plane team. This remote role focuses on designing and developing high-scale, resilient data plane services that enhance AI-driven applications. The ideal candidate will have strong...Remote work- Qualifications CUDA + GPU inference optimization vLLM, SGLang, or TensorRT-LLM experience KV caching, paged attention, batching, token streaming, etc. Distributed compute (with GPUs is a super plus) No degree required Company Luminal (YC S25) builds an AI compiler and serving...
- ...enable enterprises to implement AI workloads effectively. The role involves designing large-scale deployment architectures, solving AI inference challenges, and collaborating closely with customers' DevOps teams. Ideal candidates will have 3+ years in cloud infrastructure or...Flexible hours
- ABOUT BASETEN Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence,... ...development that also includes aspects of product management, technical customer success, and pre‑sales solution engineering mixed in....Work experience placementFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Technical Lead, Sora. Be the first to apply!

