Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Inference Technical Lead, Sora

$380k

OpenAI

About the Team

The Sora team is pioneering multimodal capabilities for OpenAI's foundation models. We're a hybrid research and product team focused on integrating multimodal functionalities into our AI products, ensuring they are reliable, user-friendly, and aligned with our mission of broad societal benefit.

About the Role

We're looking for a GPU Inference Engineer to contribute to improvements in model serving efficiency for Sora. This is a high-impact role where you'll drive initiatives to optimize inference performance and scalability. You'll also be engaged in model design, to help assist our researchers in developing inference-friendly models.

This role is critical to scaling the team's broader goals - it will directly enable leadership to focus on higher-leverage initiatives by building a stronger technical foundation.

In this role you will:

  • Perform engineering efforts focused on improving model serving, inference performance, and system efficiency

  • Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability

  • Partner closely with research and product teams to ensure our models perform effectively at scale

  • Design, build, and improve critical serving infrastructure to support Sora's growth and reliability needs

You might thrive in this role if you:

  • Have deep expertise in model performance optimization, particularly at the inference layer

  • Have a strong background in kernel-level systems, data movement, and low-level performance tuning

  • Are excited about scaling high-performing AI systems that serve real-world, multimodal workloads

  • Can navigate ambiguity, set technical direction, and drive complex initiatives to completion

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Compensation Range: $380K

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Inference Technical Lead, Sora in San Francisco, CA vacancy
  •  ...AGI that benefits all of humanity. About the Role As a Technical Lead on the Future of Computing Research team, you will work together...  ...team of engineers responsible for implementing the low-level inference stack, including kernel development and runtime systems.... 
    Suggested
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    4 days ago
  •  ...Staff Technical Lead for Inference & ML Performance San Francisco fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at... 
    Suggested

    Fal

    San Francisco, CA
    9 hours ago
  •  ...specializing in AI infrastructure is seeking a skilled professional to build scalable infrastructure for AI model training and inference. You will lead architectural decisions and work with core systems that power their GPU optimization platform. Candidates should have... 
    Suggested

    Wafer

    San Francisco, CA
    2 days ago
  •  ...Tech Lead, Data & Inference Engineer Georgia, Georgia, United States About the Job Tech Lead, Data & Inference Engineer Our client...  ...take pride in facilitating conversations that align with your technical expertise, creative problem-solving mindset, and long-term... 
    Suggested
    Full time

    Catalyst Labs, LLC

    San Francisco, CA
    9 hours ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for...  ...cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Financial Corp

    San Francisco, CA
    5 days ago
  • $142.2k - $204.6k

     ...P-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that powers Databricks' Foundation Model API. You'll work at the intersection of research and production, ensuring our large language... 
    Local area
    Worldwide

    Databricks

    San Francisco, CA
    3 days ago
  • $187.5k - $395k

     ...Software Engineer, Inference Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step... 

    Luma AI

    San Francisco, CA
    1 day ago
  •  ...About the Job We are seeking a highly technical Inference Engine Engineer to optimize the performance and efficiency of our core inference engine. In this role, you will focus on designing, implementing, and optimizing GPU kernels and supporting infrastructure for... 
    Worldwide
    Flexible hours

    FriendliAI Corp

    San Francisco, CA
    1 day ago
  •  ...generative and vision models require infrastructure beyond traditional backend engineering - including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing... 
    Internship
    Immediate start

    SpreeAI

    San Francisco, CA
    4 days ago
  • $170k - $216k

     ...Driver's software stack at a massive scale. We solve complex technical challenges to build services and tools for a broad range of customers...  ...Engineering Manager. You will: Build and evolve ML inference infrastructure for simulations. Be responsible for the... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    4 days ago
  •  ...About the Team Our Inference team brings OpenAI's most capable research and technology to the world through our products. We empower consumers, enterprise and developers alike to use and access our start-of-the-art AI models, allowing them to do things that they've... 

    OpenAI

    San Francisco, CA
    3 days ago
  • About the Team Our team analyzes inference stack performance across the application, model, and fleet layers to identify bottlenecks and drive faster, cheaper inference. We combine systems profiling, benchmarking, and analysis to understand where time and cost are spent... 

    AI Chopping Block, Inc.

    San Francisco, CA
    4 days ago
  •  ...learn and adapt quickly Prior startup or founding experience is a plus About the Role Specialize in low-latency, high-throughput inference for OCR and multimodal models. Own profiling, batching, and autoscaling across single-tenant and multi-tenant environments. Responsibilities... 
    Work at office
    Visa sponsorship
    Relocation package

    Pulse

    San Francisco, CA
    2 days ago
  •  ...Technical Alliances Lead Operant AI | Full-Time | Hybrid Set-up in the SF Bay Area About Operant AI Operant AI is the industry'...  ...in partner conversations - capable of diving deep into AI inference infrastructure, runtime environments, orchestration layers... 
    Full time
    Day shift

    Webflow

    San Francisco, CA
    3 days ago
  • $175k - $225k

     ...A* and Atomic with participation from other leading venture capital firms. The Role We're looking for an AI Inference Engineer who lives at the boundary of high-performance...  ...Why Sauron You'll be joining a deeply technical team obsessed with building real-world... 
    Local area
    Remote work

    Sauron

    San Francisco, CA
    9 hours ago
  •  ...About the Role We're looking for a Tech Lead Manager (TLM) to own and drive the AI...  ...approximately 70% of your time on hands-on technical work and 30% on people management and...  ...discussions for model training and inference infrastructure, set standards for... 
    Remote work
    Flexible hours

    TEEMA

    San Francisco, CA
    1 day ago
  •  ...-on builders-intellectually curious, deeply technical leaders eager to shape the future of AI and ML at Whatnot. You'll lead the development and scaling of the core infrastructure...  ...training and high-throughput GPU inference. This is a role that requires strong technical... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Work from home
    Home office

    Whatnot

    San Francisco, CA
    3 days ago
  • A leading AI research firm in San Francisco is seeking a Technical Lead to join its Future of Computing Research team. This role involves evaluating silicon platforms and optimizing model architectures while working in a hybrid model. Ideal candidates have expertise in... 
    Relocation package

    OpenAI

    San Francisco, CA
    3 days ago
  • $425k

     ...representation architecture aims for efficient training, fast inference, and high spatial resolution. The Position We’re...  ...real world with just their imagination. This is a lead-by-doing role at the intersection of ML, technical architecture, and company vision: a chance to shape... 

    Strativ Group

    San Francisco, CA
    4 days ago
  • $220k

    Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience... 

    Perplexity

    San Francisco, CA
    3 days ago
  •  ...Montreal Employment Type Full time Location Type Hybrid Department Inference Model Serving Who are we? Our mission is to scale intelligence...  ...advanced NLP applications? We are looking for Members of Technical Staff to join the Model Serving team at Cohere. The team is responsible... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Jaide Health

    San Francisco, CA
    2 days ago
  • Fathom is seeking a Model Performance Engineer in San Francisco to optimize the speed, cost, and reliability of its model inference stack while building fine-tuning infrastructure. The ideal candidate will have extensive experience with LLM frameworks, quantization techniques... 

    Fathom

    San Francisco, CA
    1 day ago
  • $405k

     ...at the seam between the Safeguards organization and the Cloud Inference team: taking classifiers, detection signals, and enforcement policies...  ...Have strong communication skills and can explain complex technical and risk tradeoffs to non-technical stakeholders across Policy... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    9 hours ago
  • $320k

     ...Staff + Sr. Software Engineer, Cloud Inference San Francisco, CA | Seattle, WA About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • A leading AI technology company in San Francisco is seeking a Tech Lead Manager focused on machine learning performance. In this role, you will manage and mentor a team while driving optimization projects. Ideal candidates have over 5 years of software engineering experience... 

    Baseten

    San Francisco, CA
    3 days ago
  • A cutting-edge AI infrastructure startup is seeking a Kubernetes DevOps Engineer to join their innovative team in San Francisco. The role involves building and maintaining production-grade Kubernetes clusters across various environments, focusing on high-performance GPU...

    Jack & Jill/External ATS

    San Francisco, CA
    2 days ago
  • $167.2k - $209k

    A leading cloud service provider is seeking a Senior Engineer 2 for their AI Inference Data Plane team. This remote role focuses on designing and developing high-scale, resilient data plane services that enhance AI-driven applications. The ideal candidate will have strong... 
    Remote work

    DigitalOcean

    San Francisco, CA
    4 days ago
  • Qualifications CUDA + GPU inference optimization vLLM, SGLang, or TensorRT-LLM experience KV caching, paged attention, batching, token streaming, etc. Distributed compute (with GPUs is a super plus) No degree required Company Luminal (YC S25) builds an AI compiler and serving... 

    SupportFinity™

    San Francisco, CA
    4 days ago
  •  ...enable enterprises to implement AI workloads effectively. The role involves designing large-scale deployment architectures, solving AI inference challenges, and collaborating closely with customers' DevOps teams. Ideal candidates will have 3+ years in cloud infrastructure or... 
    Flexible hours

    FriendliAI

    San Francisco, CA
    4 days ago
  • ABOUT BASETEN Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence,...  ...development that also includes aspects of product management, technical customer success, and pre‑sales solution engineering mixed in.... 
    Work experience placement
    Flexible hours

    Baseten

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Inference Technical Lead, Sora. Be the first to apply!