Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Tokens-as-a-Service (Taas) Software Engineer

$293k

OpenAI

About the Role

We are seeking a Tokens-as-a-Service (TaaS) Engineer to help build the systems that convert large-scale infrastructure capacity into measurable, reliable token throughput for OpenAI workloads.

In this role, you will work across performance benchmarking, tokenomics, model porting, infrastructure integration, systems tooling, and operational monitoring. You will help connect partner and first-party compute environments into OpenAI's infrastructure stack, ensuring GPU capacity can be onboarded, measured, monitored, and optimized against real workload outcomes.

Key Responsibilities

  • Develop systems and tooling to measure, monitor, and improve token throughput across first-party and partner-owned compute environments.

  • Support performance benchmarking, tokenomics analysis, and model porting across heterogeneous infrastructure environments.

  • Build tooling to integrate external or partner infrastructure into OpenAI's internal compute, observability, and workload management systems.

  • Develop and monitor operational metrics including billing, usage, SLAs, utilization, reliability, and throughput.

  • Identify bottlenecks across hardware, networking, software, and workload enablement that prevent capacity from becoming productive tokens.

  • Partner with compute, infrastructure, networking, finance, and operations teams to translate raw capacity into usable workload-serving capacity.

  • Build dashboards, automation, and reporting systems that provide clear visibility into TaaS capacity, performance, and business outcomes.

Qualifications

  • Strong software engineering background with experience building systems, tooling, automation, or infrastructure platforms.

  • Experience working across compute infrastructure, distributed systems, performance engineering, or production operations.

  • Ability to reason about token throughput, utilization, benchmarking, infrastructure efficiency, and workload performance.

  • Comfortable integrating external systems or partner environments into internal infrastructure stacks.

  • Strong analytical and debugging skills across hardware, networking, software, and operational domains.

Preferred Skills

  • Experience with GPU clusters, AI infrastructure, performance benchmarking, or workload optimization.

  • Familiarity with model porting, inference/training workloads, token economics, or compute efficiency analysis.

  • Experience building monitoring systems for billing, usage, SLAs, utilization, or infrastructure reliability.

  • Background in systems engineering, infrastructure software, observability, distributed systems, or platform engineering.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Compensation Range: $293K - $455K

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Tokens-as-a-Service (Taas) Software Engineer in San Francisco, CA vacancy
  • $212.5k - $250k

     ...Senior Software Engineer II, Design Systems San Francisco, CA; Seattle, WA; New York, NY...  ...countries, Carta's platform of software and services lays the groundwork so you can build, invest...  ...eager to explore how component APIs, tokens, and documentation can be optimized to... 
    Suggested
    Full time
    Work at office

    Carta

    San Francisco, CA
    18 hours ago
  • $120k - $170k

     ...Wanna join the adventure? Loft Orbital is looking for a Software Engineer to join our Ground Software Solutions team. About the...  ...launch, and operate spacecraft, offering end-to-end missions as a service across Earth observation, IoT connectivity, on-orbit AI,... 
    Suggested
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    Loft Orbital

    San Francisco, CA
    1 day ago
  •  ...amazing high tech client opportunity that Sr. Engineers will want to hear about! Our San...  ...infrastructure engineers building tooling for Edge services, create and work on SSL/DNS management...  ...~5+ years of full-stack development and software engineering. ~ Demonstrated... 
    Suggested
    Long term contract
    Immediate start

    InterSources

    San Francisco, CA
    4 days ago
  •  ...Senior Fullstack Software Engineer Join us in founding a new team building AI-first products and experiences that will become core to how our customers manage and grow their businesses. As a Senior Fullstack Software Engineer, you'll be one of the early members helping... 
    Suggested
    Work at office
    Shift work
    3 days per week

    MyHealthTeam

    San Francisco, CA
    4 days ago
  • $152k - $190k

     ...spend management, bill pay, and travel software, Brex enables founders and finance teams...  ...'s AI-native automation and world-class service eliminate manual expense and accounting...  ...support you need to grow your career. Engineering at Brex Engineering at Brex is about... 
    Suggested
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    4 days ago
  • $200k - $250k

     ...transforming how legal and professional services operate — not incrementally,...  ...— from leadership to engineers — and work together to solve...  .... Role Overview As a Software Engineer on the Core...  ...processing billions of prompt tokens and millions of daily requests... 
    Full time
    Internship
    Relocation package

    Harvey, Inc.

    San Francisco, CA
    14 hours ago
  • $135k - $236.25k

     ...About the IT Product Team The IT Product Engineering team is critical to unifying Rippling's...  ...administration. Our mission is to build software that enables businesses to manage employee...  ..., implement, and test reliable backend services and APIs that power core product... 
    Work at office
    Remote work
    3 days per week

    Rippling

    San Francisco, CA
    3 days ago
  • $130k - $210k

     ...manage day-to-day operations, and improve service performance. Today, over 180 transit...  ...unable to provide Visa sponsorship. Engineering at Swiftly Engineering at Swiftly is...  ...and mitigate risks, and building scalable software using industry best practices. We’re guided... 
    Work experience placement
    Work at office
    Home office
    Flexible hours

    Breakout Tools

    San Francisco, CA
    2 days ago
  • $165.2k - $223.6k

     ...Description Amazon Interactive Video Service (Amazon IVS) is AWS's fully managed live...  ...move fast. As a Data Infrastructure Engineer, you will be responsible for empowering...  ...3+ years of non-internship professional software development experience ~2+ years of non... 
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    San Francisco, CA
    2 days ago
  • $226k - $306k

     ...Senior Software Engineer, AI Product Insights San Francisco, US (Hybrid) Mixpanel turns data clarity into innovation. Trusted by more...  ...stack, from React frontend experiences to Python backend services to integrating with our query engine, to ship workflows that... 
    Contract work
    Remote work
    Shift work

    Mixpanel

    San Francisco, CA
    4 days ago
  • $99.5k - $185k

     ...Twitch is the world’s biggest live streaming service, with global communities built around...  ...what they love. As a member of the engineering team, you will report to the Senior Engineering...  ...Have: ~1+ Years experience developing software in a professional environment ~ Prior... 
    Flexible hours

    Twitch

    San Francisco, CA
    3 days ago
  •  ...Product-Oriented Full-Stack Engineer Repool is a fintech software startup that is modernizing infrastructure for hedge funds. US hedge funds account for $3.5T of assets but rely upon antiquated services and technology from fractured service providers, and there's an... 
    Temporary work
    Work at office
    Local area
    2 days per week

    Repool

    San Francisco, CA
    3 days ago
  •  ...scalable authentication and authorization services for distributed environments • Develop and maintain system software across multiple OSes (Linux, macOS, Windows)...  ...teams across security, infrastructure, and engineering to support platform integrity and trustworthiness... 

    Insight Global

    San Francisco, CA
    2 days ago
  • $193.3k - $261.5k

     ...Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators. From...  ...Community and Fandom is looking for an experienced Senior Software Development Engineer for our team in San Francisco office. As a Software Engineer... 
    Internship
    Work at office
    Local area
    Flexible hours

    Amazon

    San Francisco, CA
    2 days ago
  • $150k - $230k

     ...the world's most meaningful appointments, helping 100,000+ service businesses earn more revenue and free up time for the work they...  ...grow their businesses That's why we are seeking strong Software Engineers, All levels to join one of our Product or Platform-based... 
    Hourly pay
    Work at office
    Home office
    Flexible hours

    GlossGenius

    San Francisco, CA
    2 days ago
  • $193.3k - $261.5k

     ...Description Amazon Interactive Video Service (Amazon IVS) is AWS's fully managed live...  ...team is looking for experienced mobile engineers to build a multi-platform broadcasting and...  ...customers' live video experiences. As a software engineer in the Mobile Client SDK Team... 
    Internship
    Local area
    Worldwide
    Flexible hours
    Day shift

    Amazon

    San Francisco, CA
    4 days ago
  • $127.1k - $185k

     ...including Reserves, National Guard, and service member spouses. Please list your service...  ..., you'll grow into the high-impact engineer you know you can be, supported by a culture...  ...environment to deliver high-quality software. A day in the life As an intern, you... 
    Full time
    Internship
    Work at office
    Local area
    Worldwide
    Monday to Friday

    Amazon

    San Francisco, CA
    1 day ago
  • $115k - $140k

     ...Software Engineer: Perception Los Angeles, US About Lodestar Lodestar's mission is to develop the first "Protect and Defend" capability...  ...deliver a fully autonomous end-to-end protection spacecraft service. About the Job As a Software Engineer - Perception at... 
    Permanent employment
    Full time
    Flexible hours

    Lodestar

    San Francisco, CA
    1 day ago
  • $181.1k - $272.1k

     ...Software Engineer Apps Store When the App Store was first introduced it launched a cultural and economic phenomenon that changed the way...  ...to over 1.5 million apps and billions of users, to scale the service and help customers find the apps they love. Description... 
    Work experience placement
    Relocation

    Apple

    San Francisco, CA
    4 days ago
  • $168k - $280k

     ...first products and experiences that will become core to how our customers manage and grow their businesses. As a Senior Fullstack Software Engineer, you’ll be one of the early members helping define the architecture, systems, and product experience. You’ll work closely with... 
    Work at office
    Shift work
    3 days per week

    Rippling

    San Francisco, CA
    2 days ago
  • $127.1k - $185k

     ...Twitch is the world's biggest live streaming service, with global communities built around...  ...managers, technical leads, and other engineers to design, develop, launch, and operate...  ...Have: ~1+ Years experience developing software in a professional environment ~ Prior... 
    Flexible hours

    Amazon

    San Francisco, CA
    18 hours ago
  • $175k - $215k

     ...Software Engineer, Booking Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since...  .... The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $99.5k - $200k

     ...Twitch is the world’s biggest live streaming service, with global communities built around...  ...side framework that powers As a Front-end Engineer, you’ll be integral to shipping performant, high quality, and delightful software to Twitch viewers and creators. You Will... 
    Flexible hours

    Twitch

    San Francisco, CA
    3 days ago
  • $181.1k - $318.4k

     ...Sr. Video and Imaging Software Engineer, Vision Products Group Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result... 
    Relocation

    Apple

    San Francisco, CA
    18 hours ago
  •  ...Staff Backend Engineer Tilia is hiring a Staff Backend Engineer to own and evolve our financial services platform serving digital economies, virtual worlds, and creator platforms. We are a Go and Python shop running on AWS, using modern CI/CD to deliver a service oriented... 
    Worldwide
    Night shift

    Thunes

    San Francisco, CA
    4 days ago
  • $99.5k - $200k

     ...About Us Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music...  ...our interview process. About the Role We are seeking Software Engineers to join the ML Products team. This team is focused on... 
    Flexible hours

    Amazon

    San Francisco, CA
    6 days ago
  • $159k - $278.25k

    Senior Software Engineer, Backend Full Stack - IT Product Rippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. For the... 
    Work at office
    Remote work
    3 days per week

    Rippling

    San Francisco, CA
    2 days ago
  • $216k - $288k

     ...assembling a diverse, world-class team-engineers, designers, researchers, and product minds...  ...advancements into every HP product and service, we're expanding what's possible for individuals...  .... About the Role As a Senior Software Engineer specializing in Device Security... 
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    18 hours ago
  • $150k - $215k

     ...Space Infrastructure Software Engineer Wanna join the adventure? As a Space Infrastructure Software Engineer, you are responsible for...  ...launch, and operate spacecraft, offering end-to-end missions as a service across Earth observation, IoT connectivity, on-orbit AI,... 
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    Loft Orbital

    San Francisco, CA
    4 days ago
  • $300 per month

     ...the stack - from electrons to tokens - to power the world's most...  ...center construction, and cloud services. If you want to do the...  ...s Data Center Infrastructure Engineering (DCIE) team is fundamental to...  ...highly skilled and motivated Software Engineer to join Crusoe's Data... 
    Temporary work

    Crusoe

    San Francisco, CA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Tokens-as-a-Service (Taas) Software Engineer. Be the first to apply!