Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Program Manager, Model Performance

$165k - $330k

Baseten

About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

The Model Performance organization at Baseten is looking to hire our first Technical Program Manager. This is a zero‑to‑one role in a team that is responsible for building the core algorithms and methods that power Baseten’s high performance inference stack. You won't inherit an existing program framework, you'll build one from the ground up: the planning structure, execution processes, metrics and the cross‑functional alignment that a fast‑growing organization needs. Your contributions will directly impact how fast our performance R&D gets productized. If you can drive turning a set of ambitious but loosely defined initiatives into a predictable, well‑governed program, this role is for you.

EXAMPLE INITIATIVES

How to build a day-0 API for Kimi K3 How we built the new fastest API for GLM-5.2 Inference engineering for DeepSeek V4 Pro 0813 Responsibilities Own execution across Model Performance's active project portfolio, freeing the team's technical leads to focus on technical direction rather than tracking. Design and stand up the planning structures, operating cadences, and status reporting mechanisms that best fits the team’s DNA. Coordinate model release and optimization programs end to end, including day-zero launches, sequencing the work across performance engineering, infra, and release stakeholders. Drive cross-team alignment as scope expands from Model Performance Core into Model APIs and the inference production stack (BIS). Surface risks and dependencies early, and keep leadership informed with clear, honest status. Partner with engineering leads to design team structures and ownership boundaries as the org scales. Requirements Deep technical program management experience - you're already running programs of this scope at an organization of similar or greater complexity. Experience program‑managing model performance or inference optimization work - you understand how engines like vLLM, TensorRT-LLM, SGLang, or NVIDIA Dynamo fit into a production serving stack and can engage credibly with the engineers building on them. Demonstrated comfort with ambiguity and zero-to-one program building, not just executing an existing framework. Proven ability to influence without authority across engineers, managers, and leadership who don't report to you. Excellent written and verbal communication, with the ability to make deeply technical programs legible to any audience. High agency decision making that demonstrates ownership, accountability and a strong desire to get things done.

NICE TO HAVE

Experience coordinating model release programs, including day-zero launches (ideally for large‑scale models). Prior hands‑on software engineering background. Deep learning performance optimization background, in training or inference, with inference preferred. Benefits Competitive compensation, including meaningful equity 100% coverage of medical, dental, and vision insurance for employee and dependents Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!) Paid parental leave Fertility and family‑building stipend through Carrot Company‑facilitated 401(k) Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities. At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable). Compensation Range: $165K - $330K #J-18808-Ljbffr Baseten

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Technical Program Manager, Model Performance in New York, NY vacancy
  • Baseten is seeking their first Technical Program Manager for the Model Performance group in the United States. You will build a from-scratch planning and governance framework for high-performance inference, coordinating across engineering, infra, and release stakeholders... 
    Suggested

    Baseten

    New York, NY
    1 day ago
  •  ...Technical Program Manager Hybrid - New York This is a Senior Technical Program Manager will support the planning and execution of programs related to t developer platforms - tools and services for scale offered to internal engineers across the technology organization... 
    Suggested
    Full time

    Optomi

    New York, NY
    4 days ago
  •  ...Technical Program Manager – Software Engineering | Hedge Fund Leading Global Hedge Fund | New York Please note: Unfortunately, visa sponsorship is not available. Total Comp: Base + Cash Bonus (Competitive) The Opportunity A leading global hedge fund is... 
    Suggested
    Full time

    Goldman Lloyds

    New York, NY
    15 hours ago
  • $120k - $140k

     ...for more information about Fractal. Role Overview: Technical Program Manager, Remote, Full Time Client Relationship & Account Management...  ...actionable insights, KPIs, operational reporting, and performance measurement frameworks. Serve as a trusted advisor to... 
    Suggested
    Full time
    Local area
    Remote work

    Fractal

    New York, NY
    3 days ago
  •  ...BCforward is seeking a highly motivated and experienced Technical Program Manager Note: Candidate must be local to New York, NY. Job Title...  ...lifestyle, and automation, grounded in our data technology model that prioritizes data governance and data management. It... 
    Suggested
    Long term contract
    Local area

    BCforward

    New York, NY
    2 days ago
  • $75 - $85 per hour

    Job Title Technical Program Manager (Analytics) – Portfolio / Program Delivery Pay $75-$85/hr. Location Remote (United States) —...  ...metrics cadence (monthly), insights, and accountability to performance indicators Manage Azure DevOps boards to maintain... 
    Remote work
    Home office

    Prestige Staffing

    New York, NY
    11 days ago
  • $110k - $129k

     ...Technical Program Manager, Brokerage Join us in building the future of finance. Our mission is to democratize finance for all. An estimated...  ...intentional, energizing, and designed to fully support high-performing teams. What You'll Do Drive execution across... 
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robin Hood

    New York, NY
    2 days ago
  • $140.4k - $166.1k

    ABOUT THE ROLEWe’re looking for a Technical Program Manager (TPM) to drive complex, cross-functional cybersecurity programs across our enterprise technology landscape — security initiatives, risk remediation, compliance efforts, and technology projects that span many teams... 
    Local area

    Peloton Cycle

    New York, NY
    4 days ago
  • $163.6k - $221.3k

    As a Technical Program Manager for the Amazon DVA+ Delivery Program, you own the lifecycle of a complex, cross-functional program that directly shapes how advertisers experience campaign delivery. You define the program mission, set objectives, and drive teams inside and... 
    Flexible hours

    Amazon

    New York, NY
    7 hours ago
  • $163.6k - $221.3k

     ...and engage with brands online. As a Technical Program Manager, you’ll lead large-scale technical programs...  ...decisions and plan the launch of model improvements into customer-facing...  ...predicts impressions, spend, reach, and performance for advertiser campaigns, while our guidance... 
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  • $10k

     ...deserves the same.If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it.About The RoleWe’re looking for a Technical Program Manager who can work across engineering, product, and business teams. You’ll bring the... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    2 days ago
  • $139.9k - $189.2k

    We're seeking a Technical Program Manager to join the Data Infrastructure and Generative Intelligence (DIGI) team within Advertising Finance. In this role, you will be responsible for scoping and delivering large cross-functional projects end-to-end that enable AI-powered... 
    Remote work
    Flexible hours
    Shift work

    Amazon

    New York, NY
    7 hours ago
  • $163.6k - $221.3k

    We are looking for a Technical Program Manager to join the PV Ads - Ad Tech Ops team, a newly formed centralized operational backbone for advertising technology across Prime Video Channels (PVC) and FAST partnerships. This TPM will drive scalable processes for partner onboarding... 
    Flexible hours

    Amazon

    New York, NY
    2 days ago
  • $182k - $242k

     ...enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute...  ...extraordinary speed. We are seeking a Senior Technical Program Manager to lead the delivery of our compute fleet—the GPU and CPU... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • $157k - $210k

     ...enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute...  ...a highly motivated and experienced Senior FW Technical Program Manager (TPM) to join our dynamic team focused on the New Product... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $194.7k - $263.4k

     ...can I make more money." As a Principal Technical Program Manager for the FAIM team, you will own this...  ...achieve outcomes that today's models cannot.Current state-of-the-art models...  ...ensure scalability, reliability, and performance- Drive operational excellence through... 
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $170k - $190k

     ...By building intuitive, high-performance applications, our team provides...  ...constraints. Strong program leadership is the connective...  ...products or platform for Compass.Manage the full life cycle of key programs...  ...manage, and deliver multiple technical programs that may span... 
    Minimum wage
    Flexible hours

    Compass

    New York, NY
    3 days ago
  • $157k - $210k

     ...enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute...  ...2025. Learn more at .About the TeamAs a Sr. Technical Program Manager on the Capacity Delivery team, you will own the end-to-... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $163.6k - $221.3k

     ...personalization for sellers, vendors, and offsite advertisers. As a Sr. Technical Program Manager on GPS, you will drive programs that directly shape how...  ...consolidating fragmented systems into unified, domain-modeled interfaces that serve multiple channels and consumer... 
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $116k - $148k

    We are seeking a motivated and experienced Technical Program Manager to join Datadog’s Technical Solutions organization. This organization is made...  ...at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve... 
    Work at office

    Datadog

    New York, NY
    3 days ago
  • $120k - $140k

    The Technical Program Manager leads the program management strategy and execution and drives continuous improvement of the foundation’s core digital...  ...infrastructure teams to maintain high standards of site performance, accessibility, and security.Optimize design-to-... 
    Full time
    Local area

    Simons Foundation

    New York, NY
    1 day ago
  • $182k - $242k

     ...CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate...  ...scale. We are seeking a Staff Technical Program Manager to define and lead how maintenance and...  ...infrastructure. You will establish the operating model, decision frameworks, and execution... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    15 hours ago
  • $192k - $278k

    Lead, mentor, and grow a distributed team of technical program managers and engineers driving asset reliability, configuration management, and...  ..., and improve facility uptime.Define and track key performance indicators (KPIs) to measure asset health, program execution... 
    Local area

    Google

    New York, NY
    1 day ago
  • $163k - $236k

     ...translate safety risks into measurable technical goals, driving strategic planning and...  ...cross-functional partnerships across modeling, infrastructure, evaluation, governance...  ...regulatory requirements.Implement robust program management frameworks (OKRs, stand-ups,... 

    Google

    New York, NY
    3 days ago
  • $117.58k - $154.32k

    Hi, we're Oscar. We're hiring Technical Program Managers to join our Technical Program Management team. Oscar is the first health insurance company...  ...in Oscar's unlimited vacation program, and annual performance bonuses.Responsibilities:Lead complex technical programs... 
    Full time
    Work at office
    Flexible hours

    Oscar Health Insurance

    New York, NY
    1 day ago
  • $200k - $270k

     ...business’s system of record to making and managing AI agents to automating away the busy...  ...design leaders at Notion to help run the programs and operating rhythms that keep EPD focused...  ...outcomeForge strong partnerships with technical and business leaders across the company,... 
    Local area

    Notion Labs

    New York, NY
    2 days ago
  • $190k - $284k

     ...Bitmoji, Saturn, and other digital services.At Snap, the Technical Program Manager (TPM) is not a traditional project coordinator—this is a strategic...  ...programs (focused on reliability, efficiency, and performance).Drive the operating rhythm of the business, ensuring engineering... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    New York, NY
    4 days ago
  • $184k - $230k

     ...require humans, and drive the company’s most technically complex and consequential bets to completion.Technical Program Management at Datadog operates at the intersection of...  ...data platforms, or AI/ML systems including model training pipelines, ML infrastructure, and GPU... 
    Work at office
    Local area
    Shift work

    Datadog

    New York, NY
    15 hours ago
  • $157k - $210k

     ...CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate...  ...function. We’re looking for a Technical Program Manager to join the CIO organization and...  ...maintenance windows, operational support models, and audit readiness.Experience... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Immediate start
    Flexible hours

    CoreWeave

    New York, NY
    15 hours ago
  •  ...to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role   As a Technical Program Manager (TPM), you are the engine behind Palantir’s engineering teams. You partner with developers to optimize our development process... 
    Full time

    palantir

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Program Manager, Model Performance. Be the first to apply!