Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of Inference

Confidential

Head of Inference

About the Company

Ambitious AI infrastructure provider

Industry
Information Technology and Services

Type
Privately Held, VC-backed

About the Role

The Company is seeking a Head of Inference to take ownership of model serving at a production scale for its AI infrastructure. This role is pivotal in the transition of the inference business into a standalone line, with a focus on lifting the inference platform from a beta stage to a generally available product with defined cost and latency SLAs. The successful candidate will be responsible for the end-to-end remit, including the serving stack, customer SLOs, and the underlying unit economics. The Head of Inference will also be tasked with pricing the platform, shaping the product roadmap, and driving the inference revenue line as it becomes a significant part of the company's business. Applicants for the Head of Inference position should be current or recent leaders of an inference platform program at a peer infrastructure provider, frontier lab, or hyperscaler. The role requires a dual focus, being both customer-facing on integration and SLAs, and platform-facing on serving and optimization. The ideal candidate will have a strong engineering background with the ability to translate technical expertise into economic terms, as they will be the key decision-maker for inference unit economics. The role involves direct line management of a team of platform engineers and SREs, with plans to expand the team, and therefore, leadership and hiring experience is essential. The Head of Inference will play a critical role in the company's growth, as inference is expected to become a major and profitable line of business.

Hiring Manager Title
VP Platform

Functions

  • Engineering
  • Product Management
Confidential
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Head of Inference in New York, NY vacancy
  •  ...Role Cloudflare is building one of the most differentiated AI inference platforms in the market. We aren’t building another...  ...someone to own the go-to-market strategy for this business. As Head of GTM, AI Inference, you will be the connective tissue between... 
    Suggested
    Full time
    Temporary work
    Local area
    Flexible hours
    Shift work

    Cloudflare_

    New York, NY
    3 days ago
  • $80 per hour

    About Rula Rula is a comprehensive behavioral health solution that works with a network of licensed clinicians to deliver high-quality care to individuals, couples, and families. By taking care of all the new client marketing and administrative heavy-lifting, we allow...
    Suggested
    Hourly pay
    For contractors
    Private practice
    Work at office
    Remote work
    Flexible hours

    Rula

    New York, NY
    1 day ago
  • $25 per unit

    Job description We are urgently looking for people interested in taking online surveys for Fortune 500 brands. If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up to $25 per survey. Share your opinion and help influence...
    Suggested
    Extra income
    Full time
    Part time
    Second job
    Remote work
    Work from home
    Flexible hours

    Earn Haus

    New York, NY
    15 days ago
  • The Role Output has built a biological reasoning model that understands biology at the scale and complexity life actually operates. Our model independently learned the principles of molecular interactions, opening up drug treatments that were previously impossible. We'...
    Suggested

    Output Biosciences

    New York, NY
    4 days ago
  • $145k - $165k

    Location: New York, NY Salary: $145,000 - $165,000 | 0.05% - 0.10% Equity About Wally 84% of Americans want to go to the dentist this year. 40% will. For fifty years, dentistry has run on simple math: get someone in the chair, find something to fix, bill the ...
    Suggested
    Full time
    Work at office

    Wally Health

    New York, NY
    4 days ago
  • $200k - $275k

     ...Head of Valuations opportunity with a prestigious $200B+ AUM multi-strategy / credit-focused alternative investment manager. This is an exceptional opportunity for someone looking to take the next step in their career and lead an impressive, established valuations team... 
    Immediate start
    3 days per week

    Green Key Resources

    New York, NY
    3 days ago
  •  ...Solar Eclipse New York is looking for an exceptional, commercially driven Head of TikTok Shop & Social Commerce to build TikTok Shop into a major revenue channel for our rapidly growing global accessories and lifestyle brand. This is not a traditional social media... 

    Solar Eclipse New York

    New York, NY
    a month ago
  • $168k

     ...Head of Portfolio Architecture, Corporate Functions Direct Hire (Base + Bonus) Work Location (Hybrid): 3 days/week onsite — New York, NY, Holmdel, NJ, or Bethlehem, PA We’re prioritizing candidates with: Insurance industry architecture leadership experience... 
    3 days per week

    Yoh, A Day & Zimmermann Company

    New York, NY
    19 hours ago
  •  ...giveaway pickleball stuff with Katy Perry, churn out viral content like it's our job (it is), broadcast and livestream big events, go head-to-head with the top pickleball players on the planet...and much more. Our content engine fuels all of it, and we're looking... 
    For contractors
    Freelance
    Remote work

    The Dink Pickleball

    New York, NY
    8 days ago
  •  ...and be a part of something truly special at Biz2Credit. About the Role Biz2Credit is seeking an experienced, multi-faceted Head of Content & Creative to own and evolve our brand identity, messaging, and multimedia content strategy. Reporting directly to the Chief... 
    Freelance

    Biz2Credit

    New York, NY
    4 days ago
  • $240k

     ...services, and administrative functions while partnering closely with senior stakeholders and global teams. THE ROLE This is a Head of Administration position responsible for leading the administrative and workplace operations function for a large New York office.... 
    Full time
    Work at office

    Joss Search

    New York, NY
    10 days ago
  • We’re is partnered with a financial services company seeking an SVP to build and lead its compensation and benefits function within an evolving HR team. This is a hands-on opportunity to overhaul the compensation framework, lead a comprehensive benefits and insurance...

    JCW Group

    New York, NY
    a month ago
  •  ...Practice Head - Healthcare & Life Sciences (HCLS) About Coforge Coforge is a global digital services and solutions provider, that leverages emerging technologies and deep domain expertise to deliver real-world business impact for its clients. A focus on select... 
    Full time

    Coforge

    New York, NY
    4 days ago
  • Are you passionate about engineering and AI? The AI revolution is here, and we’re looking for someone who wants to own, transform, and integrate AI within a private equity ecosystem. In this role, you will act as an internal innovation hub, generating ideas and rapidly...
    Full time

    Saragossa

    New York, NY
    2 days ago
  • The Company Our client is a leading alternative credit manager with over $60B in AUM. Responsibilities Own the end-to-end monthly and quarterly fair value process for a large portfolio of privately originated loans, equity co-investments, warrants, and other hard...

    Wall Street Careers®

    New York, NY
    2 days ago
  • $200k - $225k

     ...Jefferies Finance is seeking a Head of Valuations to lead valuation and pricing processes across its private credit platform. The role will oversee the monthly/quarterly private credit valuations for the direct lending business in coordination with its third-party valuation... 
    Full time

    Jefferies

    New York, NY
    1 day ago
  • $205k - $250k

     ...We are seeking a Head of Audience Engagement to lead audience growth, engagement and retention strategies across a portfolio of digital media brands. This individual will be responsible for evolving how we reach, engage and retain audiences, with an emphasis on growing... 
    Full time
    Casual work
    Shift work

    Confidential

    New York, NY
    2 days ago
  • $120k - $150k

    About ODDITY ODDITY is a consumer-tech company that builds and scales digital-first brands to disrupt offline-dominated categories. In less than five years since launch, we have built three of the fastest-growing online beauty and wellness brands in the US — IL MAKIAGE...
    Full time
    Work at office

    IL MAKIAGE

    New York, NY
    4 days ago
  •  ...technology. Following strong early customer adoption, the business is entering its next phase of growth and is looking to appoint a Head of Revenue to build and scale its commercial function. This is an opportunity to join at a pivotal stage in the company's journey. The... 
    Full time

    FinPro.

    New York, NY
    1 day ago
  •  ...An established financial services firm is seeking an experienced Head of Anti-Money Laundering (AML) to lead its financial crimes compliance program across securities and derivatives activities. This position will oversee the firm's AML and sanctions framework, manage... 
    Full time

    Madison-Davis, LLC

    New York, NY
    13 hours ago
  • $100k

     ...The Burnouts | New York, NY | Full-time, in-office The Burnouts is hiring a full-time head of content to join our NYC team. The Burnouts has grown to nearly 1.2M followers across platforms and generated over 700 MILLION impressions since launch. And we’re just... 
    Full time
    Work at office

    The Burnouts

    New York, NY
    4 days ago
  • $10 per hour

     ...Our client is a US-based Hedge Fund with a 15+ year track-record and ~$10Bil AUM. They're looking to secure a Head of Equity Capital Markets. This hire will work out of their NYC offices and have a strong track-record working with 10+ years experience in ECM. Our Client... 

    JW Michaels & Co.

    New York, NY
    12 days ago
  • $200k - $300k

    Description Market Services is the unit within BBVA which is charged with providing access to market infrastructure for our clients.We currently operate out of Madrid, London and Mexico providing access to OTC Clearing and Futures and Options execution and clearing. The...
    Work at office

    BBVA

    New York, NY
    a month ago
  • An international bank is growing its New York transaction banking business. This is a hands-on product and structuring seat: you'd personally structure and pitch trade finance and cash management solutions for corporate clients, working alongside the Corporates coverage...

    JCW Group

    New York, NY
    1 day ago
  •  ...Head of Equities, Exotics & Structured Products — Director The Opportunity We are seeking a Director-level leader to serve as Head of Equities, Exotics & Structured Products. This individual will lead a global team of approximately 15–20 professionals responsible... 
    Full time

    The Cypress Group

    New York, NY
    4 days ago
  • $205.45k

     ...interest into bookings, build a high-performing sales team, and grow profitable revenue across the guest journey. The opportunity As Head of Revenue, you’ll lead our phone-sales function and coordinate revenue improvement across reservations, digital booking, rebooking,... 

    BOLT FARM TREEHOUSE

    New York, NY
    3 days ago
  •  ...Head of Content Location: New York, NY Work Arrangement: Full-time | On-site About the Role We are looking for a hands-on Head of Content to lead and scale content strategy across social media platforms for a fast-growing consumer technology company.... 
    Full time

    ALANS Group

    New York, NY
    1 day ago
  •  ...the first 25 applicants Barrington James is partnered with a large research consultancy looking to bring on board a Pharmacovigilance Head on a part time contract. Responsibilities would include: Lead the company’s drug safety and pharmacovigilance strategy. Oversee... 
    Contract work
    Part time
    Remote work

    Barrington James

    New York, NY
    3 days ago
  • $200k - $265k

     ...Box, UPS, and C.H. Robinson and we’re looking for builders who want to help shape what comes next. About The Role Loop is seeking a Head of Payments to build and lead our client payments and treasury function as we scale. Reporting to the CFO, you will own liquidity and... 
    Temporary work
    Flexible hours

    Loop

    New York, NY
    5 days ago
  • $150k - $200k

    About InstaLILY InstaLILY builds AI that does the work. We automate complex workflows across the physical economy—industrial, healthcare, and construction—using AI agents that execute directly inside existing enterprise systems. We are backed by Insight Partners and...
    Work at office
    Shift work

    Instalily, Inc.

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of Inference. Be the first to apply!