Head of Inference
Confidential
Head of Inference
About the Company
Ambitious AI infrastructure provider
Industry
Information Technology and Services
Type
Privately Held, VC-backed
About the Role
The Company is seeking a Head of Inference to take ownership of model serving at a production scale for its AI infrastructure. This role is pivotal in the transition of the inference business into a standalone line, with a focus on lifting the inference platform from a beta stage to a generally available product with defined cost and latency SLAs. The successful candidate will be responsible for the end-to-end remit, including the serving stack, customer SLOs, and the underlying unit economics. The Head of Inference will also be tasked with pricing the platform, shaping the product roadmap, and driving the inference revenue line as it becomes a significant part of the company's business. Applicants for the Head of Inference position should be current or recent leaders of an inference platform program at a peer infrastructure provider, frontier lab, or hyperscaler. The role requires a dual focus, being both customer-facing on integration and SLAs, and platform-facing on serving and optimization. The ideal candidate will have a strong engineering background with the ability to translate technical expertise into economic terms, as they will be the key decision-maker for inference unit economics. The role involves direct line management of a team of platform engineers and SREs, with plans to expand the team, and therefore, leadership and hiring experience is essential. The Head of Inference will play a critical role in the company's growth, as inference is expected to become a major and profitable line of business.
Hiring Manager Title
VP Platform
Functions
- Engineering
- Product Management
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Head of Inference in New York, NY vacancy
$170k - $230k
...unmet medical needs. Biomanufacturing, reinvented. Medicine, democratized. Role Summary We are looking for an exceptional Head of Biologics to lead the selection and development of therapeutic proteins produced using Neion Bio’s egg-based biomanufacturing platform...SuggestedNeion Bio
New York, NY14 days ago- Mongo is seeking a Head of AI Platform, GM to lead the development and scaling of a new AI Applications Platform. With millions of... ...for the business unit. Manage the budget for R&D, infrastructure/inference costs, and headcount planning. R&D Leadership: Build and lead a...SuggestedLocal areaRemote workWorldwideDay shift
$200k - $400k
Controller/Head of Registered PE Fund (BDC/Interval/REIT) Controller/Head of Registered PE Fund (BDC/Interval/REIT) 1 day ago Be among... ...increase your chances of interviewing at Atlantic Group by 2x Inferred from the description for this job Medical insurance Vision insurance...SuggestedFull timeRemote work$225k - $250k
...YOU’LL DOViant’s Travel business is already a major success, with deep adoption across Travel, and hospitality. We are now seeking a Head of Industry, Travel to further accelerate our growth in this category by scaling brand-direct demand, expanding agency adoption, and...SuggestedWork experience placementLocal area$214.8k - $252.7k
...you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a strategic and transformational technology Executive to serve as Head of FICC Technology. This role will lead technology strategy, delivery, and operational performance supporting the Fixed Income, Currencies...SuggestedFull timeWork experience placementLocal area$139.2k - $289k
...the Enterprise Technology Stack to drive new levels of performance, competitiveness, and customer experienceJob Summary: The Global Head of Cyber Alliances maintains and manages ongoing strategic alliances of global scope with core cybersecurity OEM counterparts, enterprise...Minimum wageFull timeContract workImmediate startFlexible hours$225k - $250k
WHAT YOU'LL DOViant has established strong momentum across the Consumer Packaged Goods (CPG) industry and is seeking a Head of Industry, CPG to accelerate growth within one of our most strategic verticals. This executive leader will expand brand-direct demand, deepen agency...Local area$230k - $270k
Transform the end‑to‑end global Order‑to‑Cash engine in successful firm.Lead a global function at the center of revenue and operational transformation.About Our ClientThe employer is a large organization within the financial services industry, known for its commitment to...Contract workRemote workShift work$152.29k - $250.2k
...The Head of Innovation in the Financial Protection & Retirement Solutions (FPRS) division is a leadership role responsible for defining and executing a forward-looking innovation strategy that reimagines how we serve advisors, clients, and Guardian colleagues. This leader...Full timeWork experience placementVisa sponsorshipWork visaFlexible hours$150k - $180k
...subscriber growth, this is your chance to make a global impact and be part of a team changing the future of sports broadcasting.The Role:As Head of CRM, you will lead the global retention and CRM strategy for some of DAZN's most important partnerships. You will oversee the...Temporary workWork at officeFlexible hours$155.37k - $255.26k
The Head of Operational Excellence and Enablement will drive strategic initiatives to enhance operational efficiency, effectiveness, and organizational readiness within the Group Benefits Underwriting organization. This role is accountable for optimizing learning and development...Full timeH1bWork at officeRemote workVisa sponsorshipWork visaFlexible hours3 days per week$152.29k - $250.2k
Head of Portfolio Architecture, Corporate FunctionsPosition Overview:The Head of Corporate Functions Architecture is a senior architecture leader responsible for shaping the end-to-end architecture and portfolio roadmap for Corporate Functions, while influencing key investment...Full timeH1bVisa sponsorshipWork visaFlexible hours3 days per week$250k - $300k
About the Role IEX is looking for a Head of SRE, Cross-Assetto lead our SRE organization as we scale our Equities business and launch Options. We’re looking for a deeply technical, intellectually curious leader and change agent who can challenge the status quo, develop...Work experience placementLocal area$176.6k - $294.3k
...Immunology and Diagnostics organization, you will envision and implement next-generation immunodiagnostics strategies. Reporting to the Head of Clinical Diagnostics, you will drive novel, high-throughput ligand binding assay (LBA) strategies outside of conventional plate-...Permanent employmentFull timeH1bLocal areaVisa sponsorshipWork visaRelocation package2 days per week$195k - $240k
...marketing, or social commerce and 3+ years of leadership experience in a people management roleWho you will work with:Report to the Head of Growth MarketingWork side-by-side with best-in-class Performance Marketing teamsManage a team made up 3 direct reports, and x growth...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work$200k - $300k
...classes, such as equities, options, fixed income securities, and advanced trading, research, and management technology. Job purpose: The Head of Cash & Collateral Optimization will work with Treasury on the strategy and execution to improve how StoneX deploys cash,...Permanent employmentFull time$180k - $230k
Head of AI - Digital Content PlatformSalary Range: $180,000 to $230,000Location: New York/Remote (EST Working Timezone Considered) Are you driven by the challenge of applying AI and data science to revolutionize how digital content is created and generates revenue? We...Remote work- About this role:Wells Fargo is seeking a Head of Treasury Advisory for Complex Liquidity Solutions to lead the development and delivery of sophisticated treasury, liquidity, and working capital strategies that help clients optimize funding, cash flow, and operational efficiency...Full timeWork experience placement
$320k - $350k
...immersive experiences, and a shared spirit of creativity and innovation.About the roleReporting to the Chief Marketing Officer, the Head of Creative is a key member of the Banana Republic Marketing Leadership Team and oversees the internal creative organization. The Head...Minimum wage- Posted 4 days agoHead of Ceded Reinsurance opening in NJ, NY, or TX. Manage small team; set long-term vision for multi-line P&C insurance carrier’s outward reinsurance activities; champion creative risk-sharing approaches to enhance capital utilization and protect overall...
- Seinor Director, Global BenefitsJoin a global organization seeking a Senior Director of Global Benefits to lead benefits strategy, operations, governance, and employee experience across multiple regions. This executive role will oversee the design, administration, and optimization...Local area3 days per week
$303k
Grant Thornton is seeking a Managing Director, Value Creation Office to join the team. Reporting to the Chief Financial Officer, the Managing Director, Value Creation Office (VCO), will lead Grant Thornton’s enterprise value creation capability during a period of sustained...InternshipSeasonal workWork at officeLocal areaFlexible hours3 days per week- ...religious minority background. We speak over 20 languages across our 47 nationalities, creating a sense of belonging for all.We're heading in one direction, the future. We’d love you to join us.This role can be based in either the London, New York, or Boston.The Opportunity...Shift work
$340k - $420k
...organization. Role Overview This is a rare opportunity to lead one of the most influential franchises in U.S. capital markets. As SVP, Head of US Equities, you will hold full strategic and P&L ownership across Cboe's four U.S. equities exchanges — setting the vision,...Full timeTemporary workImmediate start$178.69k - $293.56k
Head of Park Avenue Wealth Management TechnologyThis senior leader will define and execute the end-to-end technology strategy for Park Avenue, Guardian’s wealth management broker-dealer, and Guardian Wealth Partners, a new in-house advisory channel. The role will shape...Full timeVisa sponsorshipWork visaFlexible hours$179k - $249k
...complex, multi-market commercial and technical agreements (JBPs) with global partner headquarters (e.g., Circana, Meridian).As the Global Head of 3P Measurement, you will be the lead for Google's global third-party measurement and media effectiveness partner ecosystem. You...Local areaShift work$225k - $422.5k
Primary DetailsTime Type: Full timeWorker Type: EmployeeHead of North America A&H Reinsurance - QBE ReLocation: USA - New York (Preferred) and other Multi US LocationsWork Arrangement: Hybrid The salary range for this role is: $225,000-$422,500KThe OpportunityThe purpose...Full timeContract workPart timeWork experience placementWork at officeWork from homeRelocation$164.2k - $218.9k
...Available No Grade 14M Posted Date 22-Apr-2026 Job ID 17156 Description and Requirements The OpportunityThe Head of L&D - US Business, MIM & Global Functions is responsible for enabling workforce capability and readiness across MetLife’s US...Full timeTemporary workWork at officeLocal areaRelocation package3 days per week$210k - $262.5k
Head of Healthcare and Life Sciences GTMAI is transforming how the world’s largest companies operate. At Scale, our mission is to Develop reliable AI systems for the world’s most important decisions. Scale has powered breakthroughs in generative AI, defense, and autonomy...Full time- About RipplingRippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. For the first time ever, you can manage and automate...Work at office3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of Inference. Be the first to apply!
Related searches
- head of architecture New York, NY
- head of portfolio management New York, NY
- head golf professional New York, NY
- head coach New York, NY
- head of seo New York, NY
- head credit administration New York, NY
- head of investor relations New York, NY
- head New York, NY
- head of copy New York, NY
- head of rewards New York, NY