Head of Inference
Confidential
Head of Inference
About the Company
Ambitious AI infrastructure provider
Industry
Information Technology and Services
Type
Privately Held, VC-backed
About the Role
The Company is seeking a Head of Inference to take ownership of model serving at a production scale for its AI infrastructure. This role is pivotal in the transition of the inference business into a standalone line, with a focus on lifting the inference platform from a beta stage to a generally available product with defined cost and latency SLAs. The successful candidate will be responsible for the end-to-end remit, including the serving stack, customer SLOs, and the underlying unit economics. The Head of Inference will also be tasked with pricing the platform, shaping the product roadmap, and driving the inference revenue line as it becomes a significant part of the company's business. Applicants for the Head of Inference position should be current or recent leaders of an inference platform program at a peer infrastructure provider, frontier lab, or hyperscaler. The role requires a dual focus, being both customer-facing on integration and SLAs, and platform-facing on serving and optimization. The ideal candidate will have a strong engineering background with the ability to translate technical expertise into economic terms, as they will be the key decision-maker for inference unit economics. The role involves direct line management of a team of platform engineers and SREs, with plans to expand the team, and therefore, leadership and hiring experience is essential. The Head of Inference will play a critical role in the company's growth, as inference is expected to become a major and profitable line of business.
Hiring Manager Title
VP Platform
Functions
- Engineering
- Product Management
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Head of Inference in New York, NY vacancy
$128.1k - $289.9k
...own writing and storytelling should set the standard for what those tools make possible. Adobe Creative is looking for a visionary Head of Copy to define the copywriting and narrative standard for Adobe Creative’s campaign and creative work, and to build the copywriting...SuggestedFull timeTemporary workLocal areaWorldwideFlexible hours$155.37k - $255.26k
The Head of Operational Excellence and Enablement will drive strategic initiatives to enhance operational efficiency, effectiveness, and organizational readiness within the Group Benefits Underwriting organization. This role is accountable for optimizing learning and development...SuggestedFull timeH1bWork at officeRemote workVisa sponsorshipWork visaFlexible hours3 days per week$170k - $282.5k
We are seeking a senior leader to serve as Head of US ETF Liquidity Solutions, responsible for commercializing and deepening relationships across the dealer and institutional trading ecosystem, positioning our ETF range as a portfolio trading, hedging, and implementation...SuggestedFull timeTemporary workFlexible hours$250k - $300k
About the Role IEX is looking for a Head of SRE, Cross-Assetto lead our SRE organization as we scale our Equities business and launch Options. We’re looking for a deeply technical, intellectually curious leader and change agent who can challenge the status quo, develop...SuggestedWork experience placementLocal area- ...religious minority background. We speak over 20 languages across our 47 nationalities, creating a sense of belonging for all.We're heading in one direction, the future. We’d love you to join us.This role can be based in either the London, New York, or Boston.The Opportunity...SuggestedShift work
$178.69k - $293.56k
Head of Park Avenue Wealth Management TechnologyThis senior leader will define and execute the end-to-end technology strategy for Park Avenue, Guardian’s wealth management broker-dealer, and Guardian Wealth Partners, a new in-house advisory channel. The role will shape...Full timeVisa sponsorshipWork visaFlexible hours- PLEASE CLICK HERE TO SEE *ALL* OF OUR JOB OPENINGS!Head of GTM EnablementAs a leader on the go-to-market team, the Head of GTM Enablement will be responsible for building and scaling the onboarding, training, and continuing education programs for the company’s GTM organization...
$164.2k - $218.9k
...Available No Grade 14M Posted Date 22-Apr-2026 Job ID 17156 Description and Requirements The OpportunityThe Head of L&D - US Business, MIM & Global Functions is responsible for enabling workforce capability and readiness across MetLife’s US...Full timeTemporary workWork at officeLocal areaRelocation package3 days per week$320k - $350k
...certified B Corp. Ready to make a move? Join us. Because we know that alone we’re strong, but together we’re unstoppable.About the roleThe Head of Creative for Athleta leads the brand’s visual identity and storytelling across all consumer touchpoints, driving creative...Minimum wage$165k - $275k
Position DescriptionMorgan Stanley Bank NA (MSBNA) and Morgan Stanley Private Bank (MSPBNA) are nationally chartered banks and material operating subsidiaries of Morgan Stanley. These entities are regulated by the Office of the Comptroller of the Currency (OCC) and the ...Temporary workWork at office$250k - $325k
...valued for who they are and what they contribute.To learn more about CIBC, please visit CIBC.comWhat you'll be doingAs the National Head, Private Bank Lending, you'll serve as a senior leader within the US Private Banking business, with primary accountability for lending...Full time$225k - $250k
WHAT YOU'LL DOViant has established strong momentum across the Consumer Packaged Goods (CPG) industry and is seeking a Head of Industry, CPG to accelerate growth within one of our most strategic verticals. This executive leader will expand brand-direct demand, deepen agency...Local area$139.2k - $289k
...the Enterprise Technology Stack to drive new levels of performance, competitiveness, and customer experienceJob Summary: The Global Head of Cyber Alliances maintains and manages ongoing strategic alliances of global scope with core cybersecurity OEM counterparts, enterprise...Minimum wageFull timeContract workImmediate startFlexible hours$225k - $250k
...YOU’LL DOViant’s Travel business is already a major success, with deep adoption across Travel, and hospitality. We are now seeking a Head of Industry, Travel to further accelerate our growth in this category by scaling brand-direct demand, expanding agency adoption, and...Work experience placementLocal area$225k - $422.5k
Primary DetailsTime Type: Full timeWorker Type: EmployeeHead of North America A&H Reinsurance - QBE ReLocation: USA - New York (Preferred) and other Multi US LocationsWork Arrangement: Hybrid The salary range for this role is: $225,000-$422,500KThe OpportunityThe purpose...Full timeContract workPart timeWork experience placementWork at officeWork from homeRelocation- Posted 4 days agoHead of Ceded Reinsurance opening in NJ, NY, or TX. Manage small team; set long-term vision for multi-line P&C insurance carrier’s outward reinsurance activities; champion creative risk-sharing approaches to enhance capital utilization and protect overall...
$320k - $350k
...immersive experiences, and a shared spirit of creativity and innovation.About the roleReporting to the Chief Marketing Officer, the Head of Creative is a key member of the Banana Republic Marketing Leadership Team and oversees the internal creative organization. The Head...Minimum wage$195k - $240k
...marketing, or social commerce and 3+ years of leadership experience in a people management roleWho you will work with:Report to the Head of Growth MarketingWork side-by-side with best-in-class Performance Marketing teamsManage a team made up 3 direct reports, and x growth...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work$200k - $300k
...classes, such as equities, options, fixed income securities, and advanced trading, research, and management technology. Job purpose: The Head of Cash & Collateral Optimization will work with Treasury on the strategy and execution to improve how StoneX deploys cash,...Permanent employmentFull time$176.6k - $294.3k
...Immunology and Diagnostics organization, you will envision and implement next-generation immunodiagnostics strategies. Reporting to the Head of Clinical Diagnostics, you will drive novel, high-throughput ligand binding assay (LBA) strategies outside of conventional plate-...Permanent employmentFull timeH1bLocal areaVisa sponsorshipWork visaRelocation package2 days per week$180k - $230k
Head of AI - Digital Content PlatformSalary Range: $180,000 to $230,000Location: New York/Remote (EST Working Timezone Considered) Are you driven by the challenge of applying AI and data science to revolutionize how digital content is created and generates revenue? We...Remote work$152.29k - $250.2k
Head of Portfolio Architecture, Corporate FunctionsPosition Overview:The Head of Corporate Functions Architecture is a senior architecture leader responsible for shaping the end-to-end architecture and portfolio roadmap for Corporate Functions, while influencing key investment...Full timeH1bVisa sponsorshipWork visaFlexible hours3 days per week- Seinor Director, Global BenefitsJoin a global organization seeking a Senior Director of Global Benefits to lead benefits strategy, operations, governance, and employee experience across multiple regions. This executive role will oversee the design, administration, and optimization...Local area3 days per week
$160k - $250k
# Head of Private Equity and Structured Credit ValuationsMillenniumHeadPrivate EquityFinancial ServicesFull-timeLocationNew York, United StatesCompensation$160,000 – $250,000 base + discretionary bonusDate PostedMay 19, 2026RegionNew YorkStay ahead of the marketGet instant...InforCapital, partnership
New York, NY2 days ago- ...turn that foundation into products that people can use without needing to understand the technology underneath. We are hiring a Head of Applications to build that layer. You will decide where TwelveLabs should play, find the first use cases where our technology...Work at officeRemote workVisa sponsorshipFlexible hoursDay shiftAfternoon shift
Twelve-Labs
New York, NY3 days ago - Establish and execute institutional strategy for Uniswap’s institutional business, identifying novel use cases, bespoke market structures, partnerships, and adoption pathways Develop institutional GTM motions covering segmentation, positioning, pipeline development,...Full timeWork at officeRelocation
Jobtailor
New York, NY3 days ago - ...The Role This is a foundational hire and a pivotal moment for Antler in North America. We are looking for a Head of Capital Formation to own and scale fundraising across the region - leading institutional capital raising while helping shape the next phase of Antler...Relocation
Antler
New York, NY4 days ago $215k - $260k
...CybSafe is seeking a Head of Workforce Solution Consulting to manage all new and existing business in its workforce vertical. This role involves leading a team of Solution Consultants, ensuring successful product implementations, and collaborating with various departments...Remote workCybSafe
New York, NY4 days ago$20 per hour
Job Description Job Description Technician Needed for Lice Treatments - Training provided Compensation: $20/hour LICE CLINICS OF AMERICA Upper East Side is an all-natural lice treatment company that is seeking 3-4 people to join our team. Our treatment is natural non...Hourly payFlexible hoursLice Clinics of America
New York, NY13 days ago$2,856.59 per week
...Job Description Job Description Head Electrician IATSE Local One Position — The St. James Theatre Position Summary Compensation: $2,856.59/weekly + all applicable overtime per Local One IATSE and Broadway League contract Benefits: per Local One IATSE...16 hoursContract workWork at officeLocal areaAfternoon shiftATG Entertainment USA
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of Inference. Be the first to apply!
Related searches
- head credit administration New York, NY
- head of rewards New York, NY
- head of copy New York, NY
- head golf professional New York, NY
- head coach New York, NY
- head New York, NY
- head of seo New York, NY
- head of investor relations New York, NY
- head of portfolio management New York, NY
- head of architecture New York, NY