Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference Engineering Lead

$210.73k - $358.07k

The Red Hat

A leading enterprise open source software provider in Boston seeks a Senior Engineering Manager to lead the Machine Learning Engineering team. You will focus on vLLM inference, drive the vision for engineering teams, and engage with open-source communities. The ideal candidate has over 10 years of software development experience, including 5 years in management, with a strong background in machine learning. Competitive salary range between $210,730.00 and $358,070.00 based on qualifications. #J-18808-Ljbffr Red Hat

Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineering Lead in Boston, MA vacancy
  •  ...A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building and releasing system software across various architectures. You will work on cloud infrastructure and enhance... 
    Senior

    Red Hat

    Boston, MA
    4 days ago
  • $133.65k - $220.68k

     ...Red Hat, LLC in Boston is on a quest for a Senior Software Engineer to lead the development of the Red Hat AI Inference Server. This role involves the full lifecycle, from compiling wheels to managing multi-cloud infrastructure and ensuring model accuracy. The ideal candidate... 
    Senior

    Red Hat

    Boston, MA
    3 days ago
  •  ...A leading open-source company is looking for a Senior Performance Engineer in Boston, MA to enhance the performance and scalability of AI workloads. This role involves defining performance metrics, collaborating with teams, and utilizing tools like vLLM and PyTorch. Candidates... 
    Senior

    Red Hat

    Boston, MA
    3 days ago
  •  ...Pfizer Belgium in Cambridge is looking for an AI & Data Engineer to build AI-enabled solutions for Oncology R&D workflows. The role requires significant experience in data pipelines, analytics, and machine learning to improve operations and decision-making. The ideal... 
    Senior

    Pfizer Belgium

    Cambridge, MA
    3 days ago
  • $119.6k - $215.4k

     ...delivery of cutting-edge AI infrastructure? Join the Akamai Inference Cloud Team! The Akamai...  ...with the best As a Senior Technical Program Manager...  ..., and proven experience leading large-scale technical programs...  ..., cloud infrastructure engineering or AI/ML or its... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Work from home
    Worldwide
    Flexible hours
    Shift work

    Akamai

    Cambridge, MA
    1 day ago
  • $119.6k - $215.4k

    Senior Technical Program Manager (Akamai Inference Cloud) United States (Remote) Job Description Do...  ...of cutting‑edge AI infrastructure? Join the...  ..., and proven experience leading large‑scale technical programs...  ...management, cloud infrastructure engineering or AI/ML or its... 
    Senior
    Work experience placement
    Remote work
    Worldwide
    Shift work

    Akamai Technologies GmbH

    Cambridge, MA
    2 days ago
  •  ...A leading software solutions provider seeks a Forward Deployed Engineer to manage and optimize Large Language Model (LLM) inference systems for client environments. The ideal candidate will have over...  ...particularly with Kubernetes and AI inference techniques. Responsibilities... 

    Red Hat

    Boston, MA
    4 days ago
  • $180k - $250k

     ...Senior AI Engineer (LLMs / Agents) Boston, Massachusetts (Hybrid / Remote) $180,000 - $250,000 + Equity + Healthcare + PTO Are...  ...harnesses to track model and agent performance *Optimize inference for latency and throughput using vLLM or TensorRT-LLM *Deploy... 
    Senior
    Remote work

    Rise Technical

    Boston, MA
    40 minutes ago
  •  ...Senior Software Engineer - AI & Data Engineering Location: Boston, MA (Onsite every Thursday)...  ...life sciences domains. We partner with leading organizations to deliver cutting-edge...  ...tasks in story points, factoring in LLM inference latency and API rate limits.... 
    Senior

    Saviance

    Boston, MA
    4 days ago
  • $133.65k - $220.68k

     ...Hat, we believe the future of AI is open and we are on a...  ...enterprise. The Red Hat AI Inference team accelerates AI for the...  ...simplicity to GenAI deployments. As leading developers and maintainers...  ...are seeking an experienced Senior Software Engineer to build and release the Red... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    3 days ago
  • $158k - $197.5k

     ...Job Description WilmerHale is a leading, full-service international law firm...  ...practice. About the Role The Senior AI Defense Engineer is a technical leader responsible for...  ...poisoning, model inversion and membership inference, overreliance/automation bias, and... 
    Senior
    Work experience placement
    Shift work

    Wilmerhale

    Boston, MA
    1 day ago
  • $96.8k - $306.4k

     ...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical...  ...platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI...  ...into durable technical strategy, lead multi-team execution without... 
    Senior
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    5 days ago
  • $200k - $325k

     ...Job Description We are building an AI Engineering function to enable productivity and agentic...  ..., developers, and business teams. As a Senior AI Platform Engineer, you will design and...  ...that powers AI systems firm‑wide: inference services, agentic platforms, developer... 
    Senior
    Work at office
    Local area

    Arrowstreet Capital

    Boston, MA
    4 days ago
  • $144k - $270k

     ...Your Impact at LILA We are seeking a Senior Software Engineer to join our Applied AI group and help build the next generation of our AI-driven scientific...  ...vector databases to support low-latency AI retrieval and inference workloads. Cloud & Infrastructure: Leverage AWS,... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Dormont Manufacturing Company

    Cambridge, MA
    3 days ago
  • $150k - $210k

     ...level and live longer by using AI to transform continuous...  ...every day. WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence...  ...across WHOOP products. Lead end-to-end AI system initiatives...  ...production deployments with inference optimization, observability,... 
    Senior
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    1 day ago
  • $176.6k - $294.3k

     ...Pfizer Belgium is seeking a skilled AI Engineer in Cambridge, MA, to design and implement production-grade AI systems to support the Clinical Development & Operations organization. The ideal candidate will possess a PhD in Computer Science or related fields, with significant... 

    Pfizer Belgium

    Cambridge, MA
    3 days ago
  •  ...Ernst & Young Oman is seeking a Manager, AI/ML Engineer to lead the development of the memory layer for its agentic AI platform. This hands-on role requires strong expertise in graph databases and AI/ML techniques, focusing on architecting and building scalable solutions... 

    Ernst & Young Oman

    Boston, MA
    3 days ago
  • $314.8k - $359.3k

     ...Capital One is seeking a Sr Director of AI Engineering in Cambridge, MA, to lead innovative projects leveraging AI to enhance banking experiences. This role requires deep technical knowledge in AI systems, collaboration with diverse teams, and a focus on developing AI... 
    Senior

    Comfort Systems USA

    Cambridge, MA
    3 days ago
  • $93.6k - $156k

     ...Pfizer, S.A. de C.V in Cambridge, Massachusetts, is seeking a Senior Scientist in Computational Biotherapeutics Engineering. In this role, you will implement state-of-the-art AI/ML methods to advance biotherapeutic discoveries and collaborate on innovative designs for... 
    Senior

    Pfizer, S.A. de C.V

    Cambridge, MA
    4 days ago
  •  ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years Location: Hybrid - Remote (India-based) with onsite every Thursday in Chennai Industry: AI/ML, Enterprise Applications, Healthcare... 
    Senior
    Work at office
    Remote work

    Saviance

    Boston, MA
    22 hours ago
  • A leading technology company in Boston seeks a Systems Engineer to enhance engineering productivity by designing an AI-first onboarding program. The ideal candidate will have a strong background in software engineering, experience in developer education, and the ability... 

    Klaviyo Inc.

    Boston, MA
    4 days ago
  • A leading AI research company seeks a contractor with software engineering experience to evaluate AI-generated code and collaborate on AI-driven solutions. The ideal candidate has over 5 years in software engineering and strong skills in full-stack application development... 
    Senior
    Contract work
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    Turing

    Boston, MA
    4 days ago
  •  ...A leading financial services company in Cambridge, MA, seeks a Senior Lead AI Engineer to develop innovative AI-powered products. You will work closely with a cross-functional team to design and implement scalable AI solutions, leveraging cutting-edge technologies. Candidates... 
    Senior

    Capital One National Association

    Cambridge, MA
    3 days ago
  •  ...A leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure and reliable AI services that enhance productivity for users. Key responsibilities include designing... 
    Senior

    Franklin Fitch

    Boston, MA
    4 days ago
  • $90k - $157.5k

     ...Who We Are Looking For This is an L3 Support Engineer / Senior Platform Support Specialist position within the Generative AI Team. Our primary objective is to ensure the...  ...platform outages, performance degradation, model inference failures, token/rate‑limiting issues, API... 
    Senior
    Temporary work
    Shift work

    State Street Corporation

    Quincy, MA
    3 days ago
  •  ...A leading technology firm is seeking a Sr. Managed Services Engineer specializing in AI and Copilot solutions. Candidates should have a strong technical background, excellent communication skills, and a customer-focused approach. Responsibilities include managing customer... 
    Senior
    Remote work

    SHI GmbH

    Boston, MA
    2 days ago
  • A leading AI research organization is looking for an entry-level contractor to assist in enhancing AI-generated coding solutions. The ideal candidate will have over 5 years of software engineering experience, particularly in full-stack application development. This role... 
    Senior
    Contract work
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    Turing

    Boston, MA
    4 days ago
  • $200k - $220k

     ...Senior AI Engineer Cambridge, MA - 4 days onsite $200,000 - $220,000 + bonus + equity THE COMPANY Harnham is partnering with a well-funded biotech startup that is developing an AI-driven approach to more personalized cancer monitoring—integrating proprietary... 
    Senior

    Harnham

    Cambridge, MA
    1 day ago
  •  ...Senior AI Engineer Full-time opportunity for a Senior AI Engineer, based in Boston (hybrid). This role offers the chance to build cutting-edge AI systems at a rapidly growing company transforming how organizations access and scale human expertise through advanced AI... 
    Senior
    Full time

    Motion Recruitment

    Boston, MA
    1 day ago
  •  ...Senior AI Engineer| AI-Native Orchestration Platform About NetSpeek NetSpeek is building an AI-native orchestration platform for enterprise...  ...discipline You will work directly with: AI Team Lead for architectural direction EVP Product and Engineering... 
    Senior

    Talent Retriever

    Newton, MA
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference Engineering Lead. Be the first to apply!