Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference Engineering Lead

$210.73k - $358.07k

The Red Hat

A leading enterprise open source software provider in Boston seeks a Senior Engineering Manager to lead the Machine Learning Engineering team. You will focus on vLLM inference, drive the vision for engineering teams, and engage with open-source communities. The ideal candidate has over 10 years of software development experience, including 5 years in management, with a strong background in machine learning. Competitive salary range between $210,730.00 and $358,070.00 based on qualifications. #J-18808-Ljbffr Red Hat

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineering Lead in Boston, MA vacancy
  • A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building and releasing system software across various architectures. You will work on cloud infrastructure and enhance... 
    Senior

    Red Hat, Inc.

    Boston, MA
    3 days ago
  • A leading open-source company is looking for a Senior Performance Engineer in Boston, MA to enhance the performance and scalability of AI workloads. This role involves defining performance metrics, collaborating with teams, and utilizing tools like vLLM and PyTorch. Candidates... 
    Senior

    Red Hat, Inc.

    Boston, MA
    4 days ago
  • Pfizer Belgium in Cambridge is looking for an AI & Data Engineer to build AI-enabled solutions for Oncology R&D workflows. The role requires significant experience in data pipelines, analytics, and machine learning to improve operations and decision-making. The ideal candidate... 
    Senior

    Pfizer Belgium

    Cambridge, MA
    3 days ago
  • $132.5k - $366.3k

     ...thinking services company at the forefront of AI-native innovation. We partner with...  ...next-generation, agent-powered workflows engineered to scale in real-world settings. Our engineers...  ..., including being capable of leading technical workshops and delivering under... 
    Senior
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    6 days ago
  • A leading software solutions provider seeks a Forward Deployed Engineer to manage and optimize Large Language Model (LLM) inference systems for client environments. The ideal candidate will have over...  ...particularly with Kubernetes and AI inference techniques. Responsibilities... 
    Suggested

    Red Hat, Inc.

    Boston, MA
    1 day ago
  •  ...Senior Software Engineer - AI & Data Engineering Location: Boston, MA (Onsite every Thursday)...  ...life sciences domains. We partner with leading organizations to deliver cutting-edge...  ...tasks in story points, factoring in LLM inference latency and API rate limits.... 
    Senior

    Saviance

    Boston, MA
    4 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are creating responsible and reliable AI systems, changing...  ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation,... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    14 days ago
  •  ...Akamai Technologies GmbH is seeking a Senior II Software Engineer Lead to drive innovation in AI systems within the Akamai Inference Cloud Team. This role involves leading the design and implementation of platform components, driving key technical decisions, and mentoring... 
    Senior
    Remote work
    Flexible hours

    Akamai

    Cambridge, MA
    5 hours ago
  • $133.65k - $220.68k

     ...Hat, we believe the future of AI is open and we are on a...  ...enterprise. The Red Hat AI Inference team accelerates AI for the...  ...simplicity to GenAI deployments. As leading developers and maintainers...  ...are seeking an experienced Senior Software Engineer to build and release the Red... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    6 days ago
  • $158k - $197.5k

     ...Job Description WilmerHale is a leading, full-service international law firm...  ...practice. About the Role The Senior AI Defense Engineer is a technical leader responsible for...  ...poisoning, model inversion and membership inference, overreliance/automation bias, and... 
    Senior
    Full time
    Work experience placement
    Shift work

    Wilmerhale

    Boston, MA
    1 day ago
  • $96.8k - $251.6k

     ...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical...  ...platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI...  ...into durable technical strategy, lead multi-team execution without... 
    Senior
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    2 days ago
  •  ...inspires extraordinary results.  Emburse AI Engineer   As a Senior AI Engineer at Emburse, you will...  ...of artificial intelligence inference applications and products using a variety...  ...trainings ● Able to serve as a project lead where you will lead and mentor others... 
    Senior
    Full time
    Local area
    Flexible hours

    Emburse

    Boston, MA
    5 hours ago
  • $200k - $325k

     ...Job Description We are building an AI Engineering function to enable productivity and...  ...developers, and business teams. As a Senior AI Platform Engineer, you will design and...  ...platform that powers AI systems firm-wide: inference services, agentic platforms, developer... 
    Senior
    Work at office
    Local area

    Arrowstreet Capital

    Boston, MA
    4 days ago
  • $150k - $210k

     ...Senior AI/ML Engineer (AI Platform) At WHOOP, we're on a mission to unlock human performance and...  ...across WHOOP products. Lead end-to-end AI system initiatives spanning...  ...evaluation sets to production deployments with inference optimization, observability, and... 
    Senior
    Full time
    Work at office
    Relocation

    Venturefizz Product Management Community

    Boston, MA
    1 day ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems,...  ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    4 days ago
  • $225.4k - $257.2k

     ...Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems...  ...including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    Cambridge, MA
    5 hours ago
  • $77k - $202k

     ...and experiences you need to lead and deliver value at this...  ...through innovative, AI-driven solutions. As a Senior Associate, you will analyze...  ...pipelines for model training and inference on cloud platforms like...  ...software development or AI/ML engineering What Sets You Apart... 
    Senior
    Full time
    H1b

    PwC

    Boston, MA
    3 days ago
  • $148k - $222k

     ...conversion data. We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our...  ...experiences, strategies, and campaigns for any business. As a Sr. AI Engineer at Klaviyo, you'll play a key role in designing and building... 
    Senior

    Klaviyo

    Boston, MA
    6 days ago
  • $112k - $168k

     ...Intelligence, and Automations) team is building the AI systems that transform how our employees work. We are looking for a Senior AI Engineer to design, build, and scale production-...  .... Evaluate and fine-tune AI models: Lead benchmarking, evaluation, and fine-tuning... 
    Senior

    Klaviyo

    Boston, MA
    5 days ago
  •  ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years Location: Hybrid - Remote (India-based) with onsite every Thursday in Chennai Industry: AI/ML, Enterprise Applications, Healthcare... 
    Senior
    Work at office
    Remote work

    Saviance

    Boston, MA
    5 days ago
  • A leading AI research company seeks a contractor with software engineering experience to evaluate AI-generated code and collaborate on AI-driven solutions. The ideal candidate has over 5 years in software engineering and strong skills in full-stack application development... 
    Senior
    Contract work
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    Turing

    Boston, MA
    4 days ago
  • A leading technology firm is seeking a Sr. Managed Services Engineer specializing in AI and Copilot solutions. Candidates should have a strong technical background, excellent communication skills, and a customer-focused approach. Responsibilities include managing customer... 
    Senior
    Remote work

    SHI GmbH

    Boston, MA
    2 days ago
  • A leading AI research organization is looking for an entry-level contractor to assist in enhancing AI-generated coding solutions. The ideal candidate will have over 5 years of software engineering experience, particularly in full-stack application development. This role... 
    Senior
    Contract work
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    Turing

    Boston, MA
    4 days ago
  • $90k - $157.5k

     ...Are Looking For This is an L3 Support Engineer / Senior Platform Support Specialist position within the Generative AI Team . Our primary objective is to ensure the...  ...outages, performance degradation, model inference failures, token/rate-limiting issues, API errors... 
    Senior
    Temporary work
    Flexible hours
    Shift work

    State Street Corporation

    Quincy, MA
    1 day ago
  • $150k - $240k

     ...Senior AI Engineer | Boston, MA (Hybrid) | $150-$240k with Equity We are partnering with a high-growth, venture-backed AI company that...  ...how organisations access and apply expert insight. Backed by leading investors and experiencing strong early traction, the business... 
    Senior

    Franklin Fitch

    Boston, MA
    2 days ago
  • $176.6k - $294.3k

    Pfizer Belgium is seeking a skilled AI Engineer in Cambridge, MA, to design and implement production-grade AI systems to support the Clinical Development & Operations organization. The ideal candidate will possess a PhD in Computer Science or related fields, with significant... 

    Pfizer Belgium

    Cambridge, MA
    4 days ago
  • A leading technology company in Boston seeks a Systems Engineer to enhance engineering productivity by designing an AI-first onboarding program. The ideal candidate will have a strong background in software engineering, experience in developer education, and the ability... 

    Klaviyo Inc.

    Boston, MA
    4 days ago
  •  ...Senior AI Engineer| AI-Native Orchestration Platform About NetSpeek NetSpeek is building an AI-native orchestration platform for enterprise...  ...discipline You will work directly with: AI Team Lead for architectural direction EVP Product and Engineering... 
    Senior

    Talent Retriever

    Newton, MA
    5 days ago
  •  ...Our AI Engineering Team builds custom web applications with leading LLMs, largely in secure Amazon Bedrock environments. Our aim is to streamline business processes and deliver constituent value by implementing AI solutions responsibly. Data security and human-centered... 
    Senior
    Contract work

    3B Staffing LLC

    Dorchester, MA
    5 days ago
  • $163k - $246.5k

     ...AI Engineer As an AI engineer, you'll apply LLM technologies throughout our stack to enhance Semgrep's security vulnerability detection, prioritization and remediation capabilities. You will work directly with customers to understand their pain points, own the end-to... 
    Senior
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep, Inc

    Boston, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference Engineering Lead. Be the first to apply!