Senior AI Inference Engineering Lead
$210.73k - $358.07kThe Red Hat
A leading enterprise open source software provider in Boston seeks a Senior Engineering Manager to lead the Machine Learning Engineering team. You will focus on vLLM inference, drive the vision for engineering teams, and engage with open-source communities. The ideal candidate has over 10 years of software development experience, including 5 years in management, with a strong background in machine learning. Competitive salary range between $210,730.00 and $358,070.00 based on qualifications. #J-18808-Ljbffr Red Hat
- ...A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building and releasing system software across various architectures. You will work on cloud infrastructure and enhance...Senior
$133.65k - $220.68k
...Red Hat, LLC in Boston is on a quest for a Senior Software Engineer to lead the development of the Red Hat AI Inference Server. This role involves the full lifecycle, from compiling wheels to managing multi-cloud infrastructure and ensuring model accuracy. The ideal candidate...Senior- ...A leading open-source company is looking for a Senior Performance Engineer in Boston, MA to enhance the performance and scalability of AI workloads. This role involves defining performance metrics, collaborating with teams, and utilizing tools like vLLM and PyTorch. Candidates...Senior
- ...Pfizer Belgium in Cambridge is looking for an AI & Data Engineer to build AI-enabled solutions for Oncology R&D workflows. The role requires significant experience in data pipelines, analytics, and machine learning to improve operations and decision-making. The ideal...Senior
$119.6k - $215.4k
...delivery of cutting-edge AI infrastructure? Join the Akamai Inference Cloud Team! The Akamai... ...with the best As a Senior Technical Program Manager... ..., and proven experience leading large-scale technical programs... ..., cloud infrastructure engineering or AI/ML or its...SeniorPermanent employmentWork experience placementWork at officeWork from homeWorldwideFlexible hoursShift work$119.6k - $215.4k
Senior Technical Program Manager (Akamai Inference Cloud) United States (Remote) Job Description Do... ...of cutting‑edge AI infrastructure? Join the... ..., and proven experience leading large‑scale technical programs... ...management, cloud infrastructure engineering or AI/ML or its...SeniorWork experience placementRemote workWorldwideShift work- ...A leading software solutions provider seeks a Forward Deployed Engineer to manage and optimize Large Language Model (LLM) inference systems for client environments. The ideal candidate will have over... ...particularly with Kubernetes and AI inference techniques. Responsibilities...
$180k - $250k
...Senior AI Engineer (LLMs / Agents) Boston, Massachusetts (Hybrid / Remote) $180,000 - $250,000 + Equity + Healthcare + PTO Are... ...harnesses to track model and agent performance *Optimize inference for latency and throughput using vLLM or TensorRT-LLM *Deploy...SeniorRemote work- ...Senior Software Engineer - AI & Data Engineering Location: Boston, MA (Onsite every Thursday)... ...life sciences domains. We partner with leading organizations to deliver cutting-edge... ...tasks in story points, factoring in LLM inference latency and API rate limits....Senior
$133.65k - $220.68k
...Hat, we believe the future of AI is open and we are on a... ...enterprise. The Red Hat AI Inference team accelerates AI for the... ...simplicity to GenAI deployments. As leading developers and maintainers... ...are seeking an experienced Senior Software Engineer to build and release the Red...SeniorPermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours$158k - $197.5k
...Job Description WilmerHale is a leading, full-service international law firm... ...practice. About the Role The Senior AI Defense Engineer is a technical leader responsible for... ...poisoning, model inversion and membership inference, overreliance/automation bias, and...SeniorWork experience placementShift work$96.8k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical... ...platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI... ...into durable technical strategy, lead multi-team execution without...SeniorTemporary workFlexible hours$200k - $325k
...Job Description We are building an AI Engineering function to enable productivity and agentic... ..., developers, and business teams. As a Senior AI Platform Engineer, you will design and... ...that powers AI systems firm‑wide: inference services, agentic platforms, developer...SeniorWork at officeLocal area$144k - $270k
...Your Impact at LILA We are seeking a Senior Software Engineer to join our Applied AI group and help build the next generation of our AI-driven scientific... ...vector databases to support low-latency AI retrieval and inference workloads. Cloud & Infrastructure: Leverage AWS,...SeniorFull timeWork at officeLocal areaFlexible hours$150k - $210k
...level and live longer by using AI to transform continuous... ...every day. WHOOP is hiring a Senior AI/ML Engineer to help scale the intelligence... ...across WHOOP products. Lead end-to-end AI system initiatives... ...production deployments with inference optimization, observability,...SeniorFull timeWork at officeRelocation$176.6k - $294.3k
...Pfizer Belgium is seeking a skilled AI Engineer in Cambridge, MA, to design and implement production-grade AI systems to support the Clinical Development & Operations organization. The ideal candidate will possess a PhD in Computer Science or related fields, with significant...- ...Ernst & Young Oman is seeking a Manager, AI/ML Engineer to lead the development of the memory layer for its agentic AI platform. This hands-on role requires strong expertise in graph databases and AI/ML techniques, focusing on architecting and building scalable solutions...
$314.8k - $359.3k
...Capital One is seeking a Sr Director of AI Engineering in Cambridge, MA, to lead innovative projects leveraging AI to enhance banking experiences. This role requires deep technical knowledge in AI systems, collaboration with diverse teams, and a focus on developing AI...Senior$93.6k - $156k
...Pfizer, S.A. de C.V in Cambridge, Massachusetts, is seeking a Senior Scientist in Computational Biotherapeutics Engineering. In this role, you will implement state-of-the-art AI/ML methods to advance biotherapeutic discoveries and collaborate on innovative designs for...Senior- ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years Location: Hybrid - Remote (India-based) with onsite every Thursday in Chennai Industry: AI/ML, Enterprise Applications, Healthcare...SeniorWork at officeRemote work
- A leading technology company in Boston seeks a Systems Engineer to enhance engineering productivity by designing an AI-first onboarding program. The ideal candidate will have a strong background in software engineering, experience in developer education, and the ability...
- A leading AI research company seeks a contractor with software engineering experience to evaluate AI-generated code and collaborate on AI-driven solutions. The ideal candidate has over 5 years in software engineering and strong skills in full-stack application development...SeniorContract workFor contractorsRemote work10 hours per weekFlexible hours
- ...A leading financial services company in Cambridge, MA, seeks a Senior Lead AI Engineer to develop innovative AI-powered products. You will work closely with a cross-functional team to design and implement scalable AI solutions, leveraging cutting-edge technologies. Candidates...Senior
- ...A leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure and reliable AI services that enhance productivity for users. Key responsibilities include designing...Senior
$90k - $157.5k
...Who We Are Looking For This is an L3 Support Engineer / Senior Platform Support Specialist position within the Generative AI Team. Our primary objective is to ensure the... ...platform outages, performance degradation, model inference failures, token/rate‑limiting issues, API...SeniorTemporary workShift work- ...A leading technology firm is seeking a Sr. Managed Services Engineer specializing in AI and Copilot solutions. Candidates should have a strong technical background, excellent communication skills, and a customer-focused approach. Responsibilities include managing customer...SeniorRemote work
- A leading AI research organization is looking for an entry-level contractor to assist in enhancing AI-generated coding solutions. The ideal candidate will have over 5 years of software engineering experience, particularly in full-stack application development. This role...SeniorContract workFor contractorsRemote work10 hours per weekFlexible hours
$200k - $220k
...Senior AI Engineer Cambridge, MA - 4 days onsite $200,000 - $220,000 + bonus + equity THE COMPANY Harnham is partnering with a well-funded biotech startup that is developing an AI-driven approach to more personalized cancer monitoring—integrating proprietary...Senior- ...Senior AI Engineer Full-time opportunity for a Senior AI Engineer, based in Boston (hybrid). This role offers the chance to build cutting-edge AI systems at a rapidly growing company transforming how organizations access and scale human expertise through advanced AI...SeniorFull time
- ...Senior AI Engineer| AI-Native Orchestration Platform About NetSpeek NetSpeek is building an AI-native orchestration platform for enterprise... ...discipline You will work directly with: AI Team Lead for architectural direction EVP Product and Engineering...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineering Lead. Be the first to apply!
- ai engineer remote Boston, MA
- ai prompt engineer Boston, MA
- senior ai engineer Boston, MA
- machine learning ai engineer Boston, MA
- ai engineer Boston, MA
- ai developer Boston, MA
- ai ml engineer Boston, MA
- senior office manager Boston, MA
- senior automation controls engineer Boston, MA
- senior accounts payable Boston, MA


