Senior AI Inference Engineer for Open-Source LLM Platform
Red Hat, Inc.
A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building and releasing system software across various architectures. You will work on cloud infrastructure and enhance AI applications. Ideal candidates have over 5 years of experience in software engineering and strong skills in Python, Docker, and CI/CD practices. Join us to shape the future of AI with innovative open-source solutions. #J-18808-Ljbffr Red Hat, Inc.
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineer for Open-Source LLM Platform in Boston, MA vacancy
- A leading open-source company is looking for a Senior Performance Engineer in Boston, MA to enhance the performance and scalability of AI workloads. This role involves defining performance metrics, collaborating with teams, and utilizing tools like vLLM and PyTorch. Candidates...Senior
- ...pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves developing model... ...innovative solutions to complex problems in an open-source environment. Excellent communication skills and...Senior
$133.65k - $220.68k
Red Hat, LLC in Boston is on a quest for a Senior Software Engineer to lead the development of the Red Hat AI Inference Server. This role involves the full lifecycle, from compiling wheels to managing multi-cloud infrastructure and ensuring model accuracy. The ideal candidate...Senior$174.19k - $287.41k
Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine...Senior$229.9k - $262.4k
...Overview Senior Lead AI Engineer (LLM Customization and Finetuning) Overview... .... Our AI models and platforms empower teams across Capital... ...training, large language model inference, similarity search,... ...Leverage a broad stack of Open Source and SaaS AI technologies such...PlatformSeniorFull timePart timeLocal area$225.4k - $257.2k
...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview:... ...customers. Our AI models and platforms empower teams across... ...training, large language model inference, similarity search,... ...a broad stack of Open Source and SaaS AI technologies...PlatformSeniorFull timePart timeLocal area- ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years... ...custom development, cloud data platforms, AI/ML integrations, and data analytics... ...a deep understanding of LLM frameworks, Python-based AI development...PlatformSeniorWork at officeRemote work
Saviance
Boston, MA2 days ago - ...Cambridge, MA, is seeking a Senior Member of Technical Staff to... ...their autonomous development platform. This role involves... ...and building production-grade open-source projects, providing feedback... ...product roadmap, and evaluating engineering candidates. The ideal candidate...PlatformSenior
- ...Inc. in Cambridge, MA is looking for a Senior Member of Technical Staff to push the limits... ...selecting and building production-grade open source projects, conducting technical... ...directly influence product decisions based on platform performance and capabilities. The ideal...PlatformSenior
$150k - $210k
...longer by using AI to transform... ...recommendations. Our AI platform is central to... ...is hiring a Senior AI/ML Engineer to help scale... ...tuning workflows, LLM observability,... ...messy, multi-source data into high-... ...language models (open-weight or API-... ...with inference optimization, observability...PlatformSeniorFull timeWork at officeRelocation$133.65k - $220.68k
...believe the future of AI is open and we are on a... ...power of open-source LLMs and vLLM to... .... The Red Hat AI Inference team accelerates... ...provides a stable platform for enterprises to... ...optimize, and scale LLM deployments.... ...seeking an experienced Senior Software Engineer to build and...PlatformSeniorPermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hoursRed Hat
Boston, MA8 days ago- A leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure and reliable AI services that enhance productivity for users. Key responsibilities include designing...PlatformSenior
$229.9k - $262.4k
Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services) Overview: At Capital One, we are creating... ...large language model inference, similarity search,... ...a broad stack of Open Source and SaaS AI technologies... ...introduce state-of-the-art LLM optimization...PlatformSeniorFull timePart timeLocal area$200k - $325k
...We are seeking a Senior Security Engineer with experience in cloud and AI security to help design... ...through automation, secure platform design, and proactive risk... ...environments for open-source software, third-party tools... ...ability to secure AI/ML and LLM-based platforms,...PlatformSeniorLocal areaArrowstreet Capital
Boston, MA4 days ago$210.73k - $358.07k
A leading enterprise open source software provider in Boston seeks a Senior Engineering Manager to lead the Machine Learning Engineering team. You will focus on vLLM inference, drive the vision for engineering teams, and engage with open-source communities. The ideal candidate...Senior- ...the leader in secure AI software development,... ...native Developer Security Platform integrates seamlessly... ...we’re looking for a Senior AI Engineer for our Web team, who... ...release optimizations for LLM discoverability.Work... ...resources* Contribute to open-source projects or web...PlatformSeniorWork at officeWork from homeFlexible hoursShift work
- ...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA / New York... ...agents. Evaluate new agentic AI, LLM, and orchestration technologies and recommend... ..., compliance). Contributions to open-source AI frameworks (LangChain, OpenAI MCP,...PlatformSeniorCasual workFlexible hours
Blue Prism Group
Boston, MA3 days ago $286.2k - $326.7k
Sr Director, AI Engineering Overview At Capital One, we... ...customers. Our AI models and platforms empower teams across... ...large language model inference, similarity search,... ...a broad stack of Open Source and SaaS AI technologies... ...state‑of‑the‑art LLM optimization techniques...PlatformSeniorFull timePart timeLocal area$105.8k - $174.8k
...– Data and Decision Science – AI Native Engineering Physical AI Engineering Consultant, Senior Consultant The opportunity... ...insights from varied data sources across a broad technology landscape... ...with MLOps methods and platforms such as MLFlow. Experience...PlatformSeniorFull timeWork experience placementSummer holidayFlexible hoursEY
Boston, MA3 days ago$144k - $270k
...LILA We are seeking a Senior Software Engineer to join our Applied AI group and help... ...-driven scientific platform. In this role, you... ...large language model (LLM) integration. This... ...latency AI retrieval and inference workloads. Cloud &... ...resumes from any source other than...PlatformSeniorFull timeWork at officeLocal areaFlexible hours$210.73k - $358.07k
...believe the future of AI is open and we are on a... ...power of open‑source LLMs and vLLM to... ...enterprise. RedHat Inference engineering team accelerates... ...of the vLLM and LLM‑D projects, and inventors... ...a stable platform for enterprises to... ...deployments. As a Senior Engineering...PlatformSeniorContract workWork experience placementRemote workFlexible hours$105.8k - $174.8k
...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of... ...and derive insights from varied data sources across a broad technology landscape.... .... Experience with MLOps methods and platforms such as MLFlow. Experience with CI/CD...PlatformSeniorFull timeWork experience placementSummer holidayFlexible hours- ...looking for a passionate Open Source Developer who is... ...technologies such as LLMs, AI tooling, and scalable backend... ...ideal for early-career engineers who love experimenting,... .../ML stacks, including LLM integrations... ..., Kubernetes, or cloud platforms Experience working with...Platform
Stealth Startup
Boston, MA17 hours ago $210.73k - $358.07k
...believe the future of AI is open and we are on a... ...power of open-source LLMs and vLLM to... ...enterprise. Red Hat Inference engineering team accelerates... ...of the vLLM and LLM‑D projects, and inventors... ...a stable platform for enterprises to... .... As a Senior Engineering Manager...PlatformSeniorPermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours$200k - $220k
...Senior AI Engineer Cambridge, MA - 4 days onsite $200,000 - $220,000 + bonus + equity... ...training, and model serving on cloud platforms (e.g., AWS, GCP). Data Engineering... ...genomics, pathology, EHRs) Publications or open-source contributions in relevant fields Startup...PlatformSeniorHarnham
Cambridge, MA3 days ago- ...Full-time opportunity for a Senior AI Engineer based in Boston, MA. Join a... ...powering the company's core platform. You'll help design and deploy... ...that automate expert sourcing, qualification, interviewing... ...Breakdown • 50% AI, LLM & Agentic Systems Development...PlatformSeniorFull time
Motion Recruitment
Cambridge, MA1 day ago - A leading software solutions provider in Boston is seeking a Principal Machine Learning Engineer to work on model optimization algorithms. In this role, you will collaborate with product and research teams to develop state-of-the-art deep learning software. You should...
$106.9k - $176.5k
...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of... ...and derive insights from varied data sources across a broad technology landscape.... ...production AI/ML solutions on a major cloud platform. Proficient in Generative AI models...PlatformSeniorFull timeWork experience placementSummer holidayFlexible hours- Red Hat is looking for a Senior Performance Engineer in Boston to join the Performance and Scale Engineering... ...performance and scalability for AI workloads, particularly with Large... ...leave. Join Red Hat to innovate in the open-source community. #J-18808-Ljbffr Red HatPlatformSenior
$87.52k - $140.77k
Job Description Role: Senior Software Engineer ( Gen AI) Location : Coppell, TX... ...Develop and optimize AI inference systems for large language... ...Familiarity with cloud platforms (AWS, GCP, or Azure) and... ...~ Contributions to open-source projects in the AI space...PlatformSeniorLocal areaRemote workRelocationFlexible hoursBlue Yonder
Boston, MA17 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineer for Open-Source LLM Platform. Be the first to apply!
Related searches
- senior ai engineer Boston, MA
- ai ml engineer Boston, MA
- ai engineer remote Boston, MA
- ai engineer Boston, MA
- ai prompt engineer Boston, MA
- ai developer Boston, MA
- machine learning ai engineer Boston, MA
- senior cost analyst Boston, MA
- senior development engineer Boston, MA
- senior program specialist Boston, MA