Senior AI Inference Engineer for Open-Source LLM Platform
The Red Hat
A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building and releasing system software across various architectures. You will work on cloud infrastructure and enhance AI applications. Ideal candidates have over 5 years of experience in software engineering and strong skills in Python, Docker, and CI/CD practices. Join us to shape the future of AI with innovative open-source solutions. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineer for Open-Source LLM Platform in Boston, MA vacancy
- A leading open-source company is looking for a Senior Performance Engineer in Boston, MA to enhance the performance and scalability of AI workloads. This role involves defining performance metrics, collaborating with teams, and utilizing tools like vLLM and PyTorch. Candidates...Senior
- ...pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves developing model... ...innovative solutions to complex problems in an open-source environment. Excellent communication skills and...Senior
- ...Red Hat is seeking an experienced software engineer in Boston, MA to join the AI Inference team. The role involves developing Python tooling, managing CI/CD pipelines, and orchestrating model validation for LLMs. Candidates should have over 5 years of experience in software...Senior
Red Hat
Boston, MA2 days ago $229.9k - $262.4k
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we... .... Our AI models and platforms empower teams across Capital... ..., large language model inference, similarity search, guardrails... ...a broad stack of Open Source and SaaS AI technologies...PlatformSeniorFull timePart timeLocal area$133.65k - $220.68k
...Red Hat, LLC in Boston is on a quest for a Senior Software Engineer to lead the development of the Red Hat AI Inference Server. This role involves the full lifecycle, from compiling wheels to managing multi-cloud infrastructure and ensuring model accuracy. The ideal candidate...SeniorRed Hat
Boston, MA3 days ago$174.19k - $287.41k
Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine...Senior$229.9k - $262.4k
...Overview Senior Lead AI Engineer (LLM Customization and Finetuning) Overview... .... Our AI models and platforms empower teams across Capital... ...training, large language model inference, similarity search,... ...Leverage a broad stack of Open Source and SaaS AI technologies such...PlatformSeniorFull timePart timeLocal area- ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years... ...custom development, cloud data platforms, AI/ML integrations, and data analytics... ...a deep understanding of LLM frameworks, Python-based AI development...PlatformSeniorWork at officeRemote work
Saviance
Boston, MA4 days ago $150k - $210k
...longer by using AI to transform... ...recommendations. Our AI platform is central to... ...is hiring a Senior AI/ML Engineer to help scale... ...tuning workflows, LLM observability,... ...messy, multi-source data into high-... ...language models (open-weight or API-... ...with inference optimization, observability...PlatformSeniorFull timeWork at officeRelocationWHOOP
Boston, MA5 days ago$133.65k - $220.68k
...believe the future of AI is open and we are on a... ...power of open-source LLMs and vLLM to... .... The Red Hat AI Inference team accelerates... ...provides a stable platform for enterprises to... ...optimize, and scale LLM deployments.... ...seeking an experienced Senior Software Engineer to build and...PlatformSeniorPermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hoursRed Hat
Boston, MA3 days ago- ...A leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure and reliable AI services that enhance productivity for users. Key responsibilities include designing...PlatformSenior
Franklin Fitch
Boston, MA2 days ago $77k - $202k
...through innovative, AI-driven solutions. As a Senior Associate, you... ...model training and inference on cloud platforms like AWS and GCP... ...development or AI/ML engineering What Sets You Apart... ...applications with LLM orchestration... ...Contributing to open-source projects in AI or...PlatformSeniorFull timeH1b$200k - $325k
...We are seeking a Senior Security Engineer with experience in cloud and AI security to help design... ...through automation, secure platform design, and proactive risk... ...environments for open-source software, third-party tools... ...ability to secure AI/ML and LLM-based platforms,...PlatformSeniorLocal areaArrowstreet Capital
Boston, MA1 day ago$74.1k - $147.8k
...innovative ideas, such as AI-enabled insights... ...Description: Senior AI Engineer 1 About Crowe... ..., and lead in a platform-driven economy.... ...model telemetry, and inference performance to... ...evaluating and integrating LLM APIs (OpenAI,... ...service, sourcing entity or any other...PlatformSeniorLocal areaRemote workWorldwideFlexible hoursCrowe
Boston, MA3 days ago$210.73k - $358.07k
A leading enterprise open source software provider in Boston seeks a Senior Engineering Manager to lead the Machine Learning Engineering team. You will focus on vLLM inference, drive the vision for engineering teams, and engage with open-source communities. The ideal candidate...Senior$314.8k - $359.3k
Sr. Distinguished AI Engineer At Capital One, we are creating... .... Our AI models and platforms empower teams across... ...large language model inference, similarity search,... ...Leverage a broad stack of Open Source and SaaS AI... ...introduce state‑of‑the‑art LLM optimization techniques...PlatformSeniorFull timePart timeLocal area- ...the leader in secure AI software development,... ...native Developer Security Platform integrates seamlessly... ...we’re looking for a Senior AI Engineer for our Web team, who... ...release optimizations for LLM discoverability.Work... ...resources* Contribute to open-source projects or web...PlatformSeniorWork at officeWork from homeFlexible hoursShift work
- ...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA / New York... ...agents. Evaluate new agentic AI, LLM, and orchestration technologies and recommend... ..., compliance). Contributions to open-source AI frameworks (LangChain, OpenAI MCP,...PlatformSeniorCasual workFlexible hours
Blue Prism Group
Boston, MA12 hours ago $286.2k - $326.7k
Sr Director, AI Engineering Overview At Capital One, we... ...customers. Our AI models and platforms empower teams across... ...large language model inference, similarity search,... ...a broad stack of Open Source and SaaS AI technologies... ...state‑of‑the‑art LLM optimization techniques...PlatformSeniorFull timePart timeLocal area$144k - $270k
...LILA We are seeking a Senior Software Engineer to join our Applied AI group and help... ...-driven scientific platform. In this role, you... ...large language model (LLM) integration. This... ...latency AI retrieval and inference workloads. Cloud &... ...resumes from any source other than...PlatformSeniorFull timeWork at officeLocal areaFlexible hoursDormont Manufacturing Company
Cambridge, MA2 days ago$105.8k - $174.8k
...– Data and Decision Science – AI Native Engineering Physical AI Engineering Consultant, Senior Consultant The opportunity... ...insights from varied data sources across a broad technology landscape... ...with MLOps methods and platforms such as MLFlow. Experience...PlatformSeniorFull timeWork experience placementSummer holidayFlexible hoursEY
Boston, MA18 hours ago$210.73k - $358.07k
...believe the future of AI is open and we are on a... ...power of open‑source LLMs and vLLM to... ...enterprise. RedHat Inference engineering team accelerates... ...of the vLLM and LLM‑D projects, and inventors... ...a stable platform for enterprises to... ...deployments. As a Senior Engineering...PlatformSeniorContract workWork experience placementRemote workFlexible hours- ...A leading software solutions provider in Boston is seeking a Principal Machine Learning Engineer to work on model optimization algorithms. In this role, you will collaborate with product and research teams to develop state-of-the-art deep learning software. You should...
Red Hat
Boston, MA2 days ago $105.8k - $174.8k
...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of... ...and derive insights from varied data sources across a broad technology landscape.... .... Experience with MLOps methods and platforms such as MLFlow. Experience with CI/CD...PlatformSeniorFull timeWork experience placementSummer holidayFlexible hours$106.9k - $176.5k
...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of... ...and derive insights from varied data sources across a broad technology landscape.... ...production AI/ML solutions on a major cloud platform. Proficient in Generative AI models...PlatformSeniorFull timeWork experience placementSummer holidayFlexible hoursErnst & Young Oman
Boston, MA2 days ago$210.73k - $358.07k
...believe the future of AI is open and we are on a... ...power of open-source LLMs and vLLM to... ...enterprise. Red Hat Inference engineering team accelerates... ...of the vLLM and LLM-D projects, and inventors... ...a stable platform for enterprises to... .... As a Senior Engineering Manager...PlatformSeniorPermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours$200k - $220k
...Senior AI Engineer Cambridge, MA - 4 days onsite $200,000 - $220,000 + bonus + equity... ...training, and model serving on cloud platforms (e.g., AWS, GCP). Data Engineering... ...genomics, pathology, EHRs) Publications or open-source contributions in relevant fields Startup...PlatformSeniorHarnham
Cambridge, MA18 hours ago- ...Full-time opportunity for a Senior AI Engineer based in Boston, MA. Join a... ...powering the company's core platform. You'll help design and deploy... ...that automate expert sourcing, qualification, interviewing... ...Breakdown • 50% AI, LLM & Agentic Systems Development...PlatformSeniorFull time
Motion Recruitment
Cambridge, MA3 days ago $178.3k - $407k
...working world. AI and Data – Data Scientist – Senior Manager EY delivers... ...big data and cloud engineering. We always support... ...the build of core platform components... ...equivalent agent / LLM framework). ~ Practical... ...Published research or open-source contributions in AI...PlatformSeniorSummer holidayFlexible hoursEY
Boston, MA18 hours ago$269.1k - $307.2k
...Distinguished AI Engineer Overview: At Capital... ...customers. Our AI models and platforms empower teams across... ...large language model inference, similarity search,... ...Leverage a broad stack of Open Source and SaaS AI... ...introduce state-of-the-art LLM optimization techniques...PlatformFull timePart timeLocal areaCapital One Financial Corp
Cambridge, MA18 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineer for Open-Source LLM Platform. Be the first to apply!
Related searches
- senior ai engineer Boston, MA
- ai ml engineer Boston, MA
- ai engineer remote Boston, MA
- ai engineer Boston, MA
- ai prompt engineer Boston, MA
- ai developer Boston, MA
- machine learning ai engineer Boston, MA
- senior cost analyst Boston, MA
- senior development engineer Boston, MA
- senior program specialist Boston, MA