Senior AI Inference Engineer for Open-Source LLM Platform
Red Hat, Inc.
A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building and releasing system software across various architectures. You will work on cloud infrastructure and enhance AI applications. Ideal candidates have over 5 years of experience in software engineering and strong skills in Python, Docker, and CI/CD practices. Join us to shape the future of AI with innovative open-source solutions. #J-18808-Ljbffr Red Hat, Inc.
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineer for Open-Source LLM Platform in Boston, MA vacancy
$229.9k - $262.4k
...Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and... ...of customers. Our AI models and platforms empower teams across Capital One... ...etc. Leverage a broad stack of Open Source and SaaS AI technologies such as...PlatformSeniorFull timePart timeLocal areaCapital One
Cambridge, MA1 day ago$229.9k - $262.4k
Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable... ...of customers. Our AI models and platforms empower teams across Capital One... ...etc. Leverage a broad stack of Open Source and SaaS AI technologies such as...PlatformSeniorFull timePart timeLocal area$133.65k - $220.68k
Red Hat, LLC in Boston is on a quest for a Senior Software Engineer to lead the development of the Red Hat AI Inference Server. This role involves the full lifecycle, from compiling wheels to managing multi-cloud infrastructure and ensuring model accuracy. The ideal candidate...Senior$229.9k - $262.4k
...Overview Senior Lead AI Engineer (LLM Customization and Finetuning) Overview... .... Our AI models and platforms empower teams across Capital... ...training, large language model inference, similarity search,... ...Leverage a broad stack of Open Source and SaaS AI technologies such...PlatformSeniorFull timePart timeLocal area$225.4k - $257.2k
...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview:... ...customers. Our AI models and platforms empower teams across... ...training, large language model inference, similarity search,... ...a broad stack of Open Source and SaaS AI technologies...PlatformSeniorFull timePart timeLocal area$229.9k - $262.4k
...responsible and reliable AI systems, changing... ...science and engineering teams to deliver our... ...Our AI models and platforms empower teams... ...large language model inference, similarity search... ...a broad stack of open‑source and SaaS AI technologies... ...state‑of‑the‑art LLM optimization...PlatformSeniorLocal areaCapital One
Cambridge, MA1 day ago- Blitzy in Cambridge, MA is seeking a Senior Member of Technical Staff to lead... ...evaluation and development of their AI software platform. This role involves selecting open source projects to test platform limits, assessing engineering candidates and contributing directly...PlatformSenior
$150k - $210k
...longer by using AI to transform... ...recommendations. Our AI platform is central to... ...is hiring a Senior AI/ML Engineer to help scale... ...tuning workflows, LLM observability,... ...messy, multi-source data into high-... ...language models (open-weight or API-... ...with inference optimization, observability...PlatformSeniorFull timeWork at officeRelocation$133.65k - $220.68k
...believe the future of AI is open and we are on a... ...power of open‑source LLMs and vLLM to... .... The Red Hat AI Inference team accelerates... ...provides a stable platform for enterprises to... ...optimize, and scale LLM deployments. We... ...an experienced Senior Software Engineer to build and release...PlatformSeniorContract workWork experience placementRemote workFlexible hours- A leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure and reliable AI services that enhance productivity for users. Key responsibilities include designing...PlatformSenior
- ...next generation of AI-driven analytics —... ...team of AI engineers within Teradata's... ...role reports to the Senior Manager of AI Engineering... ..., the Agent Platform team, and Product... ...What you will bring Open‑source contributions to agent... ...frameworks or LLM tooling — we value...PlatformSeniorPermanent employmentFlexible hours
$210.73k - $358.07k
...believe the future of AI is open and we are on a... ...power of open-source LLMs and vLLM to... ...enterprise. Red Hat Inference engineering team accelerates... ...of the vLLM and LLM‑D projects, and inventors... ...a stable platform for enterprises to... .... As a Senior Engineering Manager...PlatformSeniorPermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hoursRed Hat
Boston, MA3 days ago$105.8k - $174.8k
...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of... ...and derive insights from varied data sources across a broad technology landscape.... .... Experience with MLOps methods and platforms such as MLFlow. Experience with CI/CD...PlatformSeniorFull timeWork experience placementSummer holidayFlexible hours$141.3k - $185.4k
...AI Engineer | Data Science & AI Engineering Full-Time... ...generative and agentic AI, and LLM-based techniques to... ...classical ML, causal inference, optimization, and... ...cloud-native data platforms, vector databases, and... ...published work, significant open-source contributions, or a...PlatformFull timeWork at office3 days per weekMassachusetts Mutual Life Insurance Company
Boston, MA2 days ago- Techaxis, Inc is looking for a Senior Full Stack AI Engineer in Boston, MA to enhance its enterprise AI platform and develop AI capabilities. You will be responsible for implementing sophisticated AI solutions, working closely with Portfolio Managers and Research Analysts...PlatformSenior
$87.97k - $188.95k
...Advisory. KPMG is currently seeking a Senior Associate, AI Engineer to join our Advisory Services... ...Responsibilities: Develop GenAI / LLM applications and integrations using foundational... ..., collaboration tools) using cloud platforms Document processes, code, and...PlatformSeniorFull timeH1bLocal areaKPMG
Boston, MA9 days ago$150k - $210k
WHOOP is seeking a Senior AI/ML Engineer to help scale the intelligence behind our AI-powered experiences. This role involves designing and operating production AI systems, partnering closely with product and data science teams. The ideal candidate has 3+ years of applied...PlatformSenior$155k - $235k
...reflects an approved, open position within the... ...the Team The Data Platform team sits within... ...to the semantic and AI layers that sit on... ...work for everyone — engineers, analysts, and business... ...’re looking for a Senior AI Data Engineer to... ...infrastructure or LLM‑powered...PlatformSeniorLocal areaHome officeFlexible hoursScribd
Boston, MA1 day ago$135.2k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands... ...production-grade agentic AI platforms, autonomous workflows, scalable inference infrastructure, and enterprise... ...~ Deep understanding of LLM application patterns, including...PlatformSeniorTemporary workFlexible hoursOracle
Boston, MA5 days ago$180k - $200k
...that matter. With open source Drupal at its... ...Digital Experience Platform (DXP) enables marketers... ...The Role As an AI Staff Engineer within R&D, you... ...— benchmarking LLM providers, orchestration... ...and inference cost management.... ...suite stakeholders. Senior IC track record —...PlatformRemote jobLocal area$65 - $75 per hour
GeoLogics in Dedham, MA is seeking an Android Open Source Embedded Software Engineer for a W2 hourly contract. Candidates must be US citizens and hold a Bachelor's degree in Software Engineering or related field along with 5+ years of relevant experience. The role requires...SeniorHourly payContract work$148k - $240k
...scientific superintelligence platform and autonomous lab for life,... ...building the capabilities to apply AI to every aspect of the... ...Science, Physics, Mathematics, Engineering) with a strong background in... ...real transfer. Publications or open‑source contributions in AI for...PlatformSeniorFull timeWork at officeLocal areaFlexible hours$127k - $167k
AI Engineer We are seeking an AI engineer to join our Managed Services... ...agentic applications, LLM inference, similarity search, guardrails... ...and integrate agentic AI platforms into coding, testing, CI/CD... ...such as Contributions to open‑source AI/ML frameworks or tools are...PlatformTemporary work$200k - $325k
...Description We are building an AI Engineering function to enable... ..., and business teams. As a Senior AI Platform Engineer, you will design and... ...powers AI systems firm‑wide: inference services, agentic platforms... ...platform, including managed LLM inference services (Amazon...PlatformSeniorWork at officeLocal area- Senior. Distinguished AI Engineer (Agentic AI Platform) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For... ...AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory...PlatformSeniorWork at officeLocal area
$174.19k - $287.41k
Red Hat, LLC is seeking a Principal Software Engineer to join the AI Innovation Team in Boston. This role bridges AI algorithms and Red Hat's AI platform, focusing on integrating cutting-edge AI research with production systems. The ideal candidate has extensive experience...Platform- ...company building an AI-enabled nursing platform designed to augment... ...for STT/TTS/Speech LLM model training: from... ...Evaluate and benchmark open‑source models (Parakeet,... ...integration with Triton Inference Server (TensorRT/FP1... ...strategies Mentor engineers on data curation,...PlatformRemote work
$90k - $105k
...Senior Life Sciences Knowledge Engineer Company: Norstella Location: Remote, United States... ...life sciences data and AI solutions provider... ...with structured publishing platforms and data tools; comfort with... ...approaches them about an open role with Norstella. Norstella...PlatformSeniorFull timeTemporary workWork at officeLocal areaRemote workFlexible hoursNorstella
Boston, MA4 days ago- ...in Boston that is using AI to transform how... ...they need to build. Their engineering team is small, exceptionally... ...As they scale their AI platform across an expanding... ...system clients, they need a Senior AI/ML Engineer who can... ...and delivering LLM-powered features that surface...PlatformSeniorRemote work
$144k - $181k
...the company operates by embedding AI into workflows across every function — product, engineering, revenue, finance, support. It’s... ...specs. Work with AI APIs and platforms (Anthropic/Claude, AWS Bedrock,... ...Hands-on experience building with LLM APIs, agent frameworks, or AI-powered...PlatformSeniorFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineer for Open-Source LLM Platform. Be the first to apply!
Related searches
- ai engineer Boston, MA
- machine learning ai engineer Boston, MA
- ai ml engineer Boston, MA
- senior ai engineer Boston, MA
- ai prompt engineer Boston, MA
- ai developer Boston, MA
- ai engineer remote Boston, MA
- senior cloud service delivery manager Boston, MA
- senior business analyst contract Boston, MA
- senior product design engineer Boston, MA