Distributed vLLM Engineer for Scalable AI Inference (Hybrid)
The Red Hat
Red Hat, Inc. is seeking a Machine Learning Engineer focused on distributed vLLM infrastructure. This role involves designing, developing, and optimizing innovative AI solutions in a hybrid work environment. The engineer will aid in the advancement of open-source projects, enhancing distributed inference systems. Successful candidates should have strong proficiency in Python or Go, and experience with Kubernetes technologies. A Bachelor's degree is preferred but relevant hands-on experience is prioritized. Join Red Hat to shape the future of AI. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Distributed vLLM Engineer for Scalable AI Inference (Hybrid) in Boston, MA vacancy
$136.32k - $287.41k
...Red Hat, LLC is seeking a Machine Learning Engineer focused on distributed vLLM infrastructure to join the AI Inference Engineering team in Boston. You will contribute to innovative solutions for scalable LLM deployments, leveraging technologies like Kubernetes. The ideal...SuggestedRed Hat
Boston, MA1 day ago$184.94k - $305.13k
The vLLM and LLM-D Engineering team at Red Hat is looking for a customer obsessed... ...bridge between our cutting‑edge inference platform (LLM-D ( and vLLM... ..., optimize, and scale distributed Large Language Model (LLM)... ...troubleshoot complex CNI failures. AI Inference Proficiency: You...SuggestedPermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours$130k - $300k
...Distributed Systems engineers at Datadog design, implement and run in production the... ...together. We operate as a hybrid workplace to ensure our employees... ...-tolerant, horizontally scalable solutions running in multi-... ...ability to use AI coding tools in day-to-day...SuggestedWork at officeDatadog
Boston, MA3 days ago$110.3k - $190.3k
...You will report to the Senior AI/ML Development Manager in the Architecture, Engineering, and Construction (AEC) Solutions... ...Team. Location: We support hybrid work, and you work near our Boston... ...Responsibilities Help develop scalable, distributed systems and microservices in a...Suggested$142.6k - $261.5k
...Using our product‑driven, AI‑centric approach, we... ..., and software engineers enable our clients to... ...successful production scalable software systems preferred... ...interest in cloud and distributed systems architectures... ...led and leader‑enabled hybrid model. Our expectation...SuggestedSummer holidayFlexible hoursErnst & Young Oman
Boston, MA3 days ago- ...Modulate Inc. is seeking a Machine Learning Operations Engineer to enhance and manage production inference systems. The role demands strong skills in AWS,... ...response plans. The company offers competitive salary, hybrid work options, and a comprehensive benefits package....
MODULATE
Somerville, MA1 day ago - ...AI Systems Engineer Join the AI Studio of an innovative construction... ...Systems Engineer, a hybrid role responsible for... ...both: The distributed systems backbone that... ...AI. You will design scalable APIs, event-driven... ...AI agents Optimize inference pipelines for cost, performance...
1872 Consulting
Boston, MA4 days ago $152k - $222.6k
...AI Systems Engineer ID 2026-10479 Job Location... ...Systems Engineer, a hybrid role responsible for... ...building both: The distributed systems backbone that... ...AI. You will design scalable APIs, event-driven services... ...agents Optimize inference pipelines for cost,...Full timeTemporary workFor contractorsWork at officeSuffolk Construction
Boston, MA3 days ago- ...Architect (Computer Engineer) VA Boston... ...functional, volumetric, scalable, highly performant, reliable, and distributed system including front... ...cloud computing, hybrid cloud, web app,... ...coding experience. AI and Machine... ...for training and inference would be a definite...Full timePart timeWork experience placement
Society of Fire Protection Engineers
Boston, MA1 day ago $60 per hour
Contract to Hire Lead Quality Test Automation Engineer - Hybrid Onsite in Boston Location: Boston,... ...frameworks, and mentoring team members. AI‑assisted development/testing exposure,... ...Drive the development and adoption of scalable automation frameworks and best practices...Contract workFor contractors- Suffolk, a national leader in construction and technology, seeks an AI Systems Engineer for its Boston office. This hybrid position focuses on architecting AI-driven capabilities and building scalable APIs and infrastructure. The ideal candidate will have extensive software...Work at office
$172k - $225.7k
...this new era, we seek AI-native thinkers across... ...Security Applied Field Engineering (AFE) organization is... ...sensitive training and inference data. Platform... ...logging, monitoring, and distributed tracing on a platform... ...in securing cloud and hybrid network architectures,...Flexible hoursSnowflake Computing
Boston, MA2 days ago$99.6k - $223.4k
...smart systems software engineers with BS/MS/PhD in... ...for best performance, scalability and high availability.... ..., Smart Flash Log and Hybrid Columnar Compression technologies... ...edge technology like AI vector Database. As... ...algorithms and distributed systems software that...Temporary workFlexible hoursOracle
Boston, MA6 days ago$36 - $41 per hour
...A leading global biopharmaceutical firm is looking for an AI Data Integration Engineer (RAG Systems). This hybrid position involves developing AI-enabled assistants and supporting engineering workflows. Candidates should have experience in data engineering, awareness of...Permanent employmentContract work3 Key Consulting
Cambridge, MA1 day ago- ...leading consulting firm in the United States is seeking a Senior AI Native Engineer to revolutionize how businesses leverage artificial... ...This role involves researching, building, and implementing scalable AI systems, enhancing data integrity and optimizing learning...
Ernst & Young Oman
Boston, MA2 days ago $136.32k - $225.09k
..., virtualization, and AI technologies, together... ...challenges. Red Hat’s Global Engineering team is looking for a... ...developing robust and scalable code. As part of your... ...scaled and performant Distributed Systems Experience... ..., PyTorch, LLaMA.cpp, vLLM, LangGraph, and...Permanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hoursRed Hat
Boston, MA2 days ago- ...Senior Software Engineer, Data & MarTech (Hybrid, Boston, Seaport District) #26571 PROJECT STACK and TEAM... ...Thinking: Ability to debug complex, distributed systems and provide long‑term solutions... ...to deployment, ensuring they are scalable, secure, and performant Hands‑on Development...
Evolvesquads
Boston, MA2 days ago - ...Snyk, based in Boston, is seeking a Software Engineer to shape secure AI software development. You will analyze, design, and build reliable, scalable solutions while collaborating with teams to ensure product quality. Ideal candidates have 3+ years of experience and proficiency...
Snyk
Boston, MA1 day ago - ...Job Title: AI Data Integration Engineer (RAG Systems) - Hybrid(JP15177) Location: Cambridge, MA 02138 Employment Type: Contract Business Unit: ETA Drug Substance Duration: 1+ year with likely extensions and/or conversion to permanent Posting Date: 4/1/2026 Pay Rate: $3...Permanent employmentContract workWork at officeLocal area
3 Key Consulting
Cambridge, MA2 days ago - ...Population Health Data Engineer (Epic & Healthcare Analytics) - Hybrid Location: Hybrid (25% onsite / 75% remote) Openings: 2 positions... ...Responsibilities • Design, develop, and maintain scalable data pipelines supporting population health, claims...Contract workLive inRemote work
Gardner Resources Consulting
Boston, MA2 days ago $178.13k - $198.63k
...A leading software solutions company seeks a Senior Software Quality Engineer for a hybrid role in Boston. This position involves developing automated test strategies and collaborating with developers on testing approaches. Candidates should possess at least 5 years of...Red Hat
Boston, MA1 day ago$229.9k - $262.4k
...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do you love building and pioneering in the technology space... ...Tech) is committed to pioneering and responsibly implementing AI/ML across Capital One . We achieve this by building...Full timePart timeInternshipLocal areaCapital One
Cambridge, MA3 days ago- ...A pioneering AI software development company in Greater Boston is seeking a Forward Deployed Software Engineer to help integrate cutting-edge AI technology into customer solutions... ...relocate to the Greater Boston area. This hybrid position requires on-site work in Quincy...Relocation
Blitzy
Quincy, MA2 days ago $120k - $180k
...that is enabling high‑performance, scalable optical components across AI/datacom infrastructure, hyperscale... ...assembled a world‑class team covering engineering, business, and operations. We... ...Senior Photonics Process Engineer for Hybrid Integration, you will be a key technical...$100k - $130k
...AI Business Systems Engineer - Wakefield, MA – C-4 Analytics The ideal candidate understands the benefits... ...that enhances your productivity. Hybrid: For those who prefer a balance... ...drives relentlessly for reliability and scalability. AI Expertise: Deep, hands-on...Currently hiringWork at officeLocal areaRemote work3 days per weekC-4 Analytics
Wakefield, MA5 days ago- ...Tristar AI, Inc. is looking for a Hardware Engineer to support vision systems hardware setups in Cambridge, MA. The ideal candidate has over 5 years of... ...configurations, and documenting setups. The position offers a hybrid work model and competitive benefits, including equity...Flexible hours
Tristar AI, Inc.
Cambridge, MA1 day ago $314.8k - $359.3k
...Senior Distinguished Engineer, AI Compute (Remote Eligible) At Capital... ...product experiences and scalable, high‐performance AI infrastructure... ...leader passionate about distributed systems, to engineer and scale... ...‐tuning, or high‐throughput inference Hands‐on experience with AWS...Full timePart timeLocal areaRemote workCapital One
Cambridge, MA2 days ago$225k - $300k
...thinking peers.The Director of Engineering will provide strategic... ..., and execution of scalable, secure, and production-grade AI-enabled systems. As a key... ..., system latency, model inference performance, and... ...secure API design, and distributed full-stack application development...Goodwin Procter Boston
Boston, MA1 day ago$150k - $250k
...building a new generation of AI systems designed to reason with... ...modeling, the platform enables engineers and researchers to accelerate... ...innovation. Location: Boston, USA (Hybrid) Employment Type: Full-... ...lifecycles and develop scalable solutions Collaborate directly...Full timeVisa sponsorshipRelocation package$140k - $170k
...operations. We deliver advanced AI and data analytics... ...SUMMARY: As an Engineer on the Image & Computer... ...and location inference from imagery, and multimodal... ...teams to deliver reliable, scalable, and cost-efficient vision... ...language. This is a hybrid role to be based out of...Work at officeFlexible hoursBabel Street
Somerville, MA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed vLLM Engineer for Scalable AI Inference (Hybrid). Be the first to apply!
