Senior AI Inference Performance Engineer (Open Source)
Red Hat
A leading open-source company is looking for a Senior Performance Engineer in Boston, MA to enhance the performance and scalability of AI workloads. This role involves defining performance metrics, collaborating with teams, and utilizing tools like vLLM and PyTorch. Candidates should have substantial experience in performance engineering and a commitment to open-source values. The position offers competitive compensation and a supportive, innovative work environment. #J-18808-Ljbffr
- ...pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves developing model... ...innovative solutions to complex problems in an open-source environment. Excellent communication skills and...Senior
- ...A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building... ..., and CI/CD practices. Join us to shape the future of AI with innovative open-source solutions. #J-18808-Ljbffr...Senior
$178.13k - $198.63k
Senior Software Quality Engineer page is loaded## Senior Software... ...permitted: work may be performed within normal... ....* Analyze source code and work with... ...to testing RHEL AI software,... ..., including LLM inference engine such as vLLM... ...collaborating with upstream open-source...SeniorPerformanceContract workWork experience placementWork at officeImmediate startRemote workFlexible hours$184.94k - $305.13k
The vLLM and LLM-D Engineering team at Red Hat is looking... ...our cutting‑edge inference platform (LLM-D ( and... ...deployments by running performance benchmarks, tuning vLLM... ...complex CNI failures. AI Inference Proficiency:... ...Experience contributing to open-source AI infrastructure...PerformancePermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours$133.65k - $220.68k
...Red Hat, LLC in Boston is on a quest for a Senior Software Engineer to lead the development of the Red Hat AI Inference Server. This role involves the full lifecycle, from compiling wheels to managing multi-cloud infrastructure and ensuring model accuracy. The ideal candidate...Senior$105.8k - $174.8k
...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of... ...and derive insights from varied data sources across a broad technology landscape. You... ...you to provide technical leadership and perform development tasks to ensure robust engineering...SeniorPerformanceFull timeWork experience placementSummer holidayFlexible hours$105.8k - $174.8k
...– Data and Decision Science – AI Native Engineering Physical AI Engineering Consultant, Senior Consultant The opportunity... ...derive insights from varied data sources across a broad technology... ...provide technical leadership and perform development tasks to ensure robust...SeniorPerformanceFull timeWork experience placementSummer holidayFlexible hours$106.9k - $176.5k
...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of... ...and derive insights from varied data sources across a broad technology landscape. You... ...ll look to you to provide guidance and perform technical development tasks to ensure...SeniorPerformanceFull timeWork experience placementSummer holidayFlexible hours$125k - $205k
...Built on a native, AI-powered platform and... ...bridges creativity and performance so campaigns don’t just... ...POSITION: As a Senior Security Engineer at Later, you will play... ...third-party compensation sources to help us understand... ...positions, we are open to hiring fully...SeniorPerformancePermanent employmentLocal areaRemote work$210.73k - $358.07k
...believe the future of AI is open and we are on a... ...bring the power of open‑source LLMs and vLLM to every enterprise. RedHat Inference engineering team accelerates AI for... ...LLM deployments. As a Senior Engineering Manager... ...challenges in model performance and efficiency. Your...SeniorPerformanceContract workWork experience placementRemote workFlexible hours$133.65k - $220.68k
...believe the future of AI is open and we are on a... ...bring the power of open-source LLMs and vLLM to... ...enterprise. The Red Hat AI Inference team accelerates AI... ...an experienced Senior Software Engineer to build and release... ...validating LLM accuracy and performance across a growing...SeniorPerformancePermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours$130k - $300k
...Distributed Systems engineers at Datadog design, implement and run... ...Cassandra, Elasticsearch and other open-source components Own meaningful... ...about simple designs and performance ~ You want to work in a fast... ...demonstrated ability to use AI coding tools in day-to-day workflows...SeniorPerformanceWork at office$150k - $175k
...are seeking an exceptional UI Engineer to drive the creation of... ...leveraging modern technologies and AI-assisted tools. Your... ...into reusable, scalable, and performant UI components using HTML, CSS... ...pharma). Contributions to open-source design systems. Figma expertise...SeniorPerformancePermanent employmentFull timeWorldwide$210.73k - $358.07k
...believe the future of AI is open and we are on a... ...bring the power of open-source LLMs and vLLM to every... ...enterprise. Red Hat Inference engineering team accelerates AI for... ...LLM deployments. As a Senior Engineering Manager... ...challenges in model performance and efficiency. Your...SeniorPerformancePermanent employmentFull timeContract workWork experience placementWork at officeRemote workFlexible hours$229.9k - $262.4k
...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes)... ...responsibly implementing AI/ML across Capital One . We... ...TypeScript, SQL, Python, and Go, Open Source RDBMS and NoSQL databases,... ...for candidates hired to perform work within one of these locations...SeniorPerformanceFull timePart timeInternshipLocal area- ...is looking for a Machine Learning Research Engineer Co-op to join their team in Boston. The position... ...networking techniques for high-performance machine learning workloads, contributing to real-world distributed inference workflows. The ideal candidate is pursuing...Performance
$174.19k - $287.41k
...Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine...Senior$314.8k - $359.3k
...Senior Distinguished Engineer, AI Compute (Remote Eligible) At Capital One, we are creating responsible... ...product experiences and scalable, high‐performance AI infrastructure. At Capital One,... ..., fine‐tuning, or high‐throughput inference Hands‐on experience with AWS‐...SeniorPerformanceFull timePart timeLocal areaRemote work$136.84k - $145k
...Embedded Software Engineer Make the worlds most advanced Cybersecurity and Encryption... ..., preferably Rhapsody. Android Open Source Project (AOSP)-based development (Android... ...with you, we invite you to join our high-performance team! Equal Opportunity Employer / Individuals...PerformanceRelocation packageFlexible hours$229.9k - $262.4k
...Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital... ...experiences and scalable, high-performance AI infrastructure. At Capital One, you... ...etc. ~ Leverage a broad stack of Open Source and SaaS AI technologies such as AWS...SeniorPerformanceFull timePart timeLocal area- ...aware, reliable, field‑ready AI systems that tackle the hardest... ...continuously improve model performance through rapid iteration driven... ...is seeking passionate engineers to play a vital role in the development... ...software. Contributions to open‑source robotics frameworks or tools....SeniorPerformance
$90k - $165k
...Staff / Senior Embedded C++ / Rust Software Engineer (Robotics) The Staff / Senior Embedded... ...Deliver solutions that balance performance and reliability Come... ...assignments Leverage AI tooling to streamline... ...other industry-standard source control) ~ Experience using...SeniorPerformance$160k - $195k
...is the leading public safety AI company that unlocks mission‑critical... ...fuels the RapidSOS HARMONY AI engine that delivers this... ...critical moments. What you’ll do Own performance and reliability outcomes:... ...diagnose and resolve issues at the source Ability and willingness to...SeniorPerformanceLocal areaFlexible hours- ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years Location: Hybrid -... ...hybrid search, and optimize vector-based retrieval performance across enterprise datasets. Microservices &...SeniorPerformanceWork at officeRemote work
$144.7k - $261.3k
...Job Description The Senior ML Validation Research Engineer will lead applied machine... ...Prototype research concepts into performant tools integrated into CI/... ...Advance ML research for open and and closed loop... ...of Bayesian ML, causal inference, and sequential testing....SeniorPerformanceLocal areaWork from homeFlexible hours$178.3k - $407k
...better working world. AI and Data – Data Scientist – Senior Manager EY delivers... ..., big data and cloud engineering. We always support and enable... ...Published research or open-source contributions in AI / ML... ...rewarded based on your performance and recognized for the value...SeniorPerformanceSummer holidayFlexible hours- Blitzy is a Cambridge, MA based AI software development... ...(In-Office) The Role As a Senior Site Reliability Engineer at Blitzy's Kendall Square... ...production-ready software remain performant, resilient, and always... ...environment reproducible from source. Engineering teams are...SeniorPerformanceWork at office
$150k - $215k
...a mission to unlock human performance and healthspan. WHOOP empowers... ...lives. WHOOP is seeking a Senior ML Research Engineer to join the Sensor... ...DL/ML (including Foundation AI models) models for deployment... ...efficient, and cost-effective ML inference systems. QUALIFICATIONS:...SeniorPerformanceFull timeWork experience placementWork at officeRelocation- ...seeking a Member of Technical Staff in Boston to develop and apply performance models for silicon and systems. The role requires 5–10+ years... ...should have a Bachelor's or Master's degree in Electrical Engineering or Computer Engineering. Competitive salary, relocation...SeniorPerformanceRelocation package
- ...Red Hat, LLC seeks a Senior Principal Machine Learning Engineer in Boston, MA, to enhance AI solutions through operational simplicity in GenAI deployments. You’ll work on optimizing LLMs and collaborate with product and research teams to innovate in deep learning. As part...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Performance Engineer (Open Source). Be the first to apply!
- senior ai engineer Boston, MA
- ai ml engineer Boston, MA
- ai engineer remote Boston, MA
- ai engineer Boston, MA
- ai prompt engineer Boston, MA
- ai developer Boston, MA
- machine learning ai engineer Boston, MA
- senior cost analyst Boston, MA
- senior development engineer Boston, MA
- senior program specialist Boston, MA

