Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference Performance Engineer (Open Source)

Red Hat

A leading open-source company is looking for a Senior Performance Engineer in Boston, MA to enhance the performance and scalability of AI workloads. This role involves defining performance metrics, collaborating with teams, and utilizing tools like vLLM and PyTorch. Candidates should have substantial experience in performance engineering and a commitment to open-source values. The position offers competitive compensation and a supportive, innovative work environment. #J-18808-Ljbffr

Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Performance Engineer (Open Source) in Boston, MA vacancy
  •  ...pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves developing model...  ...innovative solutions to complex problems in an open-source environment. Excellent communication skills and... 
    Senior

    Red Hat

    Boston, MA
    5 hours ago
  •  ...A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building...  ..., and CI/CD practices. Join us to shape the future of AI with innovative open-source solutions. #J-18808-Ljbffr... 
    Senior

    Red Hat

    Boston, MA
    6 hours ago
  • $178.13k - $198.63k

    Senior Software Quality Engineer page is loaded## Senior Software...  ...permitted: work may be performed within normal...  ....* Analyze source code and work with...  ...to testing RHEL AI software,...  ..., including LLM inference engine such as vLLM...  ...collaborating with upstream open-source... 
    Senior
    Performance
    Contract work
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Red Hat, Inc.

    Boston, MA
    1 day ago
  • $184.94k - $305.13k

    The vLLM and LLM-D Engineering team at Red Hat is looking...  ...our cutting‑edge inference platform (LLM-D ( and...  ...deployments by running performance benchmarks, tuning vLLM...  ...complex CNI failures. AI Inference Proficiency:...  ...Experience contributing to open-source AI infrastructure... 
    Performance
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat, Inc.

    Boston, MA
    3 days ago
  • $133.65k - $220.68k

     ...Red Hat, LLC in Boston is on a quest for a Senior Software Engineer to lead the development of the Red Hat AI Inference Server. This role involves the full lifecycle, from compiling wheels to managing multi-cloud infrastructure and ensuring model accuracy. The ideal candidate... 
    Senior

    Red Hat

    Boston, MA
    1 day ago
  • $105.8k - $174.8k

     ...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of...  ...and derive insights from varied data sources across a broad technology landscape. You...  ...you to provide technical leadership and perform development tasks to ensure robust engineering... 
    Senior
    Performance
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Boston, MA
    6 hours ago
  • $105.8k - $174.8k

     ...– Data and Decision Science – AI Native Engineering Physical AI Engineering Consultant, Senior Consultant The opportunity...  ...derive insights from varied data sources across a broad technology...  ...provide technical leadership and perform development tasks to ensure robust... 
    Senior
    Performance
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Boston, MA
    3 days ago
  • $106.9k - $176.5k

     ...your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of...  ...and derive insights from varied data sources across a broad technology landscape. You...  ...ll look to you to provide guidance and perform technical development tasks to ensure... 
    Senior
    Performance
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Boston, MA
    3 days ago
  • $125k - $205k

     ...Built on a native, AI-powered platform and...  ...bridges creativity and performance so campaigns don’t just...  ...POSITION: As a Senior Security Engineer at Later, you will play...  ...third-party compensation sources to help us understand...  ...positions, we are open to hiring fully... 
    Senior
    Performance
    Permanent employment
    Local area
    Remote work

    Later

    Boston, MA
    4 days ago
  • $210.73k - $358.07k

     ...believe the future of AI is open and we are on a...  ...bring the power of open‑source LLMs and vLLM to every enterprise. RedHat Inference engineering team accelerates AI for...  ...LLM deployments. As a Senior Engineering Manager...  ...challenges in model performance and efficiency. Your... 
    Senior
    Performance
    Contract work
    Work experience placement
    Remote work
    Flexible hours

    Red Hat, LLC

    Boston, MA
    4 days ago
  • $133.65k - $220.68k

     ...believe the future of AI is open and we are on a...  ...bring the power of open-source LLMs and vLLM to...  ...enterprise. The Red Hat AI Inference team accelerates AI...  ...an experienced Senior Software Engineer to build and release...  ...validating LLM accuracy and performance across a growing... 
    Senior
    Performance
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    5 hours ago
  • $130k - $300k

     ...Distributed Systems engineers at Datadog design, implement and run...  ...Cassandra, Elasticsearch and other open-source components Own meaningful...  ...about simple designs and performance ~ You want to work in a fast...  ...demonstrated ability to use AI coding tools in day-to-day workflows... 
    Senior
    Performance
    Work at office

    Datadog

    Boston, MA
    2 days ago
  • $150k - $175k

     ...are seeking an exceptional UI Engineer to drive the creation of...  ...leveraging modern technologies and AI-assisted tools. Your...  ...into reusable, scalable, and performant UI components using HTML, CSS...  ...pharma). Contributions to open-source design systems. Figma expertise... 
    Senior
    Performance
    Permanent employment
    Full time
    Worldwide

    Skill Corp

    Boston, MA
    9 days ago
  • $210.73k - $358.07k

     ...believe the future of AI is open and we are on a...  ...bring the power of open-source LLMs and vLLM to every...  ...enterprise. Red Hat Inference engineering team accelerates AI for...  ...LLM deployments. As a Senior Engineering Manager...  ...challenges in model performance and efficiency. Your... 
    Senior
    Performance
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat, Inc.

    Boston, MA
    5 days ago
  • $229.9k - $262.4k

     ...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes)...  ...responsibly implementing AI/ML across Capital One . We...  ...TypeScript, SQL, Python, and Go, Open Source RDBMS and NoSQL databases,...  ...for candidates hired to perform work within one of these locations... 
    Senior
    Performance
    Full time
    Part time
    Internship
    Local area

    Capital One

    Cambridge, MA
    2 days ago
  •  ...is looking for a Machine Learning Research Engineer Co-op to join their team in Boston. The position...  ...networking techniques for high-performance machine learning workloads, contributing to real-world distributed inference workflows. The ideal candidate is pursuing... 
    Performance

    Red Hat

    Boston, MA
    5 hours ago
  • $174.19k - $287.41k

     ...Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine... 
    Senior

    Red Hat

    Boston, MA
    5 hours ago
  • $314.8k - $359.3k

     ...Senior Distinguished Engineer, AI Compute (Remote Eligible) At Capital One, we are creating responsible...  ...product experiences and scalable, high‐performance AI infrastructure. At Capital One,...  ..., fine‐tuning, or high‐throughput inference Hands‐on experience with AWS‐... 
    Senior
    Performance
    Full time
    Part time
    Local area
    Remote work

    Capital One

    Cambridge, MA
    1 day ago
  • $136.84k - $145k

     ...Embedded Software Engineer Make the worlds most advanced Cybersecurity and Encryption...  ..., preferably Rhapsody. Android Open Source Project (AOSP)-based development (Android...  ...with you, we invite you to join our high-performance team! Equal Opportunity Employer / Individuals... 
    Performance
    Relocation package
    Flexible hours

    General Dynamics

    Dedham, MA
    3 days ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital...  ...experiences and scalable, high-performance AI infrastructure. At Capital One, you...  ...etc. ~ Leverage a broad stack of Open Source and SaaS AI technologies such as AWS... 
    Senior
    Performance
    Full time
    Part time
    Local area

    Capital One Financial Corp

    Cambridge, MA
    3 days ago
  •  ...aware, reliable, field‑ready AI systems that tackle the hardest...  ...continuously improve model performance through rapid iteration driven...  ...is seeking passionate engineers to play a vital role in the development...  ...software. Contributions to open‑source robotics frameworks or tools.... 
    Senior
    Performance

    FieldAI

    Boston, MA
    3 days ago
  • $90k - $165k

     ...Staff / Senior Embedded C++ / Rust Software Engineer (Robotics) The Staff / Senior Embedded...  ...Deliver solutions that balance performance and reliability Come...  ...assignments Leverage AI tooling to streamline...  ...other industry-standard source control) ~ Experience using... 
    Senior
    Performance

    Full Spectrum Software

    Boston, MA
    3 days ago
  • $160k - $195k

     ...is the leading public safety AI company that unlocks mission‑critical...  ...fuels the RapidSOS HARMONY AI engine that delivers this...  ...critical moments. What you’ll do Own performance and reliability outcomes:...  ...diagnose and resolve issues at the source Ability and willingness to... 
    Senior
    Performance
    Local area
    Flexible hours

    RapidSOS

    Boston, MA
    6 hours ago
  •  ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level: 8+ to 13+ Years Location: Hybrid -...  ...hybrid search, and optimize vector-based retrieval performance across enterprise datasets. Microservices &... 
    Senior
    Performance
    Work at office
    Remote work

    Saviance

    Boston, MA
    2 days ago
  • $144.7k - $261.3k

     ...Job Description The Senior ML Validation Research Engineer will lead applied machine...  ...Prototype research concepts into performant tools integrated into CI/...  ...Advance ML research for open and and closed loop...  ...of Bayesian ML, causal inference, and sequential testing.... 
    Senior
    Performance
    Local area
    Work from home
    Flexible hours

    General Motors

    Boston, MA
    5 days ago
  • $178.3k - $407k

     ...better working world. AI and Data – Data Scientist – Senior Manager EY delivers...  ..., big data and cloud engineering. We always support and enable...  ...Published research or open-source contributions in AI / ML...  ...rewarded based on your performance and recognized for the value... 
    Senior
    Performance
    Summer holiday
    Flexible hours

    EY

    Boston, MA
    3 days ago
  • Blitzy is a Cambridge, MA based AI software development...  ...(In-Office) The Role As a Senior Site Reliability Engineer at Blitzy's Kendall Square...  ...production-ready software remain performant, resilient, and always...  ...environment reproducible from source. Engineering teams are... 
    Senior
    Performance
    Work at office

    Blitzy AI

    Cambridge, MA
    2 days ago
  • $150k - $215k

     ...a mission to unlock human performance and healthspan. WHOOP empowers...  ...lives. WHOOP is seeking a Senior ML Research Engineer to join the Sensor...  ...DL/ML (including Foundation AI models) models for deployment...  ...efficient, and cost-effective ML inference systems. QUALIFICATIONS:... 
    Senior
    Performance
    Full time
    Work experience placement
    Work at office
    Relocation

    WHOOP

    Boston, MA
    3 days ago
  •  ...seeking a Member of Technical Staff in Boston to develop and apply performance models for silicon and systems. The role requires 5–10+ years...  ...should have a Bachelor's or Master's degree in Electrical Engineering or Computer Engineering. Competitive salary, relocation... 
    Senior
    Performance
    Relocation package

    Netpreme

    Boston, MA
    2 days ago
  •  ...Red Hat, LLC seeks a Senior Principal Machine Learning Engineer in Boston, MA, to enhance AI solutions through operational simplicity in GenAI deployments. You’ll work on optimizing LLMs and collaborate with product and research teams to innovate in deep learning. As part... 
    Senior

    Red Hat

    Boston, MA
    6 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference Performance Engineer (Open Source). Be the first to apply!