Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hybrid Senior ML Engineer - Open-Source LLM Inference

$174.19k - $287.41k

Red Hat, Inc.

Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine learning, Python programming, and understanding of deep learning fundamentals. Red Hat offers a hybrid work model and a competitive salary range of $174,190.00 - $287,410.00, alongside comprehensive benefits like medical coverage and retirement plans. #J-18808-Ljbffr Red Hat, Inc.

Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Hybrid Senior ML Engineer - Open-Source LLM Inference in Boston, MA vacancy
  •  ...pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves...  ...contributing innovative solutions to complex problems in an open-source environment. Excellent communication skills and... 
    Senior

    Red Hat, Inc.

    Boston, MA
    1 day ago
  •  ...Senior ML Engineer — Agentic AI Location: Waltham, MA (Hybrid) You'll be joining a collaborative...  ...to wiring LLM reasoning with tool...  ...enterprise data sources. Implement planning...  ...with a range of open-source LLMs (Qwen...  .... Explore inference optimizations such... 
    Senior
    Temporary work

    SS&C Technologies Holdings

    Waltham, MA
    7 days ago
  • $172k - $229k

     ...Senior Machine Learning Engineer, Data Mining Boston, MA February...  .... Omnitag, our ML-powered...  ...drastically reducing inference latency and memory...  ...thought models, or LLM-based planning....  ...Publications or open-source contributions in...  ...We encourage a hybrid schedule with in... 
    Senior
    Work at office
    Remote work

    Venturefizz Product Management Community

    Boston, MA
    3 days ago
  • $189.6k - $312.73k

     ...the future of AI is open and we are on a...  ...the power of open-source LLMs and vLLM to every...  ...enterprise. Red Hat Inference team accelerates AI...  ...maintainers of the vLLM and LLM-D projects, and...  ...Machine Learning Engineer focused on...  ...OpenTelemetry. Ph.D. in an ML-related domain is a... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    2 days ago
  •  ...seeking an experienced Machine Learning Engineer to join the SMART Health IT team ( In this...  ..., you will design, build, and deploy LLM pipelines that operate on real-world clinical...  ..., and that maintains widely adopted open-source platforms used by hospitals, researchers... 
    Senior
    Worldwide
    Flexible hours

    Boston Children's Hospital

    Boston, MA
    3 days ago
  • $150k - $210k

     ...Senior AI/ML Engineer (AI Platform) At WHOOP, we're on a mission...  ...-tuning workflows, LLM observability, and experimentation...  ...messy, multi-source data into high-quality...  ...language models (open-weight or API-based),...  ...production deployments with inference optimization,... 
    Senior
    Full time
    Work at office
    Relocation

    Venturefizz Product Management Community

    Boston, MA
    2 days ago
  • $178.3k - $407k

     ...Data Scientist – Senior Manager EY delivers...  ...data and cloud engineering. We always support...  ...scientists and ML engineers tackling...  ...retrieval trade-offs, hybrid search, reranking,...  ...agent / LLM framework). ~ Practical...  ...Published research or open-source contributions in... 
    Senior
    Summer holiday
    Flexible hours

    EY

    Boston, MA
    3 days ago
  • $206.6k - $351.05k

     ...future of AI is open and we are on a mission...  ...power of open-source LLMs and vLLM to...  .... Red Hat AI ( Inference team accelerates...  ...optimize, and scale LLM deployments. As a Senior Principal Machine Learning Engineer focused on model...  ...field. A PhD in a ML related domain is... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    4 days ago
  • $189.6k - $312.73k

     ...the future of AI is open and we are on a...  ...the power of open-source LLMs and vLLM to every...  ...enterprise. Red Hat Inference team accelerates AI...  ...of the vLLM and LLM-D projects, and inventors...  ...Machine Learning Engineer focused on...  ...OpenTelemetry. Ph.D. in an ML-related domain is... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Remote work
    Flexible hours

    Red River

    Boston, MA
    14 hours ago
  •  ...seeking an experienced candidate for a key role in Center Store Sourcing based in Quincy, MA. This position involves developing sourcing...  ...excellent communication skills. The work schedule allows for hybrid flexibility, combining remote and in-office days. #J-18808-Ljbffr... 
    Senior
    Work at office
    Remote work

    ViziRecruiter,LLC.

    Quincy, MA
    4 days ago
  • $229.9k - $262.4k

     ...Senior Lead Machine Learning Engineer (Intelligent Foundations and Experiences) As a...  ...expected to perform many ML engineering activities, including...  ...model experimentation, LLM inference, similarity search, and...  ...a broad stack of Open Source and SaaS AI technologies... 
    Senior
    Full time
    Part time
    Internship
    Local area

    Capital One

    Cambridge, MA
    4 days ago
  •  ...major grocery retailer is looking for a leader in Center Store Sourcing to develop strategies that drive financial results while leading...  ...across multiple brands. This opportunity supports a hybrid work model, requiring 3 in-office days in Quincy, MA. #J-18808-... 
    Senior
    Work at office

    ViziRecruiter,LLC.

    Quincy, MA
    4 days ago
  • $145k - $210k

     ...Senior AI/ML Engineer Cooley is seeking a Senior AI/ML Engineer to join the...  ...Azure, AWS, and other cloud and hybrid platforms. This role is...  ...for building and operating LLM-powered applications and agentic...  ...with enterprise data sources, APIs, and retrieval systems... 
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours
    Weekend work

    Cooley Corp.

    Boston, MA
    2 days ago
  •  ...Job Title: Generative AI Engineer (Senior / Lead / Principal)- Multiple openings Experience Level:...  ...Location: Hybrid - Remote (India-based) with...  ...Chennai Industry: AI/ML, Enterprise Applications,...  ...a deep understanding of LLM frameworks, Python-based... 
    Senior
    Work at office
    Remote work

    Saviance

    Boston, MA
    1 day ago
  •  ...Alignerr is seeking a Senior Machine Learning Engineer to shape the next generation of AI systems by authoring high-fidelity reasoning traces. This fully remote role allows you to work independently, requiring expertise in machine learning, and strong written communication... 
    Senior
    Freelance
    Remote work
    Flexible hours

    Alignerr

    Boston, MA
    21 hours ago
  • $286.2k - $326.7k

     ...Distinguished Machine Learning Engineer (Remote-Eligible)...  ...applications of AI & ML are bringing humanity and...  ...real-time and batch inference - ensuring high performance...  ...state-of-the-art LLM optimization techniques...  ...Leverage a broad stack of Open Source and SaaS AI technologies... 
    Senior
    Full time
    Part time
    Local area
    Remote work
    Flexible hours

    Capital One

    Boston, MA
    3 days ago
  • $95.3k - $158.8k

     ...collaborative Machine Learning Ops Engineer looking to work for a mission...  .... About the role, as a Senior Machine Learning Engineer you...  .... Key Responsibilities ML & LLM Engineering, Search and...  ...reflection, chunking, embeddings, hybrid retrieval, semantic search),... 
    Senior
    Local area

    RELX

    Cambridge, MA
    3 days ago
  •  ...Senior Sourcing Analyst For Cell And Gene Therapy (CGT) And Biologics As the Senior Sourcing...  ...the Seaport area. This role requires a hybrid work schedule: minimum 3 days in office...  ...manufacturing. Bachelor's degree in engineering, supply chain, finance, business... 
    Senior
    Contract work
    Work at office
    Remote work
    Relocation

    Ver-Tex

    Boston, MA
    2 days ago
  • $111.05k - $123.39k

     ...supports work-life balance by offering hybrid schedules for certain roles. Eligibility...  ...Responsible for driving the procurement sourcing strategies, managing the bid process, and...  ...Worker Type: Regular Number of Openings: 1 Emergency Response: Responding... 
    Senior
    Contract work
    For contractors
    H1b
    Remote work

    Eversource Energy

    Westwood, MA
    18 days ago
  • $106.9k - $176.5k

     ...Decision Science – AI Native Engineering AI/Machine Learning Engineer, Senior Consultant The...  ...insights from varied data sources across a broad technology...  ...with diverse, hybrid and global teams ~ Experience...  ...high-value production AI/ML solutions on a major cloud... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Boston, MA
    21 hours ago
  • $183.5k - $269.1k

     ...Machine Learning Engineer, ML Infrastructure...  ...We're embracing a hybrid work model that enables...  ...products. This is a senior individual...  ...time computer vision inference that processes video...  ...customer base, and LLM/GenAI infrastructure...  ...deployments). Open source contributions to... 
    Work at office

    Venturefizz Product Management Community

    Boston, MA
    21 hours ago
  • $108.76k - $173.8k

    Red Hat, Inc. is looking for a Software Engineer (AI/ML) in Boston, MA. This hybrid role involves collaborating within the engineering team to develop components for the Red Hat AI platform. Candidates should have strong Python skills and a background in software development... 

    Red Hat, Inc.

    Boston, MA
    21 hours ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One,...  ..., our applications of AI & ML are bringing humanity and simplicity...  ..., large language model inference, similarity search,...  ...Leverage a broad stack of Open Source and SaaS AI technologies such... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    5 days ago
  • $144.7k - $261.3k

     ...Job Description The Senior ML Validation Research Engineer will lead applied machine learning research focused...  .... Advance ML research for open and and closed loop simulation validation...  ...Knowledge of Bayesian ML, causal inference, and sequential testing. Experience... 
    Senior
    Local area
    Work from home
    Flexible hours

    General Motors

    Boston, MA
    4 days ago
  • $133.65k - $220.68k

     ...the future of AI is open and we are on a...  ...the power of open-source LLMs and vLLM to every...  .... The Red Hat AI Inference team accelerates...  ...optimize, and scale LLM deployments. We...  ...an experienced Senior Software Engineer to build and release...  .... A Ph.D. in an ML-related domain is... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    2 days ago
  •  ...Senior AI / ML Engineer We are seeking a proactive, hands-on Senior ML/AI Engineer to help us advance...  ..., you will develop production-grade LLM-based systems, manage knowledge graphs,...  ...offers an ideal opportunity. This is a HYBRID position targeting candidates based in... 
    Senior

    Implaion Recruiting

    Boston, MA
    3 days ago
  •  ...Senior Recruiter & People Operations Lead (Hybrid) Boston, MA At Wellist, we help employers deliver the right resources...  ...hiring decisions Proactively source and build high quality pipelines,...  ..., performance reviews, and open enrollment with strong organization... 
    Senior

    Wellist

    Boston, MA
    21 hours ago
  • $96.8k - $251.6k

     ...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical...  ...platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI...  .... Deep understanding of LLM application patterns, including... 
    Senior
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    3 days ago
  •  ...home. If your candidate is not open to this please tell them they...  ...with Python. This is for a senior level candidates who can work...  ...scientists, mathematicians and engineers takes a strategic and rigorous...  ...image, audio); trending open-source model genres, e.g., GPT, FLAN/... 
    Senior
    Contract work
    Work from home

    Suncap Technology

    Boston, MA
    2 days ago
  • $106.48k - $159.72k

    Loyalty360 in Quincy, MA is hiring for a role in Merchandising Marketing Support responsible for sourcing, negotiations, and supplier management across several brands. Successful candidates will have experience in market analysis and negotiation skills, contributing directly... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Loyalty360

    Quincy, MA
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hybrid Senior ML Engineer - Open-Source LLM Inference. Be the first to apply!