Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Inference Engineering Manager

Red Hat, Inc.

A leading open-source enterprise software provider is seeking a Senior Engineering Manager to lead a team in developing cutting-edge AI solutions. You will be responsible for setting strategic vision, managing software engineering teams, and engaging with open-source communities. Candidates should have over 10 years of experience in software development and proven leadership in machine learning environments. This role offers a competitive salary and comprehensive benefits in Boston, Massachusetts. #J-18808-Ljbffr Red Hat, Inc.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior ML Inference Engineering Manager in Boston, MA vacancy
  • A pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves developing model optimization algorithms, managing deployment pipelines, and collaborating on deep learning research. Qualified... 
    Senior

    Red Hat, Inc.

    Boston, MA
    1 day ago
  • $174.19k - $287.41k

    Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine... 
    Senior

    Red Hat, Inc.

    Boston, MA
    5 days ago
  • $189.6k - $312.73k

     ...to every enterprise. Red Hat Inference team accelerates AI for the enterprise...  ...a Principal Machine Learning Engineer focused on distributed vLLM (...  ...with the vLLM project and manage distributed inference...  ...OpenTelemetry. Ph.D. in an ML-related domain is a significant... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    2 days ago
  • $206.6k - $351.05k

     ...enterprise. Red Hat AI ( Inference team accelerates AI for the...  ...LLM deployments. As a Senior Principal Machine Learning Engineer focused on model...  ...speculators ( . Create and manage inference serving deployment...  ...field. A PhD in a ML related domain is considered... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    4 days ago
  • A leading software solutions provider in Boston is seeking a Principal Machine Learning Engineer to work on model optimization algorithms. In this role, you will collaborate with product and research teams to develop state-of-the-art deep learning software. You should... 
    Suggested

    Red Hat, Inc.

    Boston, MA
    1 day ago
  • A leading medical technology company in Boston seeks a Senior Machine Learning Engineer to develop 3D reconstruction models and integrate AI inference into CAD systems. This role requires expertise in 3D data, proficiency in Python and PyTorch, and a PhD in a relevant field... 
    Senior

    Hike Medical

    Boston, MA
    5 days ago
  • $178.88k - $320.65k

     ...Job Requisition ID # 26WD94803 Senior Principal Machine Learning Engineer, ML Platform and Systems Architecture...  ...approaches for model deployment, inference services, monitoring, and...  ..., architecture, resiliency, risk management, and operational excellence Identify... 
    Senior
    For contractors
    Remote work

    Autodesk

    Boston, MA
    6 days ago
  • $144.7k - $261.3k

     ...Job Description The Senior ML Validation Research Engineer will lead applied machine learning research focused on improving verification and validation...  ...platforms. Knowledge of Bayesian ML, causal inference, and sequential testing. Experience with digital twin... 
    Senior
    Local area
    Work from home
    Flexible hours

    General Motors

    Boston, MA
    4 days ago
  • $96.8k - $251.6k

     ...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical...  ..., autonomous workflows, scalable inference infrastructure, and enterprise AI...  ...calling, agent memory, context management, Model Context Protocol (MCP) integration... 
    Senior
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    3 days ago
  •  ...Alignerr is seeking a Senior Machine Learning Engineer to shape the next generation of AI systems by authoring high-fidelity reasoning traces. This fully remote role allows you to work independently, requiring expertise in machine learning, and strong written communication... 
    Senior
    Freelance
    Remote work
    Flexible hours

    Alignerr

    Boston, MA
    8 hours ago
  • $150k - $210k

     ...Senior AI/ML Engineer (AI Platform) At WHOOP, we're on a mission to unlock human performance and healthspan. WHOOP...  ...sets to production deployments with inference optimization, observability, and lifecycle management. ~ Strong proficiency in data manipulation and... 
    Senior
    Full time
    Work at office
    Relocation

    Venturefizz Product Management Community

    Boston, MA
    2 days ago
  • $190k - $210k

     ...Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | Boston (Hybrid) A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation. This... 
    Senior
    Local area
    Flexible hours

    Franklin Fitch

    Boston, MA
    1 day ago
  • $140k - $175k

     ...Senior Machine Learning Engineer Pickle is on the hunt for a dynamic and driven Senior Machine Learning...  ...runtime integration to ensure low-latency inference on our edge compute hardware (NVIDIA...  ..., with a track record of shipping ML products to the physical world (Robotics... 
    Senior

    Pickle Robot Company

    Charlestown, MA
    2 days ago
  •  ...Senior ML Engineer — Agentic AI Location: Waltham, MA (Hybrid) You'll be joining a collaborative...  ...operate solutions that help clients manage data, automate processes, and scale...  ..., and tool-use reliability. Explore inference optimizations such as speculative decoding... 
    Senior
    Temporary work

    SS&C Technologies Holdings

    Waltham, MA
    7 days ago
  •  ...Senior Machine Learning Engineer Boston, Massachusetts, United States About the Job Senior Machine Learning...  ...treatment options. As a senior ML engineer you'll assume a leading role...  ..., testing, deploying, and performing inference with ML models, preferably with... 
    Senior
    Internship

    Tech Stars Group LLC

    Boston, MA
    2 days ago
  • A leading financial technology company is looking for a Senior Staff Machine Learning Engineer to drive strategic machine learning initiatives. This pivotal role demands over 10 years of experience in ML systems, technical leadership, and expertise in tools like PyTorch... 
    Senior
    Remote work
    Flexible hours

    Affirm

    Boston, MA
    8 hours ago
  • $95.3k - $158.8k

     ...collaborative Machine Learning Ops Engineer looking to work for a mission...  .... About the role, as a Senior Machine Learning Engineer you'...  ...confidentiality. Key Responsibilities ML & LLM Engineering, Search and...  ...governance. Develop and manage CI/CD for ML, including... 
    Senior
    Local area

    RELX

    Cambridge, MA
    3 days ago
  • $189k - $290k

    Zoox in Boston is looking for an engineer to join the Scene Understanding team. This role involves developing advanced Vision-Language-Action (VLA) models to enhance the safety of self-driving robots. Collaborating with top engineers, you'll work on real-time algorithms... 
    Senior

    Zoox

    Boston, MA
    5 days ago
  • $162.5k - $286.4k

    A leading technology company is seeking a passionate Senior Machine Learning Engineer to enhance the online shopping experience through innovative algorithms. The role involves building scalable, production-ready solutions and mentoring junior team members. Candidates... 
    Senior

    Apple Inc.

    Cambridge, MA
    3 days ago
  • $242k - $290k

    Zoox is seeking a Perception Engineer in Boston, Massachusetts, to design and implement advanced detection models using fused sensor data for autonomous vehicles. The role involves training ML models, collaborating with teams, and documenting outcomes to deploy models in... 
    Senior

    Zoox

    Boston, MA
    5 days ago
  • $229k - $317k

    Zoox is looking for an engineer in the Offline Driving Intelligence (ODIN) team in Boston, MA, to develop advanced multimodal large language models that enhance environmental understanding for their robotaxi platform. The ideal candidate will have a MS or PhD in Computer... 
    Senior

    Zoox

    Boston, MA
    1 day ago
  • $148.5k - $266.2k

     ...in the world. As a Machine Learning Engineering Manager on the Model Delivery team within Autodesk Research, you will lead production ML engineering across deployment, monitoring...  ...performance, and cost improvements for inference and serving, including capacity... 
    For contractors
    Remote work

    Autodesk

    Boston, MA
    3 days ago
  • $150k - $210k

     ...Senior Machine Learning Engineer WHOOP is an advanced health and fitness wearable, on a mission to unlock...  ...design, build, and productionize ML systems that deliver meaningful, personalized...  ..., deploying and operating ML inference systems at scale (real-time streaming... 
    Senior
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    3 days ago
  • The Role As a Senior Machine Learning Engineer, you will bridge the gap between raw computer vision and physical...  ...: Bridge the gap between AI inference and parametric CAD modeling for automated...  ...advancements into our systems. Production ML: Work with our engineering team to... 
    Senior

    Hike Medical

    Boston, MA
    2 days ago
  •  ...a unique opportunity to lead the development of large-scale recommendation systems for enterprise clients. In this role, you will manage engagements from requirements gathering to delivery, focusing on adapting and fine-tuning recommendation models using advanced architectures... 
    Senior

    Somi AI

    Cambridge, MA
    2 days ago
  • $172k - $229k

     ...Senior Machine Learning Engineer, Data Mining Boston, MA February 10, 2026 At Motional, we're transforming...  ...that matter most. Omnitag, our ML-powered multimodal data mining framework...  ...accuracy while drastically reducing inference latency and memory footprint.... 
    Senior
    Work at office
    Remote work

    Venturefizz Product Management Community

    Boston, MA
    3 days ago
  • A multinational technology company is seeking a Sr. Machine Learning Engineer in Cambridge to advance AI and create intelligent voice-based experiences. You'll be responsible for optimizing distributed data processing for speech recognition and collaborating with engineering... 
    Senior

    Apple Inc.

    Cambridge, MA
    3 days ago
  • $131.1k - $163.88k

    A leading logistics company is seeking a Manager of Data Science & AI to lead a team focused on developing and deploying AI solutions....  ...skills. The role includes defining MLOps strategies and mentoring engineers, with an annual salary ranging from $131,100 to $163,875. Join... 

    XPO Logistics, Inc.

    Boston, MA
    2 days ago
  • $216k - $324k

    A tech company in Boston is seeking a Senior Engineering Manager to lead multiple teams in the development of orchestration systems for customer communications. The role demands over 10 years of software engineering experience and 5 years of management experience. Key... 
    Senior

    Klaviyo Inc.

    Boston, MA
    4 days ago
  • $140k - $175k

    A growing robotics company seeks a Senior Machine Learning Engineer to drive innovation in their perception stack. This role involves designing multi...  ...strong Python and PyTorch skills, and a passion for deploying ML solutions in physical environments. The expected salary... 
    Senior

    Pickle Robot

    Boston, MA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Inference Engineering Manager. Be the first to apply!