Senior ML Ops Engineer
$190k - $210kFranklin Fitch
Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | Boston (Hybrid)
A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation.
This role is focused on building secure, scalable AI infrastructure that supports real enterprise deployment.
Responsibilities:
- Deploy NLP, OCR, and multimodal AI models in secure cloud environments
- Design scalable ML pipelines with strong observability, reliability, and performance
- Build data schemas and ETL workflows for annotations, training, tuning, and benchmarking
- Establish best practices in experiment tracking, model versioning, and reproducibility
- Write high-quality, maintainable production code
- Build internal AI tools to support engineering and product teams
- Identify and mitigate technical risks early in the release cycle
Requirements:
- 8–10+ years total engineering experience
- 4+ years in MLOps, SRE, DevOps, ML Platform, or similar
- Strong background in AI data modeling, versioning, and annotation workflows
- Recent experience delivering scalable enterprise AI products
- Familiarity with MLflow, LangChain, LangFuse, W&B, CrewAI, or similar frameworks
- Understanding of monitoring, experiment comparison, and evaluation frameworks
- Experience with multiple database technologies
- Strong communication skills and comfort in cross-functional environments
- Preference for candidates with a mix of startup and tech-company experience
- Heavy big-bank or Fortune 500 backgrounds are less aligned
Why This Role:
- High-impact AI work in a complex, meaningful domain
- Early-stage ownership with influence over AI architecture and engineering culture
- Competitive compensation, equity, benefits, and flexible time off
- Flat structure and direct access to leadership
Location: Boston area (hybrid). Local candidates preferred.
$95.3k - $158.8k
...Are you a collaborative Machine Learning Ops Engineer looking to work for a mission driven global... ...landscapes. About the role, as a Senior Machine Learning Engineer you'll work on... ...confidentiality. Key Responsibilities ML & LLM Engineering, Search and Recommendation...SeniorLocal area$178.5k - $290.5k
Roku, Inc. is seeking a senior Machine Learning Engineer to lead the AI-native transformation of its advertising business operations. This role involves... ...impactful solutions, designing and shipping production ML systems, and collaborating with various stakeholders. The...Senior- ...Machine Learning Engineer Architect, build, and operate end-to-end ML pipelines for training, validation and deployment on Google Cloud and AWS. Define,... ...related field. 5+ years of experience as a AI/ML Ops, DevOps, Infrastructure Engineer or equivalent. Expert...Suggested
- Medium, a Silicon Valley startup, seeks an experienced AI/ML Ops Engineer in Boston. The role involves building and operating end-to-end ML pipelines on Google Cloud and AWS. Candidates should have 5+ years' experience and expert-level skills in Python and TypeScript. This...Suggested
$170.6k - $261.3k
...understand the world! The Data Labeling Engineering team designs, builds, and operates hybrid... ...engineering, data engineering, and AI/ML, defining the strategies, tooling, and quality... ...AV stack Work with partner teams (ML, Ops, Product, Data Science, other platform...SeniorLocal areaRemote workWork from homeFlexible hours- A pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves developing model optimization algorithms, managing deployment pipelines, and collaborating on deep learning research. Qualified...Senior
- A leading financial technology company is looking for a Senior Staff Machine Learning Engineer to drive strategic machine learning initiatives. This pivotal role demands over 10 years of experience in ML systems, technical leadership, and expertise in tools like PyTorch...SeniorRemote workFlexible hours
- ...Regular Toilet in Boston is seeking experienced Machine Learning Engineers to tackle unique challenges in advancing medicine. This role... ...will have a Master’s degree and 3-4 years of experience in AI and ML, and proficiency in Deep Learning frameworks and Python. PathAI...Senior
$133.5k - $212k
...Position Overview We are looking for a Senior Machine Learning Engineer to build the core Machine Learning... ...patterns that enable other teams to build ML- and LLM-powered experiences... ...reach out to us via email at talent-ops@iterable.com upon receiving a suspicious...SeniorContract workLocal areaImmediate startRemote workWorldwideHome officeFlexible hours$189k - $290k
Zoox in Boston is looking for an engineer to join the Scene Understanding team. This role involves developing advanced Vision-Language-Action (VLA) models to enhance the safety of self-driving robots. Collaborating with top engineers, you'll work on real-time algorithms...Senior$162.5k - $286.4k
A leading technology company is seeking a passionate Senior Machine Learning Engineer to enhance the online shopping experience through innovative algorithms. The role involves building scalable, production-ready solutions and mentoring junior team members. Candidates...Senior$174.19k - $287.41k
Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine...Senior$242k - $290k
Zoox is seeking a Perception Engineer in Boston, Massachusetts, to design and implement advanced detection models using fused sensor data for autonomous vehicles. The role involves training ML models, collaborating with teams, and documenting outcomes to deploy models in...Senior- A leading medical technology company in Boston seeks a Senior Machine Learning Engineer to develop 3D reconstruction models and integrate AI inference into CAD systems. This role requires expertise in 3D data, proficiency in Python and PyTorch, and a PhD in a relevant...Senior
- Foundation EGI, located in Boston, Massachusetts, is seeking a skilled AI/ML Ops Engineer to design and implement end-to-end machine learning pipelines on Google Cloud and AWS. The candidate will collaborate across teams, ensuring high performance and availability of systems...
$229k - $317k
Zoox is looking for an engineer in the Offline Driving Intelligence (ODIN) team in Boston, MA, to develop advanced multimodal large language models that enhance environmental understanding for their robotaxi platform. The ideal candidate will have a MS or PhD in Computer...Senior- Somi AI in Cambridge, Massachusetts, is offering a unique opportunity to lead the development of large-scale recommendation systems for enterprise clients. In this role, you will manage engagements from requirements gathering to delivery, focusing on adapting and fine-tuning...Senior
- A leading open-source enterprise software provider is seeking a Senior Engineering Manager to lead a team in developing cutting-edge AI solutions. You will be responsible for setting strategic vision, managing software engineering teams, and engaging with open-source communities...Senior
- I did my part and supported the Regular Toilet is looking for a Staff Engineer to lead the development of LLM observability product features. You will shape product direction and apply your deep understanding of AI systems to solve open-ended problems. This role is crucial...Senior
- A multinational technology company is seeking a Sr. Machine Learning Engineer in Cambridge to advance AI and create intelligent voice-based experiences. You'll be responsible for optimizing distributed data processing for speech recognition and collaborating with engineering...Senior
$140k - $180k
...Summary of Position: he Cloud Data Ops team is hiring a Senior Cloud DBA & Data Platform Engineer who brings deep, hands-on DBA expertise across SQL Server, Postgres (w/Timescale) and Oracle, combined with strong cloud-native skills in GCP and AWS. This role is responsible...Senior$140k - $175k
A growing robotics company seeks a Senior Machine Learning Engineer to drive innovation in their perception stack. This role involves designing multi... ...strong Python and PyTorch skills, and a passion for deploying ML solutions in physical environments. The expected salary...Senior$140k - $175k
Pickle Robot Company is seeking a Senior Machine Learning Engineer based in Boston. The role focuses on revolutionizing warehouse automation through advanced perception stacks and deploying robust vision models. The ideal candidate has 5+ years of experience in computer...Senior- ASUSTeK Computer Inc. is seeking a Senior Machine Learning Engineer in Boston, MA to lead the design and development of advanced computer vision and perception systems. The ideal candidate will have at least 8 years of experience in machine learning, specifically in computer...Senior
- Hubspot is seeking a Senior Machine Learning Engineer II to develop AI experiences in Cambridge, Massachusetts. This role focuses on designing robust backend systems that enable efficient context retrieval for AI assistants. Ideal candidates will have proven Java expertise...SeniorRemote job
- Autodesk, Inc. is looking for a Senior Machine Engineer, ML Systems and Infrastructure to design scalable systems for machine learning. This role focuses on building infrastructure for large-scale data pipelines and production ML workflows. The ideal candidate has experience...SeniorRemote job
$286.2k - $326.7k
...leading financial services firm is seeking a Sr. Distinguished Machine Learning Engineer who will drive technical strategies for personalizing product experiences. This role involves building robust ML systems and collaborating with cross-functional teams on advanced...SeniorRemote work$120.12k - $214.5k
A leading healthcare technology organization is seeking a lead AI/ML Engineer to enhance patient care through innovative AI systems. This role involves designing scalable AI platforms, mentoring other engineers, and collaborating with a diverse team. Flexibility to work...SeniorRemote work- ...the contracts are signed, and now they need to build. Their engineering team is small, exceptionally talented, and working on problems... ...across an expanding network of health system clients, they need a Senior AI/ML Engineer who can take ownership of complex technical...SeniorRemote work
- A leading consulting firm is seeking a motivated Sr Lab Tech Ops based in Somerville, MA to support oligonucleotide development. This position involves purification and characterization of oligonucleotides and ensuring compliance with cGMP standards. Key responsibilities...SeniorLong term contract
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Ops Engineer. Be the first to apply!
- senior ml engineer Boston, MA
- machine learning ai engineer Boston, MA
- computer vision machine learning engineer Boston, MA
- machine learning software engineer Boston, MA
- ai ml engineer Boston, MA
- machine learning engineer Boston, MA
- senior game producer Boston, MA
- senior manager process engineering Boston, MA
- senior manufacturing engineer Boston, MA
- senior manager clinical operations Boston, MA

