Senior MLOps Engineer
United IT Solutions
Tittle: Senior MLOps Engineer (LLM / Agentic Systems) Location: Cupertino, CA / Austin, TX (Onsite) Role Overview
We are seeking a Senior MLOps Engineer to build and scale intelligent, data-driven platforms for next-generation AI systems. This role focuses on developing LLM-powered applications, agentic workflows, and robust evaluation systems that enable faster insights, improved diagnostics, and reliable large-scale AI deployments. Key Responsibilities:
• Build and deploy LLM-powered applications and agentic workflows in production
• Design automated evaluation frameworks for measuring LLM performance and detecting regressions
• Integrate AI/ML models into scalable backend systems and pipelines
• Run ML experiments and apply statistical analysis to validate improvements
• Develop and maintain distributed systems for large-scale inference
• Optimize systems for latency, cost, and reliability (caching, batching, prompt tuning)
• Implement guardrails, fallbacks, and monitoring for AI systems
• Work with streaming pipelines and async orchestration for real-time processing Required Qualifications:
• 3+ years of experience in backend or distributed systems engineering
• Strong programming skills in Python
• Working knowledge of Go, TypeScript, or Rust
• Experience shipping production AI/LLM systems at scale
• Hands-on experience building agentic systems (agents, tools, or workflows) Strong understanding of:
We are seeking a Senior MLOps Engineer to build and scale intelligent, data-driven platforms for next-generation AI systems. This role focuses on developing LLM-powered applications, agentic workflows, and robust evaluation systems that enable faster insights, improved diagnostics, and reliable large-scale AI deployments. Key Responsibilities:
• Build and deploy LLM-powered applications and agentic workflows in production
• Design automated evaluation frameworks for measuring LLM performance and detecting regressions
• Integrate AI/ML models into scalable backend systems and pipelines
• Run ML experiments and apply statistical analysis to validate improvements
• Develop and maintain distributed systems for large-scale inference
• Optimize systems for latency, cost, and reliability (caching, batching, prompt tuning)
• Implement guardrails, fallbacks, and monitoring for AI systems
• Work with streaming pipelines and async orchestration for real-time processing Required Qualifications:
• 3+ years of experience in backend or distributed systems engineering
• Strong programming skills in Python
• Working knowledge of Go, TypeScript, or Rust
• Experience shipping production AI/LLM systems at scale
• Hands-on experience building agentic systems (agents, tools, or workflows) Strong understanding of:
- Token limits and cost optimization
- Prompt design and structured outputs
- API rate limits and failure handling
- Experience with LLM evaluation methods and challenges (non-determinism, quality measurement)
- Strong knowledge of AWS, GCP, or Azure
- Hands-on experience with Docker and Kubernetes
- Experience with agent orchestration frameworks (Lang Graph, Crew AI, etc.)
- Knowledge of guardrails, fallback strategies, and safe AI systems
- Experience with streaming inference and async systems
- Familiarity with ML observability tools (Lang fuse, Arize, W&B, Braintrust)
- Experience with retrieval systems (vector search, hybrid search)
- Strong focus on performance optimization and cost efficiency
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior MLOps Engineer in Cupertino, CA vacancy
- ...Senior MLOps Engineer (LLM / Agentic Systems) We are seeking a Senior MLOps Engineer to build and scale intelligent, data-driven platforms for next-generation AI systems. This role focuses on developing LLM-powered applications, agentic workflows, and robust evaluation...Senior
- ...Job Description Job Description Role: Senior LLMOps / MLOps Engineer(23382-1) Location: Santa Clara, CA Onsite Requirement – Yes Number of days onsite – 5 days Must Have Skills Skill 1 – Strong proficiency in Python and software engineering best practices...Senior
- ...Hey Team, Hope all is well, have a remote opportunity with Walmart It is for an MLOPS Engineer The big thing is where they are coming from in terms of environment, looking for people that are Individual contributors Work time is in PST Remote...SuggestedLocal areaRemote work
- ...MLOps Engineer Our client is expanding a high performance AI infrastructure environment that supports large scale machine learning workloads for enterprise and emerging AI applications. They are seeking an experienced MLOps Engineer to help build, automate, and optimize...Suggested
- ...MLOps Engineer Duration: 12+ Months Location: Sunnyvale CA - hybrid Rate: DOE Key Responsibilities: Design and implement scalable model serving platforms for both batch and real-time inference Build model deployment pipelines with automated testing and...Suggested
- ...) EngineerLocationSunnyvale, CA (Work from Office)Primary SkillsMLOps, Ray , GPU , Python ScriptingMLOps (Ray Engineer)Experience: 3-5 Years .Job Role - MLOPS Engineer (RAY ENGINEER)Objective : MLOPS Engineer with experience in Ray & GPU configuration for engineering &...Full timeWork at officeRemote work
- ...from development to deployment. You will work closely with ML engineers and software developers across Intuitive to ensure that machine... ...Experience ~3+ years of experience in infrastructure, DevOps, or MLOps roles, or equivalent practical experience ~ Demonstrated...SeniorFull timeLocal areaWorldwideFlexible hours
- ...scale. It sits at the intersection of Generative AI, Information Retrieval, and Knowledge Graphs. We're looking for a senior machine learning engineer to own the conversational intelligence layer: the agent's reasoning and tool-calling, the low-latency LLM inference...Senior
$174.72k - $295.68k
...transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are looking for a full-time Machine Learning Engineer - AI Foundation, with deep knowledge and strong enthusiasm towards establishing a state-of-art ML infrastructure for training very...SeniorFull time$224k - $356.5k
...of computers, robots and self-driving cars that can perceive and understand the world.We are now looking for an extraordinary Senior Engineer to develop and productize NVIDIA’s autonomous driving solutions. As a member of our prediction team, you will be driving solutions...SeniorOdd jobFull timeWork experience placement$224k - $356.5k
NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache Spark is the most popular data processing engine in data centers for running massive scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning...SeniorFull time$184k - $287.5k
...self-driving cars, Nvidia provides the DRIVE AGX hardware platform which runs our DRIVE software.We are looking for a Senior ML Localization Engineer for Autonomous Vehicles to join us. While reliance on maps has been significantly reduced, available maps continue to help...SeniorFull timeNight shift$184k - $287.5k
...video analytics and perception solutions for smart cities, industrial automation, and autonomous systems at scale. We seek a Senior ML Engineer to compose and deliver next-generation Metropolis solutions powered by Cosmos, NVIDIA's world foundation model platform. Your...SeniorFull time$184.7k - $324.8k
...perspective. We achieve this daily by collaborating at the intersection of natural language processing, machine learning, and software engineering.We are responsible for the machine learning and software (non-UI) development for several user-facing Apple Intelligence features...SeniorRelocation$202k
...systems that power real-time driver pricing for billions of rides. Engineers on the team work on cutting-edge marketplace ML problems and... ...stakeholders and receive close mentorship from the most senior engineers within the organization, setting you up for fast-tracked...SeniorFull timeWork at officeRemote workWorldwide$150.4k - $277.6k
...next generation of our retrieval systems to sustain the growth of the business for the future. We are looking for a Machine Learning Engineer that will develop the algorithms for our retrieval system.In this role you will drive step-change improvements in our outcomes,...SeniorRelocation$184.7k - $324.8k
Role Number: 200649539Team: Machine Learning and AI, Software and ServicesLocation: CupertinoWeekly Hours: 40Posted: 2026-08-12SummaryAt Apple, we focus deeply on our customers’ experience. Apple Ads brings this same approach to advertising, helping people find exactly ...SeniorRelocation$216.2k - $324.8k
...CupertinoWeekly Hours: 40Posted: 2026-07-27SummaryAs a Machine Learning Engineer, you will design and build cutting-edge AI/ML systems that... ...such as TensorFlow, PyTorch, or scikit-learn.Familiarity with MLOps practices including model versioning, CI/CD pipelines, and...SeniorWorldwideRelocation$184.7k - $324.8k
...user's emails, messages, events, files, and more, while keeping personal data private.DescriptionWe are looking for a senior Machine Learning Engineer with a passion for building scalable, high quality solutions to evaluate personalized agentic search applications. In...SeniorWork experience placementRelocation$150k - $200k
...autonomy, Plus is looking for talented individuals to join its fast-growing teams.We are seeking a highly skilled Machine Learning Engineer with deep expertise in developing Bird’s Eye View (BEV) fusion models using multimodal sensor inputs, particularly LiDAR. You will...SeniorFull time$184.7k - $324.8k
...applied machine learning team behind interactive intelligent features like Scribble, Math Notes, and Smart Script. We're looking for an engineer who can work from multimodal foundation models to on-device optimization, and who's passionate about shipping technologies that...SeniorRelocation$187.5k - $364k
...organization at NVIDIA deploys and operates modern GPU high performance computing systems for NVIDIA researchers. We are seeking a senior engineer for our MLOps team: expert in HPC and computational machine learning who work alongside researchers to dig into their requirements,...SeniorFull timeRemote workEarly shift- ...like the da Vinci surgical system and Ion—have transformed how care is delivered for millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one purpose: to make surgery smarter, safer, and more human. Every day, our work helps care...SeniorLocal areaImmediate startWorldwideFlexible hours
$184.7k - $324.8k
...scale. It sits at the intersection of Generative AI, Information Retrieval, and Knowledge Graphs.We're looking for a senior machine learning engineer to own the conversational intelligence layer: the agent's reasoning and tool-calling, the low-latency LLM inference behind...SeniorRelocation$184.7k - $324.8k
...for someone to help us do extraordinary things.We are looking for a passionate, highly motivated, and hands-on applied Senior Machine Learning Engineer. This role will assist our Online Retail Decision Automation team by helping to research and develop the next...SeniorWork experience placementRelocation$143k - $286k
...PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary: The Senior Machine Learning Engineer will lead the design, development, and deployment of... .... The position requires expertise in model evaluation, MLOps practices, and secure AI engineering. The successful...SeniorFull timeTemporary workPart timeWork experience placement$184.7k - $324.8k
...new standards for enabling effective advertising while protecting user privacy.Ads ML Experimentation team is looking for a Senior ML Engineer to build the next generation of software platforms and systems to advance experimentation that connect millions of global users...SeniorTemporary workImmediate startRemote workRelocation$173k - $253k
Matterport - Senior ML Ops Engineer Job Description CoStar Group is a leading global provider of commercial and residential real estate information... ..., appraisal, and marketing.About the Role:As a Senior MLOps Engineer at Matterport, a part of CoStar Group, you will be...SeniorFull timeWork at officeWork from home$114.6k - $234.6k
Job-ID: 344281Category: Product and ResearchLocation: United States; Seattle, WA, United States; Santa Clara, CA, United States; Austin, TX, United States; Nashville, TN, United StatesSchedule: Full timePosted: 2026-09-10Role: Individual ContributorJob Type: Regular EmployeeDoes...SeniorTemporary workFlexible hoursShift work$184.7k - $277.6k
...expect from Apple. Because when advertising is done right, it benefits everyone.The Ads ML Experimentation team is looking for a ML Engineer who can build full-stack applications to help shape the future of how Apple's advertising systems experiment to connect millions...SeniorRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior MLOps Engineer. Be the first to apply!
Related searches
- senior living Cupertino, CA
- senior full stack web developer Cupertino, CA
- senior chief engineer Cupertino, CA
- senior magento developer Cupertino, CA
- senior physical design engineer Cupertino, CA
- senior application support engineer Cupertino, CA
- senior software design engineer Cupertino, CA
- senior devops cloud engineer Cupertino, CA
- senior international tax analyst Cupertino, CA
- senior cloud engineer Cupertino, CA





