Senior Machine Learning Platform Engineer Model Hosting & MLOps
$147.05k - $230.85kHewlett-Packard Company
- # Senior Machine Learning Platform Engineer — Model Hosting & MLOpsApply: Spring, Texas, United States of America: Tlaquepaque, Jalisco, Mexico: Full time: Posted Yesterday: 3169199Senior Machine Learning Platform Engineer — Model Hosting & MLOps**Description -****Role summary**We are hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that take custom models from development into reliable production use. This is a hands-on role for someone who has hosted LLMs on GPU infrastructure, developed the cloud platform around model serving, and built MLOps pipelines that make releases repeatable and observable.You will work with model developers, application engineers, security, and cloud platform teams to turn a model artifact into a secure, scalable inference service. The work spans serving architecture, infrastructure as code, deployment automation, model lifecycle management, and production operations across AWS and Azure, with potential integration into on-premises environments. You will also help shape agent workflows that use hosted models, so serving choices support the needs of multi-step applications. Success means teams can deploy, update, monitor, and troubleshoot models through clear, reusable platform patterns.**What you will do*** Design and build hosting for custom ML and AI models across AWS and Azure, with particular focus on GPU-backed LLM inference and real-time endpoints; support batch inference where appropriate.* Package models and their dependencies into reproducible serving workloads; choose and implement suitable managed services, containers, or Kubernetes-based patterns based on throughput, latency, security, reliability, and cost.* Provision and configure Kubernetes clusters or other suitable hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking integration, observability, and environment configuration.* Help design secure connections and deployment patterns between cloud and on-premises environments as hosting needs evolve.* Develop infrastructure as code and deployment automation so model-hosting environments can be provisioned, reviewed, promoted, and maintained consistently.* Build MLOps workflows for model registration, versioning, validation, release, rollback, and retirement. Connect training or model preparation to deployment through automated pipelines and appropriate quality gates.* Partner with application teams to design and prototype agent workflows, including model and tool orchestration, state handling, failure recovery, and evaluation.* Translate agent workload patterns into hosting decisions about model selection, context length, concurrency, latency, cost, tool access, and end-to-end tracing.* Establish production monitoring for service health, latency, throughput, errors, GPU and other resource use, and model behavior. Share responsibility for diagnosing incidents and improving capacity, reliability, and cost.* Create reusable deployment templates, reference architectures, documentation, and onboarding paths that help other teams ship models safely.* Partner with model and application teams on practical tradeoffs such as online versus batch inference, managed versus self-hosted serving, scaling, evaluation, data handling, and operational ownership.**Required experience*** Hands-on experience hosting LLM inference on GPU infrastructure in a production environment. You can explain what you personally built, how models reached production, and how you managed throughput, latency, utilization, reliability, and cost.* Experience building the surrounding model-serving platform for custom models, such as inference runtimes, deployment patterns, endpoint access, scaling, and operational tooling.* Strong software engineering skills, especially Python, with experience building services, automation, and maintainable production code.* Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other. You have used infrastructure as code such as Terraform or an equivalent tool.* Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads.* Experience building or operating ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion, and rollback.* Familiarity with LLM agent patterns, including model invocation, tool calls, and multi-step workflows, and how they affect serving capacity, reliability, and access controls.* Working knowledge of production concerns for inference services: scaling, latency, availability, logging and metrics, shared incident response, access control, and cost.* Ability to work across model development, application, platform, and security teams; turn ambiguous requirements into a working design; and document the resulting operational approach.**Helpful experience*** Advanced GPU inference optimization, including capacity planning, batching, autoscaling, memory use, model loading, and performance tuning.* Serving generative or other compute-intensive custom models beyond LLMs; selecting and tuning inference servers and runtime configurations.* AWS SageMaker or EKS; Azure Machine Learning or AKS; or equivalent managed and self-hosted model platforms.* Hybrid or on-premises model hosting, including connectivity, security boundaries, hardware constraints, and operational handoff.* Model registries, experiment tracking, data or feature pipelines, scheduled retraining, model evaluation, and drift or quality monitoring.* Secure enterprise deployment patterns such as private networking, IAM/RBAC, secrets management, auditability, and handling sensitive data.* Building shared ML platform capabilities or self-service workflows used by multiple engineering teams.* Hands-on development of agent workflows, including tool integration, evaluation, tracing, or guardrails.**Who will thrive here**You are an engineer who has taken responsibility for what happens after a model is trained: how it is packaged, deployed, secured, scaled, observed, updated, and supported. You are comfortable writing code and infrastructure, investigating production failures, and making clear tradeoffs with partner teams.**Pay & Benefits**The pay range for this role is $147,050 to $230,850 USD annually with additionalopportunities for pay in the form of bonus and/or equity (applies to UnitedStates of America candidates only). Pay varies by work location, job-relatedknowledge, skills, and experience.Benefits:HP offers a comprehensive benefits package for this position, including:* Health insurance* Dental insurance* Vision insurance* Long term/short term disability insurance* Employee assistance program* Flexible spending account* Life insurance* Generous time off policies, including;* 4-12 weeks fully paid parental leave based on tenure* 11 paid holidays* Additional flexible paid vacation and sick leave* US benefits overview compensation and benefits information is accurate as of the date of thisposting. The Company reserves the right to modify this information at any time,with or without notice, subject to applicable law.**Job -**Software**Schedule -**Full time**Shift -**No shift premium (United States of America)**Travel -**No**Relocation -**No
- J-18808-Ljbffr Hewlett-Packard Company
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Senior Machine Learning Platform Engineer Model Hosting & MLOps in Eastern, KY vacancy
- Booz Allen Hamilton is seeking an MLOps Engineer to help design and build a cloud-based ML platform for IC missions. You will implement and refine CI/CD workflows, containerized services, and scalable data pipelines using AWS, Kubernetes, and serverless technologies. A...Senior
- ...Ignite IT Hub is seeking a senior MLOps Engineer to support reliable operation and controlled improvement... ...tools. Version and trace code, model identifiers, prompts, configurations,... ...systems or automated data-processing platforms. ~ Strong AWS and Linux experience,...SeniorContract workWork at officeFlexible hours
Ignite IT, LLC
Eastern, KY1 day ago - ...are looking for a highly skilled MLOps Engineer to support the end-to-end machine learning lifecycle, from experimentation... ...teams to deliver production-ready models efficiently and confidently.... ...distributed workloads Contribute to platform design for low-latency inference...Senior
Hard Rock International
Eastern, KY1 day ago - Pennant Solutions Group is seeking a Senior Machine Learning Engineer in Richmond, VA to design, develop, and... ...production-grade ML pipelines and MLOps practices, mentoring teammates and shaping... ...with AWS SageMaker, transformer models, and scalable ML architectures, with...SeniorWork at office
- Serko is hiring a Senior Full Stack Engineer to own the end‑to‑end development of next‑gen AI products. The role focuses on building an internal platform, dashboards, and tooling that empower our AI engineers. You will work from Washington or California, partnering with...Senior
- ...Senior Machine Learning Engineer Position Type: Full-Time/Onsite in Richmond, VA... ...Processing applications and robust MLOps practices. The ideal... ...machine learning models with emphasis on NLP applications... ...Pipelines, MLflow, or similar platforms #J-18808-LjbffrSeniorFull timeRemote work
Pennant Solutions Group
Eastern, KY1 day ago - Akamai Technologies is seeking an ML Senior Software Engineer to build and operate systems for model validation, quantization, and safety across the AI lifecycle. You will develop pipelines to scan models for vulnerabilities, apply quantization and optimization, and enforce...SeniorFlexible hours
- Zof AI seeks an experienced MLOps Engineer to own the platform for AI systems, spanning model serving, scaling, and reliability. You will push the platform that enables... ..., observability, and cost control. As a senior on-site engineer in San Francisco, you will design...Senior
$130.2k - $195.3k
...positive mark on culture. We are seeking a Sr. ML Platform Engineer who is excited to deploy MLOps products that shape business strategy, optimize content... ...that will enable the Data Science team to deploy models at web scale data driving interactions with millions...SeniorPinehurst Senior Living
Eastern, KY5 days ago- Wayve in Sunnyvale is seeking a Staff/Senior Machine Learning Engineer to lead the technical direction of learned emergency manoeuvre prediction... ...detection. You will drive from problem definition through modelling, evaluation, integration, and deployment. You will join...Senior
- Apple Inc. in Seattle is seeking a senior Platform Engineer to design and deliver systems that integrate Large Language Models into Apple Intelligence and Private Cloud Compute. You will architect distributed components, ensure reliability, and enable teams to deploy ML...Senior
- Twin Health is seeking an ML Ops Engineer to help design and scale our cutting-edge ML platform for metabolic health. You will build backend distributed systems, lead... ...engineering. You’ll work with Docker/Kubernetes, MLOps, and GenAI/LLMs to deliver reliable AI solutions...SeniorRemote job
- ...was born in 2007 when two hosts welcomed three guests to their... ...protect our community and platform from fraud while also... ...Difference You Will Make As a Senior Machine Learning Engineer on the Trust team, you... ...from designing and training models to productionizing and...SeniorCasual workLive inWork at officeRemote work
$191.25k - $225k
...intense in-person working sessions called “surges.”learn more about working at Coinbase. Senior Machine Learning Platform Engineer As a Senior Machine Learning Platform Engineer... ...that powers feature engineering, model training, and model serving across Coinbase. The...SeniorLocal area$184.7k - $324.8k
Senior machine learning platform engineer, Evaluation & Privacy Cupertino, California, United States Software and Services Imagine what you could do here... ...training, evaluating, and deploying machine learning models to production. 5+ years of industry experience. Master'...SeniorRelocation$171k - $198k
## Senior Data/Machine Learning EngineerApply: US - GA - Atlanta: Full... ...workflows, and the platforms that connect them. We... ...Learning and Data Engineering, you will lead the technical... ...solutions from data modeling and feature... ...and cost* Implement MLOps pipelines covering training...SeniorFull timeWork at officeRelocation$175k - $308.5k
...generative AI, where data and model workflows come together to... ...optimized, and scaled. We develop a platform for ML data and features... .... We’re looking for engineers and researchers passionate about... ...Strong foundation in machine learning, with hands‑on experience across...SeniorRelocationFlexible hoursApple
Eastern, KY4 days ago$225k - $300k
.... We’re building the AI intelligence platform that restores humanity to healthcare... ...getting started. The Role: As a Senior Machine Learning Engineer at Ambience , you will build and... ..., deploying, and iterating on model and agentic systems. This is a highly...SeniorWork at officeRemote workFlexible hours3 days per weekAmbience Healthcare, Inc.
Eastern, KY4 days ago- ...while transforming your career. Senior Machine Learning Engineer What you will do Let’s do this... ...product managers, business stakeholders, platform teams, and AI software engineers to... ...the technical bar for the team by modeling strong engineering practices,...SeniorFlexible hours
Amgen SA
Eastern, KY4 days ago $230k - $310k
...For homeowners, our platform is a reliable way to... ...an exceptional Staff Machine Learning Engineer to join our Data Science... ...predictive models to enhance our product... ...and architect robust MLOps practices to ensure the... ...models, including self-hosted large language models...Work experience placementWorldwideFlexible hoursAngi
Eastern, KY2 days ago- ...Zof AI is seeking a MLOps Engineer to own the platform our AI systems run on. This is a consolidated platform... ...LLMOps, and agent platform engineering: model serving and scaling, GPU and compute... ...above its weight. Engineering · Senior · Full-time · On-site · San Francisco...Full time
Zof AI
Eastern, KY1 day ago $99k - $225k
...MLOps Engineer**The Opportunity:**Are you looking for an opportunity... ...why we need an experienced machine learning (ML) engineer like you to help... ...and architect an MLOps platform in the cloud that shortens... ...workflows to manage datasets and model training, deployment, and...Full timeContract workPart timeBooz Allen Hamilton
Eastern, KY4 days ago- ...AKIVA is an AI-native engineering firm specializing in enterprise... ...trains, deploys, and monitors machine learning models in production. Own the CI/... ...layers of the AKIVA AI platform. Key Responsibilities... ...Qualifications ~3+ years in MLOps, platform engineering, or SRE...Long term contractTemporary work
AKIVA AI, LLC
Eastern, KY1 day ago - PathAI is seeking Machine Learning Engineers (Applied Research & Model Development) to tackle unique ML challenges in medicine. Work with biomedical data... ...science, product teams, translational research, MLOps, and platform engineering to build and deploy ML models for AI...SeniorRemote job
$200k - $300k
Senior/Principal Machine Learning Engineer Remote (United States) Status: Full-Time Compensation: $200,000 - $300... ...next-generation autonomous navigation platforms. The position requires deep... ...experience taking machine learning models from research and experimentation through...SeniorFull timeRemote work- ...thefirst continuous, non-invasive platform for gastro-intestinal health,... ...build the next foundational model for gut activity: aself-... ...physiological andcontextual streams, learning general-purpose... ...looking for 5+ years building machine learning systems in production...Senior
- ...build and optimize large-scale machine learning systems powering the next generation of AI models. You will work on training infrastructure... ...including ChatGPT and the API platform. Requirements 5+ years of experience in machine learning engineering Strong proficiency in Python...Senior
- Expedia Group is seeking a Senior Software Development Engineer for the ML Platform in Seattle. You will design and evolve scalable ML platform capabilities, enabling feature engineering, model inference, and observability across domains. You will deliver high-quality...Senior
$206.1k - $269.08k
Engineering | Mountain View, United States or Remote | Remote, Remote | San Francisco,... ...a legal entity. We are looking for a Senior Machine Learning Engineer to join our Confluence Cloud... ...techniques, particularly forecasting models, and solve challenging, high-impact problems...SeniorWork at officeLocal areaRemote work- ...Detection and Response platform to catch and remove... ...you won't just train models — you'll talk to customers... ...our CTO and Head of Machine Learning, you'll design and... ...technical bar. As a senior voice on a lean team,... ...of machine learning engineering experience , with meaningful...SeniorWork at officeRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning Platform Engineer Model Hosting & MLOps. Be the first to apply!
Related searches
- machine learning engineer Eastern, KY
- platform engineer Eastern, KY
- platform developer Eastern, KY
- senior business development Eastern, KY
- american senior communities Eastern, KY
- senior devops engineer remote Eastern, KY
- senior information technology project manager Eastern, KY
- senior vmware engineer Eastern, KY
- sr electrical engineer Eastern, KY
- sr marketing manager Eastern, KY