Senior Machine Learning Platform Engineer — Model Hosting & MLOps
$147.05k - $230.85kJobleads-US
- # Senior Machine Learning Platform Engineer — Model Hosting & MLOpsApply: Spring, Texas, United States of America: Tlaquepaque, Jalisco, Mexico: Full time: Posted Yesterday: 3169199Senior Machine Learning Platform Engineer — Model Hosting & MLOps**Description -****Role summary**We are hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that take custom models from development into reliable production use. This is a hands-on role for someone who has hosted LLMs on GPU infrastructure, developed the cloud platform around model serving, and built MLOps pipelines that make releases repeatable and observable.You will work with model developers, application engineers, security, and cloud platform teams to turn a model artifact into a secure, scalable inference service. The work spans serving architecture, infrastructure as code, deployment automation, model lifecycle management, and production operations across AWS and Azure, with potential integration into on-premises environments. You will also help shape agent workflows that use hosted models, so serving choices support the needs of multi-step applications. Success means teams can deploy, update, monitor, and troubleshoot models through clear, reusable platform patterns.**What you will do*** Design and build hosting for custom ML and AI models across AWS and Azure, with particular focus on GPU-backed LLM inference and real-time endpoints; support batch inference where appropriate.* Package models and their dependencies into reproducible serving workloads; choose and implement suitable managed services, containers, or Kubernetes-based patterns based on throughput, latency, security, reliability, and cost.* Provision and configure Kubernetes clusters or other suitable hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking integration, observability, and environment configuration.* Help design secure connections and deployment patterns between cloud and on-premises environments as hosting needs evolve.* Develop infrastructure as code and deployment automation so model-hosting environments can be provisioned, reviewed, promoted, and maintained consistently.* Build MLOps workflows for model registration, versioning, validation, release, rollback, and retirement. Connect training or model preparation to deployment through automated pipelines and appropriate quality gates.* Partner with application teams to design and prototype agent workflows, including model and tool orchestration, state handling, failure recovery, and evaluation.* Translate agent workload patterns into hosting decisions about model selection, context length, concurrency, latency, cost, tool access, and end-to-end tracing.* Establish production monitoring for service health, latency, throughput, errors, GPU and other resource use, and model behavior. Share responsibility for diagnosing incidents and improving capacity, reliability, and cost.* Create reusable deployment templates, reference architectures, documentation, and onboarding paths that help other teams ship models safely.* Partner with model and application teams on practical tradeoffs such as online versus batch inference, managed versus self-hosted serving, scaling, evaluation, data handling, and operational ownership.**Required experience*** Hands-on experience hosting LLM inference on GPU infrastructure in a production environment. You can explain what you personally built, how models reached production, and how you managed throughput, latency, utilization, reliability, and cost.* Experience building the surrounding model-serving platform for custom models, such as inference runtimes, deployment patterns, endpoint access, scaling, and operational tooling.* Strong software engineering skills, especially Python, with experience building services, automation, and maintainable production code.* Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other. You have used infrastructure as code such as Terraform or an equivalent tool.* Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads.* Experience building or operating ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion, and rollback.* Familiarity with LLM agent patterns, including model invocation, tool calls, and multi-step workflows, and how they affect serving capacity, reliability, and access controls.* Working knowledge of production concerns for inference services: scaling, latency, availability, logging and metrics, shared incident response, access control, and cost.* Ability to work across model development, application, platform, and security teams; turn ambiguous requirements into a working design; and document the resulting operational approach.**Helpful experience*** Advanced GPU inference optimization, including capacity planning, batching, autoscaling, memory use, model loading, and performance tuning.* Serving generative or other compute-intensive custom models beyond LLMs; selecting and tuning inference servers and runtime configurations.* AWS SageMaker or EKS; Azure Machine Learning or AKS; or equivalent managed and self-hosted model platforms.* Hybrid or on-premises model hosting, including connectivity, security boundaries, hardware constraints, and operational handoff.* Model registries, experiment tracking, data or feature pipelines, scheduled retraining, model evaluation, and drift or quality monitoring.* Secure enterprise deployment patterns such as private networking, IAM/RBAC, secrets management, auditability, and handling sensitive data.* Building shared ML platform capabilities or self-service workflows used by multiple engineering teams.* Hands-on development of agent workflows, including tool integration, evaluation, tracing, or guardrails.**Who will thrive here**You are an engineer who has taken responsibility for what happens after a model is trained: how it is packaged, deployed, secured, scaled, observed, updated, and supported. You are comfortable writing code and infrastructure, investigating production failures, and making clear tradeoffs with partner teams.**Pay & Benefits**The pay range for this role is $147,050 to $230,850 USD annually with additionalopportunities for pay in the form of bonus and/or equity (applies to UnitedStates of America candidates only). Pay varies by work location, job-relatedknowledge, skills, and experience.Benefits:HP offers a comprehensive benefits package for this position, including:* Health insurance* Dental insurance* Vision insurance* Long term/short term disability insurance* Employee assistance program* Flexible spending account* Life insurance* Generous time off policies, including;* 4-12 weeks fully paid parental leave based on tenure* 11 paid holidays* Additional flexible paid vacation and sick leave* US benefits overview compensation and benefits information is accurate as of the date of thisposting. The Company reserves the right to modify this information at any time,with or without notice, subject to applicable law.**Job -**Software**Schedule -**Full time**Shift -**No shift premium (United States of America)**Travel -**No**Relocation -**No
- J-18808-Ljbffr Jobleads-US
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Machine Learning Platform Engineer — Model Hosting & MLOps in Kentucky vacancy
- ...Hewlett Packard Co. is seeking a Senior Machine Learning Platform Engineer to design and operate hosting for custom ML models across AWS and Azure. You will package models,... ...reproducible serving workloads, and build scalable MLOps pipelines for model registration,...Senior
- ...Upstart, a digital-first AI lending platform, seeks a Senior Software Engineer for the ML and Simulations Platform. You will build an MLOps platform to support model inference, automation, deployment, and observability, and help create a marketplace simulation platform...SeniorRemote jobFlexible hours
- Booz Allen Hamilton is seeking an MLOps Engineer to help design and build a cloud-based ML platform for IC missions. You will implement and refine CI/CD workflows, containerized services, and scalable data pipelines using AWS, Kubernetes, and serverless technologies. A...Senior
$292.5k - $409.5k
...Who We Are: The Machine Learning Platform team at Reddit is a... ...You’ll Do: As a Senior Staff Software Engineer, you will help define... ..., and operating model that enable teams across... .../externally hosted LLM, rate/token limit... ...evolution. Drive MLOps and LLMOps standards...SeniorRemote jobFor contractorsWork experience placementFlexible hours$200k - $250k
...For homeowners, our platform is a reliable way to... ...seeking an exceptional Senior Machine Learning Engineer to join our Data... ...leveraging predictive models to enhance our... ...and architect robust MLOps practices to ensure... ...models, including self-hosted large language models...SeniorWork experience placementWorldwideFlexible hoursAngi
Eastern, KY17 hours ago- ...Ignite IT Hub is seeking a senior MLOps Engineer to support reliable operation and controlled improvement... ...tools. Version and trace code, model identifiers, prompts, configurations,... ...systems or automated data-processing platforms. ~ Strong AWS and Linux experience,...SeniorContract workWork at officeFlexible hours
Ignite IT, LLC
Eastern, KY4 days ago - ...Angi is seeking an exceptional Senior Machine Learning Engineer to join our Data Science and Machine Learning... ...a pivotal role in transforming our platform into a world-class online... ...search ranking and leveraging predictive models to enhance our product and consumer...Senior
- Pennant Solutions Group is seeking a Senior Machine Learning Engineer in Richmond, VA to design, develop, and... ...production-grade ML pipelines and MLOps practices, mentoring teammates and shaping... ...with AWS SageMaker, transformer models, and scalable ML architectures, with...SeniorWork at office
- ...Reddit is seeking a Senior ML Infrastructure Engineer to lead the design and development of a platform for large-scale ML models. You will drive end-to-end ML lifecycle patterns, enabling efficient data prep, model management, and experiment tracking across a distributed...Senior
- ...Serko is hiring a Senior Full Stack Engineer to own the end‑to‑end development of next‑gen AI products. The role focuses on building an internal platform, dashboards, and tooling that empower our AI engineers. You will work from Washington or California, partnering...Senior
$244k - $305k
...born in 2007 when two hosts welcomed three guests... ...Join: The Growth Platform team’s vision is to drive... ...Will Make: As a machine learning engineer or scientist, your... ...We’re seeking a Senior Staff Engineer who thrives... ...decision-making to model-driven intelligence,...SeniorRemote jobWork experience placementCasual workLive inWork at officeShift work- ...Cogniify, Inc. seeks a Senior AI/ML Engineer to lead the design and delivery of production-grade ML systems and drive the maturity of ML engineering and MLOps capabilities. You will own critical ML workstreams end to end and mentor engineers while collaborating with...Senior
- ...Senior Machine Learning Engineer Position Type: Full-Time/Onsite in Richmond, VA... ...Processing applications and robust MLOps practices. The ideal... ...machine learning models with emphasis on NLP applications... ...Pipelines, MLflow, or similar platforms #J-18808-LjbffrSeniorFull timeRemote work
Pennant Solutions Group
Eastern, KY4 days ago - ...Job Summary We are seeking a Senior Machine Learning Engineer to help lead the design and validation... ...Python and large language models (LLMs) to solve complex legal workflows... ..., and cloud-based AI platforms. Establish MLOps best practices for model deployment...Senior
Compunnel
Eastern, KY4 days ago $130k - $160k
...currently has an opportunity for a Senior Machine Learning Engineer. Candid’s Data Science and AI team builds... ...and ships machine learning and AI models across many concurrent projects. The... ...systems were a primary responsibility (MLOps, ML engineering, or production-ML-...SeniorTemporary workSummer workLocal areaRemote workMonday to FridayFlexible hoursCandid
Eastern, KY4 days ago- Akamai Technologies is seeking an ML Senior Software Engineer to build and operate systems for model validation, quantization, and safety across the AI lifecycle. You will develop pipelines to scan models for vulnerabilities, apply quantization and optimization, and enforce...SeniorFlexible hours
$155k - $185k
...Carbon Mapper, Inc. Senior Machine Learning Engineer Remote·Full time Help ensure our core data products... ...deploy deep learning and machine learning models for remote sensing imagery analysis,... ...at scale. Solid understanding of MLOps practices and demonstrated experience...SeniorFull timeWork at officeRemote workCarbon Mapper, Inc.
Eastern, KY4 days ago- Zof AI seeks an experienced MLOps Engineer to own the platform for AI systems, spanning model serving, scaling, and reliability. You will push the platform that enables... ..., observability, and cost control. As a senior on-site engineer in San Francisco, you will design...Senior
- ...Candid is seeking a Senior ML Engineer to take operational ownership of deployed ML/AI services, ensuring reliable production performance and... ...reliability. You will build observability dashboards, manage model versioning and artifact handling, and work closely with...Senior
- ...transformative care model helps people recover... ...integrated, AI-powered platform combining the highest... ...looking for an experienced Senior AI/ML Engineer to spearhead the... ..., and evaluate deep learning, classical ML, and foundational... ...using modern MLOps frameworks....SeniorRemote job
- Apple Inc. in Seattle is seeking a senior Platform Engineer to design and deliver systems that integrate Large Language Models into Apple Intelligence and Private Cloud Compute. You will architect distributed components, ensure reliability, and enable teams to deploy ML...Senior
- ...Twin Health is seeking an ML Ops Engineer to help design and scale our cutting-edge ML platform for metabolic health. You will build backend distributed systems,... ...engineering. You’ll work with Docker/Kubernetes, MLOps, and GenAI/LLMs to deliver reliable AI solutions for...SeniorRemote job
$211k - $249k
...product, the NodeZeroTM platform, delivers... ...operators, startup engineers, and formerly frustrated... ...we are a team of learn it alls, committed... ...You'll Do As a Senior Machine Learning Engineer... ...our defensive models into production and... ...routing, and with self‑hosted or customer‑hosted...SeniorRemote jobFull timeWork at officeFlexible hours- ...Employee Relations Associates, Inc. seeks a Senior ML Ops Engineer to support machine learning initiatives within Pricing and... ...with Data Scientists to productionize models, build pipelines, and deploy ML solutions using cloud platforms. The ideal candidate has strong...SeniorRemote job
- ...We are looking for a Senior ML Ops Engineer to support machine learning initiatives within Pricing and Merchandising... ...Scientists to take machine learning models and move them into production.... ...AI , AWS SageMaker, or similar platforms. Work closely with Data Scientists...SeniorTemporary workRemote work
$266k - $372.4k
.... We’re looking for a Senior Staff Machine Learning Engineer to lead Reddit’s next-generation... ...across the platform. This role requires deep... ...expertise in mainstream ML user modeling approaches (e.g., large-... ..., and integration with MLOps systems. Drive Cross-Team...SeniorRemote jobFor contractorsWork experience placementImmediate startShift work$184.35k - $270.39k
...the country. Our Engineering and Analytics Team... ...leads complex modeling initiatives and drives... ...innovation in machine learning and data science. The Senior Manager designs and... ...science tools and platforms Present insights... ...cloud platforms and MLOps tools ~...SeniorRemote jobCasual workH1bWork at officeWork from home$248k - $310k
...born in 2007 when two hosts welcomed three... ...You Will Join: Machine Learning and Artificial Intelligence... ...various AI models, ML services and tools... ...Will Make: As a senior staff machine learning engineer, you will be responsible... ...to Airbnb’s ML platform architecture and...SeniorRemote jobWork experience placementCasual workLive inWork at office$244k - $305k
...in 2007 when two hosts welcomed three guests... ...community and platform from fraud while... ...community. Trust Engineering is responsible for... ...state-of-art in Machine Learning to continually build... ...Make: As a senior technical... ...architectural and modeling challenges, and raising...SeniorRemote jobWork experience placementCasual workLive inWork at office$180k - $240k
...Senior/Staff Software Engineer (Platform and Execution Model) Seattle, WA (Preferred) or McLean, VA or Remote (USA) About... ...the core execution model (state machine, lifecycle, resource model, failure... ...development and continued learning. ~ Optional 401K, FSA, and equity...SeniorRemote jobFull timeShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning Platform Engineer — Model Hosting & MLOps. Be the first to apply!
Related searches
- senior mulesoft developer Kentucky
- senior business manager Kentucky
- senior mainframe developer Kentucky
- senior level Kentucky
- senior network engineer remote Kentucky
- senior manager product development Kentucky
- senior implementation engineer Kentucky
- senior manager creative operations Kentucky
- senior medical science liaison Kentucky
- senior manager m&a tax Kentucky