Senior ML Infrastructure Engineer - Online Inference
Jobleads-US
Unity Enterprise is seeking a Senior ML Engineer to design and evolve an online inference platform for production ML models. You will build reliable infrastructure for serving models, optimize inference performance, and enable safe experimentation across high-traffic systems.
Collaboration with ML engineers and platform teams will be crucial to deploy, monitor, and iterate models at scale. You will lead architectural improvements, design canary and A/B rollout strategies, and drive
#J-18808-Ljbffr Jobleads-US- ...enterprise grade search infrastructure. Powering search and... ...determine where new ML capabilities can... ...technical roadmap for online retrieval, index serving... ...query processing, and ML inference. Turn advances in... ...fragmented systems, mentor senior engineers, and align technical...SeniorOnlineWork at officeLocal area
- ...and deliver top-notch technology products.As a Senior Lead Software Engineer - ML Engineer for Agent Platform at JPMorgan Chase within... ...-style) and policy engines (OPA/Rego)Evaluation infrastructure for agents — offline/online evals, regression suites, and LLM-as-judge...SeniorOnline
- ...Senior Lead Software Engineer - ML Engineer for Agent Platform Be an integral part of an agile team that... ..., the memory layer, and evaluation infrastructure Executes creative software... ...infrastructure for agents — offline/online evals, regression suites, and LLM-as...SeniorOnline
- ...Senior ML Platform Engineer Collaborative. Respectful. A place to dream and do. These are just a... ...the team's objective to scale our ML infrastructure and empower data teams to deliver high... ...with SageMaker Feature Store for online and offline feature management Experience...SeniorOnlineRelocation package
$191.25k - $225k
...working at Coinbase . Senior Machine Learning Platform Engineer As a Senior Machine... ...Engineer on the ML Platform team within... ...the foundational infrastructure that powers feature... ...and highly available inference services, directly... ...streaming pipelines, online serving systems, or...SeniorOnlineFull timeLocal area$142.3k - $263.3k
...love. The Apple Services Engineering (ASE) organization... ...operates the systems and infrastructure that power Apple's... ...training and fine-tuning, inference optimization and... ...We are looking for an ML engineer who is excited... ...Iceberg, Delta, Lance), and online stores (e.g. Redis,...SeniorOnlineRelocation$147.05k - $230.85k
## Senior Machine Learning Platform Engineer — Model Hosting & MLOpsApply: Spring... ...to build the infrastructure and engineering workflows... ...a secure, scalable inference service. The work... ...hosting for custom ML and AI models across... ...tradeoffs such as online versus batch inference...SeniorOnlineFull timeTemporary workRelocationFlexible hoursShift work$173k - $253k
Matterport - Senior ML Ops Engineer Job Description CoStar Group is a... ...information, analytics, and online marketplaces. Included in... ...performance, optimize inference speed and resource utilization... ...of MLOps practices and infrastructure for model deployment and monitoring...SeniorOnlineFull timeWork at officeWork from home- **The Role**We are seeking a Senior ML engineer to design and evolve Unity Vector’s online model inference platform. This role focuses on building reliable infrastructure for serving machine learning models in production, optimizing inference performance, and enabling safe...SeniorOnlineWork at officeWorldwide
$161.3k - $274.2k
...California in 2004 when a visionary engineer, Fred Luddy, saw the... ...You Will DoWe are looking for Senior Machine Learning engineers to... ...the ranking, product, design, infrastructure and data science teams to drive... ..., or are unable to use this online application and need an...SeniorOnlineWork at officeRemote workFlexible hours- ...Trajectory is seeking an ML Infrastructure Engineer to build the platform that powers training, inference, and kernels for next‑gen AI systems. You will own distributed training, low‑latency serving, and GPU‑kernel optimizations, shaping reusable systems that scale in...
- ...Mach9 Robotics Inc. is seeking an ML infrastructure engineer to build and maintain systems powering production AI models for civil engineering... ...You will manage training pipelines, data generation, and inference that integrates with CAD software. The role targets mid...
$262k - $364k
...implement advanced offline and online quality evaluation... ...budgeting predictions.Optimize ML inference and resolve system-level bottlenecks... ...with industry-scale ML infrastructure (e.g., model deployment,... ...:Master’s degree or PhD in Engineering, Computer Science, or a...SeniorOnline$207.4k - $278.1k
...Technology is a global organization of engineers, product developers, designers... ...Platform across all of Disney online properties, including Hulu and... ...scalable, high impact AI/ML and data science solutions... ...ad serving. We are seeking a Senior Manager Machine Learning to join...SeniorOnline- Zensors in San Francisco seeks an AI/ML Infrastructure Engineer to build and optimize scalable AI inference infrastructure for real-time video analytics. You will evolve the engine powering our visual sensing platform, accelerate training and inference for CV models, and...
- ...ServiceNow is hiring a Senior Staff (DevOps) Machine Learning Engineer to lead architecture, optimization, and operational excellence of the AI inference platform. You will own the end-to-end lifecycle—from onboarding models to deploying optimized inference engines in...Senior
- ...Amazon Inc. in Seattle, WA is seeking a Sr. Software Development Engineer for the Inference Team on AWS Neuron to deliver high-performance model inference for customer workloads on Inferentia- and Trainium-powered instances. You will lead customization of open-source...Senior
- ...NVIDIA Corporation is seeking a Senior Machine Learning Applications and Compiler Engineer to advance end-to-end inference optimization across NVIDIA platforms. You will work at the intersection of large-scale systems, compilers, and deep learning to map neural network...Senior
$160k - $240k
Senior ML Platform Engineer - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10050078... ...design seamless workflows for continuous model training, inference, and monitoringWork with AI experts to understand workflows...SeniorTemporary workFor contractorsWork experience placement- ...intelligence with scalable deployment. We’re seeking a senior leader to drive performance across ML workloads, GPUs and distributed systems, partnering... ..., and help define hardware strategy for training and inference, enabling faster models and safer vehicles. #J-1880...Senior
- ...Avride is seeking a software engineer with leadership experience to drive the ML infrastructure layer across the company. You will lead GPU inference optimization for onboard and high-throughput offboard scenarios, while guiding broader ML infrastructure across pipelines...
- ...AfterQuery is building a research lab focused on ML inference and GPU kernel engineering, covering inference serving systems, kernel optimization, and deployment infrastructure for large models. This is research-and-evaluation work, not production engineering, defining...SeniorRemote jobHourly pay
$176.76k - $232k
...Core responsibilities As a Senior AI/ML Engineer, you will lead the delivery... ...system design for serving AI/ML inference solutions in production.... ...and experimentation infrastructure, evaluation systems, production... ...evaluation workflows, and online experiment platforms in partnership...SeniorOnlinePermanent employmentFull timeContract workPart timeWork visa- ...lab exploring AI frontiers through novel datasets and experimentation. We are building a cohort of senior ML researchers focused on inference and GPU kernel engineering to define criteria for correctness and excellence on real-world problems. This fully remote, contract...SeniorContract workRemote workFlexible hours
- ...ServiceNow is seeking a Senior Staff Machine Learning Engineer (DevOps) to lead architecture, optimization, and operations of our AI inference platform in a production Kubernetes environment. You will own the end-to-end lifecycle from onboarding models to deploying optimized...Senior
- ...New York City, NY, is seeking a Sr. Machine Learning Engineer to join the Foundation Model Inference team within Cloud OS & Inference. You will help... ..., and scalable tooling. The role requires hands-on ML infrastructure experience and a track record in large-scale...Senior
$135 per hour
...experimentation. We believe great AI comes from exceptional, human-generated data. This remote, contract role focuses on ML inference and GPU kernel engineering. Competitive hourly pay ($135/hr) based on experience, with a broader range ($100–$170/hr) and a flexible,...SeniorRemote jobHourly payContract workFlexible hours- ...We are looking for a Senior Data Scientist - Experimentation & Causal Inference to serve as the statistical... ...will NOT be building infrastructure or writing backend services — our platform engineering team handles that.... ...and analyzing online controlled experiments...SeniorOnlineFull time
- .... Team Overview The Ads ML Platform team builds infrastructure that accelerates high-scale... .... Our systems help ML engineers move faster across the full... ...reliably. We are looking for a Senior Staff Machine Learning... ...expand into serving and online experimentation workflows...SeniorOnlineFull timeWork at officeRemote workFlexible hours
$119.8k - $234.7k
...Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind... ...for Microsoft's over 200 online businesses including Bing,... ...industry-leading AI training and inference capabilities. The Platform... ...systems. Translate AI/ML workload requirements into...SeniorOnlineOngoing contractWork at officeLocal areaWorldwide3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Infrastructure Engineer - Online Inference. Be the first to apply!
- senior mulesoft developer Kentucky
- senior business manager Kentucky
- senior mainframe developer Kentucky
- senior level Kentucky
- senior network engineer remote Kentucky
- senior manager product development Kentucky
- senior implementation engineer Kentucky
- senior manager creative operations Kentucky
- senior medical science liaison Kentucky
- senior manager m&a tax Kentucky




