Senior ML Systems Engineer Inference Optimization (Remote)
CAST AI Group
CAST AI, a Miami-headquartered AI platform, seeks an experienced ML systems engineer to optimize the inference stack across multi-GPU clusters. You’ll tune loaders, schedulers, and KV caches to improve throughput, latency, and cost per token. You’ll work with SGLang, vLLM, TensorRT-LLM, PyTorch, and CUDA tooling, handling large checkpoints and distributed setups. The role offers a remote-first global environment and equity options. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Engineer Inference Optimization (Remote) in Doral, FL vacancy
- ...ferment them with good engineering. We started inside... ...ourselves. Kimchi Inference One API line and a... ...the inference stack’s optimization, whatever it takes, and... ...You’ve built real ML systems for 5+ years, and your... ...Enjoy a flexible, remote-first global environment...Remote workSeniorLocal areaAll shiftsFlexible hours
CAST AI Group
Miami, FL4 days ago $150k - $220k
...processed more than 20 billion inference requests. We closed a $100M... ...depend on. We're a small, remote-first team. We take... ...developers . We're looking for a ML Systems Engineer, Inference. We want Runpod... ...Experience with modern inference optimization techniques such as...Remote workSeniorFull time$195.2k - $262.2k
...large in-house AI/ML infrastructure. Built by engineers, for engineers. From... ...orchestration to inference optimization, we own the hard... ...intersection of distributed systems, GPU performance,... ...engineering. A Senior MLE owns... ...secondary caregivers. Remote work reimbursement...Remote workSeniorTemporary workImmediate start- ...Leading the effort to optimize LLM inference performance, the full-time Senior ML Systems Engineer will measure, diagnose, and improve serving efficiency for large models in a remote environment. Key responsibilities Define and build tooling for measuring inference performance...Remote workSeniorFull time
Virtual Vocations Inc
United States5 days ago - ...Amazon is seeking a Senior Software Development Engineer to own the design and implementation of the inference data plane for large models on custom... ...end-to-end, and drive optimizations across CPU, GPU, and hardware... ...will integrate backends into ML serving frameworks,...Senior
Amazon
Cupertino, CA4 days ago - ...At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure... ...concurrency serving systems, benchmarking and tuning inference engines, and partnering with senior ML engineers to deploy open-source LLMs. #J-1...Remote work
Atlassian
Seattle, WA3 days ago - At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems from distributed infrastructure... ...workloads. You will collaborate with senior ML engineers to fine-tune and deploy open-...Senior
$295k
...who are building AI systems. We believe that... ...team of researchers, engineers, designers, and... ...’re looking for a senior engineer to help build... ...the full stack of ML systems, this role... ...data pipeline optimization, sharded datasets,... ...role can be based remotely or from one of our...Remote workSeniorFull timeWork at officeLocal areaHome officeCohere
New York, NY8 days ago$236k - $330k
...gets done.We are looking for talented systems developers and researchers to join... ...the state of the art in LLM inference systems and optimization.Our mission is to build the next generation... ...tuning. We embrace AI-native engineering, using AI not only as the workload...SeniorSnowflake
Bellevue, WA5 days ago- ...DigitalOcean is seeking a Senior Engineer 2 to drive AI Inference Optimization. You will lead benchmarking and optimizations at the inference engine and GPU kernel levels, and guide the technical roadmap for high-performance inference fleets. Bring 5+ years of HPC or...Remote workSenior
DigitalOcean
San Francisco, CA3 days ago - ...Intel Corporation is seeking a Senior AI Systems Software Engineer to accelerate AI inference on Intel GPUs and shape optimization across the software stack. You will lead performance improvements for LLMs, Generative AI, and related workloads, collaborating across hardware...Senior
Intel
Folsom, CA11 hours ago - ...low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads. This role is in the...Senior
- ...deployment and developer experience. The role focuses on unifying inference features into robust, distributed abstractions and... ...in Los Altos, CA; onboarding in our Los Altos office, or remote options for senior staff. Competitive compensation and strong benefits accompany...Remote workSeniorWork at office
Modular Services
Los Altos, CA4 days ago - ...measure Quantize, prune and optimize inference where latency carries a... ...research into production with engineering and trading teams STACK... ....0 Industry experience in ML roles, with hands-on post-training... ...looking for a contract or remote work. You must be...Remote workSeniorFull timeContract workShift work
Thurn Partners
Miami, FL5 days ago $272.7k - $356.03k
...Senior Principal Machine Learning Systems Engineer, Search Platform Engineering | Seattle... ...United States or Remote | New York, United... ...where new ML capabilities can meaningfully... ..., and ML inference. Turn advances in... ...and hardware-aware optimization. Lead step-change...Remote workSeniorWork at officeLocal areaAtlassian Corp.
New York, NY4 days ago- Nebius in Palo Alto is seeking a Senior MLE to own end-to-end model and endpoint optimization. You will work at the intersection of distributed systems, GPU performance, and production ML engineering, debugging serving problems and delivering measurable improvements with...Senior
$170.6k - $261.3k
...hardware and battery systems to intuitive... ...scale.As a Senior Machine Learning Engineer on the State Estimation... ...and improve the ML perception model... ...training and inference pipelines, including model optimization techniques (e.g.... ...management for ML. Remote: This role is...Remote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Sunnyvale, TX7 days ago$206.1k - $269.08k
...Engineering | San Francisco, United States | Remote, Remote Atlassians can choose where... ...build the evaluation systems, datasets, quality... ..., and production ML capabilities that reveal... ...you’ll do As a Senior Machine Learning... ...architecture, and inference; balancing quality...Remote workSeniorWork at officeLocal areaAtlassian Corp.
San Francisco, CA4 days ago$174.9k - $261.3k
...understand the world!The Data Labeling Engineering team designs, builds, and... ..., data engineering, and AI/ML, defining the strategies,... ...leadership, and direct impact on systems that unblock the next generation... ..., United States of America; Remote - United StatesType: Full timeRemote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Sunnyvale, CA3 days ago- ...of their business systems through natural language... ...’ Reasoning Engine and natural language... ...cutting edge ML infrastructure for... ...critical in building, optimizing and scaling end-to... ...training and inference pipeline for large... ...personas (flexible, remote, or required in office...Remote workSeniorPermanent employmentWork at officeFlexible hours
Moveworks
Mountain View, CA5 days ago $250k - $350k
About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI... ..., ensuring our creative AI systems deliver industry-leading user experiences... ...experiences at scale.You will design and optimize inference pipelines, implement...Work at office3 days per weekPika
Palo Alto, CA4 days ago$170.1k - $258.3k
...capable fully self-driving systems, to move us toward... ..., and performance engineering so that every cycle on... ...of our on‑vehicle ML inference for ADAS and autonomous... ...profiling, debugging and optimizing accelerator libraries... ...States of America; Remote - Washington; Austin,...Remote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
San Francisco, CA3 days ago- ...Anthropic is seeking a Senior ML Engineer to join the Core Systems team to optimize training and inference infrastructure for the Claude family of foundation models. You will design high-performance distributed pipelines and work with researchers to remove scaling bottlenecks...Senior
AI Breaking Wire
San Francisco, CA3 days ago - ...Member of Technical Staff to build the ML systems that make sustained AI research... ...workloads. The work goes beyond deploying an inference engine: you will understand its internals,... ...throughput, memory, and cost. Profile and optimize the full execution path, from Python...Full time
Bake AI Inc.
San Mateo, CA4 days ago - ...a Machine Learning Systems Administrator / DevOps Engineer, you will maintain... ...model training and our inference cloud. You’ll split... ...(e.g., VSCode remote development, Docker... ...Prior work supporting ML/AI infrastructure,... ...management and workload optimization Experience...Remote workWork at officeRelocation package
Zyphra
San Francisco, CA3 days ago - General Motors is seeking a Senior Engineer for the Embodied AI Scaling Foundations team to measure and visualize AV model performance at... ...based metrics, end-to-end simulation, and scalable workflows. Remote work is supported with travel as needed. #J-18808-Ljbffr General...Remote jobSenior
$200k - $250k
...Senior ML Performance Engineer | $200-250K salary + equity | Early-stage ML Infrastructure. 30-50 employees... ...seeking a seasoned ML Performance Optimization Specialist to spearhead the... ...deployment of high-performance, scalable ML inference pipelines for a key early-stage...Seniorwell-funded deeptech startup
California4 days ago- General Motors, through Embodied AI, seeks a Senior Engineer to measure and visualize AV model... ...evaluation with real-world behavior. This remote role offers opportunities to influence... ...of next‑generation autonomous systems and to contribute to a cohesive evaluation...Remote jobSenior
$173k - $253k
...Matterport - Senior ML Ops Engineer Matterport, a part of CoStar Group,... ...analyze model performance, optimize inference speed, and ensure seamless... ...Familiarity with version control systems (e.g., Git) and agile... ...4 days on-site and 1 day remote. This position offers...Remote workSeniorWork at officeCoStar Group
Sunnyvale, CA4 days ago- ...Unity is seeking a Senior ML engineer to design and evolve Unity Vector’s online model inference platform. You will build reliable infrastructure... ...ML models in production, optimize inference performance, and... ...across high-traffic systems. You will work with ML engineers...Senior
Unity
Salem, OR3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Engineer Inference Optimization (Remote). Be the first to apply!
Related searches
- senior living Doral, FL
- senior associate vice president Doral, FL
- senior property accountant Doral, FL
- senior performance engineer Doral, FL
- senior aws cloud engineer Doral, FL
- senior manager Doral, FL
- senior associate attorney Doral, FL
- senior manager diversity & inclusion Doral, FL
- senior living sales and marketing Doral, FL
- senior marketing project manager Doral, FL