Senior ML Engineer: AI Inference & Performance Optimizer
Nebius
Nebius in Palo Alto is seeking a Senior MLE to own end-to-end model and endpoint optimization. You will work at the intersection of distributed systems, GPU performance, and production ML engineering, debugging serving problems and delivering measurable improvements with minimal supervision. You will deploy and optimize LLM/VLM backends, quantify latency and cost, and collaborate with researchers, kernel engineers, and platform teams to push the performance frontier of AI workloads. #J-18808-Ljbffr Nebius
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior ML Engineer: AI Inference & Performance Optimizer in Palo Alto, CA vacancy
$195.2k - $262.2k
...infrastructure for the global AI economy. We are... ...large in-house AI/ML infrastructure. Built by engineers, for engineers.... ...orchestration to inference optimization, we own the hard... ...systems, GPU performance, model training frameworks... ...engineering. A Senior MLE owns...SeniorPerformanceTemporary workImmediate startRemote work$250k - $350k
About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate... ...experiences at scale.You will design and optimize inference pipelines, implement state-of-the-...PerformanceWork at office3 days per weekPika
Palo Alto, CA2 days ago- ...centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads...SeniorPerformance
- ...seeking a seasoned software engineer to advance our compute... ...will shape compiler support, performance tuning, and NN inference on our high-performance... ...hardware and model teams to optimize neural networks, improve compiler... ..., and apply agentic AI techniques to production...SeniorPerformance
- ...smart technology company, seeks a qualified engineer to advance VLA inference and model quantization for next-gen XPENG Turing AI chip. You will develop production-grade... ...The role focuses on PTQ and QAT workflows, performance benchmarking, and validating models in real...SeniorPerformance
$179k - $223k
...Autonomy stack. In this Senior ML Engineer role, you will play a... ...includes training, optimizing and shipping auto-... ...definition, evaluation, model performance optimization,... ...edge deployment, cloud inference architectures, and... ...jurisdictions. How We Use AI in Our Hiring Process...SeniorPerformanceFull timeContract workLocal area$124.5k - $272k
...for the cloud and AI era. We secure... ..., its Zero Trust Engine, and the powerful... ...control without performance trade-offs.At Netskope... ...are available at Senior Staff and above.... ..., you own the inference and optimization layer that makes... ...years hands-on in ML/AI (model development...SeniorPerformanceNetskope
Santa Clara, CA2 days ago- Wayve is building the leading AI platform for autonomous driving with a mapless... ...approach. This role focuses on performance engineering across ML systems, GPU compute and distributed... ...optimisations for training and cloud inference. You will profile workloads, implement...SeniorPerformance
$228k - $285k
...Summary As a Staff Software Engineer for ML Optimization and Hardware Acceleration,... ...LLMs, VLMs, LDMs and high-performance hardware execution. You... ..., or BLAS subroutines) for inference logic. Experience with profiling... .... How We Use AI in Our Hiring Process: To ensure...SeniorPerformanceFull timeContract workLocal areaRivian
Palo Alto, CA1 day ago$262k - $364k
...the development of advanced AI-generated content (AIGC)... ...feedback to improve the overall performance of the AIGC stack.Drive end... ...and budgeting predictions.Optimize ML inference and resolve system-level... ...:Master’s degree or PhD in Engineering, Computer Science, or a related...SeniorPerformanceGoogle
Mountain View, CA2 days ago$213k - $263k
...architect and create high-performance custom silicon; we... ...we design and optimize hardware and... ...report to a Software Engineering Manager. You will... ...Leverage agentic AI to accelerate analysis... ...neural network inference platform through... ...experience working with ML inference or...SeniorPerformanceFull timeRemote work$184k - $287.5k
...the generative AI revolution! The... ...Algorithmic Model Optimization Team... ...models for maximal inference efficiency using... ...by research and engineering teams alike developing... ...looking for a Senior Deep Learning... ...improving high-performance kernel... ...PyTorch, and related ML tools (e.g. HuggingFace...SeniorPerformanceFull timeNvidia
Santa Clara, CA7 days ago$262k - $364k
...Senior Staff ML Software Engineer, AI Generated Content Quality, Search Discover Feed... ...major surfaces, ensuring optimal user experience at a massive... ...signals to enhance model performance for over 4 billion users.... ...predictions. Optimize ML inference and resolve system-level...SeniorPerformanceGoogle Inc.
Mountain View, CA1 day ago- ...Member of Technical Staff, ML Inference Engineering Sanas is pioneering the... ...'s first real-time speech AI platform capable of accent... ...for a deeply hands-on, senior engineer to help lead that... ...working alongside them. Performance Optimization Optimize system and GPU...Performance
Sanas
Palo Alto, CA1 day ago $195k - $230k
...powered by advanced AI, recommendation... ...looking for a Senior Machine Learning Engineer to help evolve... ...multi-objective optimization to balance engagement... ...training online inference A/B... ...drift, and system performance in production.AI... ...-scale data and ML systems (e.g., Spark...SeniorPerformanceFull timeLocal areaWork from homeNews Break
Mountain View, CA2 days ago$230k - $265k
...deploy cutting-edge AI technology to... ...responsible for ML and work alongside... ...veteran scientists and engineers. As a Senior Machine Learning... ...to scale and optimize our ML systems—creating... ...-training, and inference strategies for... ...in model performance, robustness, observability...SeniorPerformancePermanent employmentOtter.ai
Mountain View, CA6 days ago- ...backbone of Atlassian’s Agentic AI Integration Products : The... ...and enterprise users.ML performance, quality, and systems acumen... ...discovery, context and response optimization, observability, automated evals... ...7+ years of software engineering experience building and operating...SeniorPerformanceWork at office
Atlassian
Mountain View, CA5 days ago $173k - $253k
Matterport - Senior ML Ops Engineer Job Description CoStar... ...in enhancing the performance, efficiency, and scalability... ..., applying advanced optimization techniques, and... ..., optimize inference speed and resource utilization... ..., and efficient AI.Contribute to the continuous...SeniorPerformanceFull timeWork at officeWork from homeMatterport
Sunnyvale, CA5 days ago$188.5k - $282.7k
...SAGE, Rubrik's Semantic AI Governance Engine, which is the first system... ...further.As an Applied ML Engineer on the SAGE team... ...fine-tuning, preference optimization (DPO/RLAIF), and... ...patterns.Engineering High-Performance Model Serving and Inference Infrastructure (25% of time...SeniorPerformancePermanent employmentRubrik
Palo Alto, CA5 days ago- ...generation agentic AI - goal-directed,... ...looking for a Senior Machine Learning Engineer to lead the... .... The AI models perform various tasks for... ...engine constraints, optimizing for latency,... ...planning and goal inference frameworks for NPCs... ...evaluation, and ML/AI safety within...SeniorPerformanceWork at officeWorldwide
LE130 Unity Technologies SF
Mountain View, CA3 days ago - Peano AI is seeking a Founding Large-Scale Mid-Training/RL Infrastructure Engineer to design and scale our in-house training stack for massive... ...with thousands of GPUs/TPUs, optimize pretraining and RL pipelines, and push the performance envelope for end-to-end training...SeniorPerformance
- JPMorgan Chase in Palo Alto seeks an experienced Senior Machine Learning Engineer in Digital Intelligence to advance LLM-based solutions... ...-to-production work, scalable training, and optimization of model performance in a fast-paced environment within the Digital Intelligence...SeniorPerformance
- ...Software Engineer Applied Intuition, Inc. is powering... ...future of physical AI. Founded in 2017 and now... ...deep experience in optimizing ML models and deploying them... ...Will: Drive ML performance optimization on... ...and latency of model inference for compute boards selected...PerformanceFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift
Applied Intuition
Sunnyvale, CA1 day ago $210.3k - $273.4k
...SF is hiring a Senior Machine Learning Engineer to help build foundational... ...agentic AI systems inside... ...world modeling, and ML/AI safety . You... ...constraints , optimizing for latency , compute... ...and goal inference for NPCs and simulations... ...usability, and performance across platforms...SeniorPerformanceWork at officeWorldwide- ...a research lab and inference provider focused on realtime AI for consumer-facing... ...make a case.Inference Optimization. Deep understanding... ...decoding.High-Performance Systems. Proficiency... ...to major inference engines, or deep-dive technical... ...backend or ML systems.Who Thrives...PerformanceFull timeWork at officeRelocation package
Inworld AI
Mountain View, CA4 days ago $193.3k - $261.5k
...is looking for a Senior Software Development Engineer to own the... ...implementation of our inference data plane. We... ...developing high-performance compute kernels,... ...who can write and optimize low-level code... ...kernels for a custom ML accelerator... ...early adopter of AI-assisted development...SeniorPerformanceLocal areaFlexible hoursAmazon
Cupertino, CA5 days ago$193.93k - $352.29k
...profound opportunity for AI to drive positive... ...investors.About the RoleThe ML Infrastructure team is... ...building to deploying the optimized models on Nuro’s fleet... ...an in-house ML inference platform to serve large... ...with a high standard for performance, scalability, and code...SeniorPerformanceImmediate startFlexible hoursNuro
Mountain View, CA3 days ago$144.7k - $261.3k
...cloud infrastructure, and ML/AI GPU platforms for AV research... ...GM is looking for a Senior Performance Engineer to join the AV Capacity and... ...budget, identify and execute optimization projects, and provide... ...large‑scale ML training and inference environments. Your skills...SeniorPerformanceWork at officeLocal areaRemote workWork from homeFlexible hours3 days per weekGeneral Motors LLC
Sunnyvale, CA5 days ago- Role Overview As our Senior Staff Software Engineer, ML infra Engineer for Search & Discovery... ..., consolidate and optimize the Search & Discovery... ...ranking system and online ML inference services Build strong... ...structures, algorithms, performance complexity, and implications...SeniorPerformanceTemporary workFlexible hours
- Google LLC in Mountain View, CA is seeking a Senior Software Engineer specializing in AI/ML for Ads Retrieval and Resource Efficiency Optimization. You will work on large-scale systems, deploying models and optimizing performance in a fast-paced environment. The role...SeniorPerformance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Engineer: AI Inference & Performance Optimizer. Be the first to apply!
Related searches
- senior ml engineer Palo Alto, CA
- machine learning ai engineer Palo Alto, CA
- machine learning software engineer Palo Alto, CA
- ai ml engineer Palo Alto, CA
- machine learning engineer Palo Alto, CA
- computer vision machine learning engineer Palo Alto, CA
- senior living Palo Alto, CA
- senior associate vice president Palo Alto, CA
- senior app developer Palo Alto, CA
- senior manufacturing engineer Palo Alto, CA