Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Systems Scientist: LLM/VLM Inference Expert

Nebius B.V.

Nebius Token Factory seeks a PhD-level researcher to lead focused ML research projects from hypothesis to production handoff. You will partner with MLEs to make prototypes production-ready and drive efficient LLM/VLM inference with measurable impact. The role emphasizes publishing results, sharing technical reports, and mentoring teams on rigorous experimental design and tradeoffs. You will operate at the intersection of research and production in Palo Alto. #J-18808-Ljbffr Nebius B.V.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Scientist: LLM/VLM Inference Expert in Palo Alto, CA vacancy
  • $195.2k - $262.2k

     ...large in-house AI/ML infrastructure. Built...  ...orchestration to inference optimization, we...  ...Factory needs scientists who can turn frontier...  ...capabilities. A Senior Applied Scientist...  ...programs in efficient LLM and VLM inference with...  ...rigor, and model/system tradeoffs. Must-haves... 
    Senior
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    5 hours ago
  • Nebius is seeking a Senior Applied Scientist to turn frontier inference bottlenecks into production-ready solutions. You...  ...and PyTorch, and collaborate with ML engineers to ship research into production...  ..., and cost per token across LLM/VLM inference workloads. #J-18808-... 
    Senior

    Nebius

    Palo Alto, CA
    4 days ago
  • d-Matrix in Santa Clara, CA is seeking a Sr. Staff ML Researcher to advance LLM algorithmic optimization on our DNN accelerators. You will design and implement efficient inference algorithms, collaborating with mathematicians, ML researchers and engineers on high-impact... 
    Senior
    3 days per week

    Entrada Ventures

    Santa Clara, CA
    1 day ago
  • Netskope is seeking a Senior Staff Machine Learning Scientist in Santa Clara to own the inference and optimization layer for AI in agentic workflows. You will fine-tune...  ...optimization, and hardware acceleration, partnering with systems and backend engineers to ship end-to-end... 
    Senior

    Netskope

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...engineers to join us and build AI inference systems that serve large-scale models...  ...decoding, data/tensor/expert/pipeline-parallelism, prefill...  ...pareto frontier for the field of ML Systems; survey recent...  ...crowdExperience building and optimizing LLM inference engines (e.g., vLLM... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $183.83k - $275.98k

     ...on bringing advancements in the field of ML and large-scale learning to the AV domain...  ...towards a more end-to-end autonomous driving system.This role requires working with and...  ...working to improve model optimization and inference speeds. You will use your applied research... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  •  ...per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will do:...  ...a team of system software experts to build out the deployment...  ...closely with other software (ML and compilers) and hardware...  ...(such as TensorRT-LLM, vLLM, SGLang, etc.)Experience... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

     ...throughput, low-latency inference framework for serving...  ...accelerators feel like a single system at datacenter scale. As...  ...of cutting-edge LLM workloads.We are...  ...and memory pools.Mentor senior and junior engineers, set...  ...performance storage, or ML systems infrastructure... 
    Full time
    Local area
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $192.2k - $260k

     ...is assembling an elite team of world-class scientists and engineers to pioneer the next...  ...driven development tools. Join the Amazon Kiro LLM-Training team and help create groundbreaking...  ...and present your pioneering work at premier ML and NLP conferences (NeurIPS, ICML, ICLR ,... 
    Senior
    Work at office
    Local area
    Worldwide
    Flexible hours

    Amazon

    Santa Clara, CA
    1 day ago
  • Pinterest is seeking an experienced Data & Applied Scientist to advance ML measurement, feature understanding, and causal inference at scale. You will own end-to-end design of production ML systems and collaborate with cross-functional teams to turn research into durable... 
    Senior
    Work at office

    Pinterest

    Palo Alto, CA
    4 days ago
  •  ...headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to...  ...deployment software and collaborating with ML, compiler, and hardware experts. Required: strong background in system software... 
    Senior

    Jobleads-US

    Santa Clara, CA
    3 days ago
  •  ...capabilities, delivering refined user experiences and advancing the AI platform across products. Responsibilities include applying ML/system engineering to create value, tackling conversational agent challenges, ensuring responsible AI, and productionizing ML solutions... 
    Senior

    ServiceNow

    Mountain View, CA
    3 days ago
  • A leader in AI technology in Palo Alto is seeking a Senior AI Systems Performance Engineer to optimize the latest foundation models on their innovative...  ...in deep learning, performance optimization, and major ML frameworks. This position offers competitive salary and... 
    Senior

    SambaNova

    Palo Alto, CA
    5 hours ago
  • $184k - $230k

    Senior Applied Scientist, Inference (MCM) Join to apply for the Senior Applied Scientist, Inference (MCM) role...  ...built some of the most successful ad systems at Google, including YouTube's monetization...  ...: Guide and assist partner teams (ML, Product, and Sales) through the... 
    Senior
    Full time

    Moloco

    Redwood City, CA
    2 days ago
  • $248k - $349k

    Google Research is seeking a Senior Staff Research Scientist to design experiments and contribute to the research community in Mountain View, CA....  ...annually, plus bonus and equity. Join Google to impact the next generation of intelligent systems. #J-18808-Ljbffr Google
    Senior

    Google

    Mountain View, CA
    1 day ago
  • $182.5k - $260.5k

     ...Positions are available at Senior Staff and above....  ...Machine Learning Scientist, you own the inference and optimization layer...  ...matures.Partner with the systems and backend engineers...  ...4+ years hands-on in ML/AI (model development...  .../SGLang, TensorRT-LLM, ONNX Runtime, llama.... 
    Senior

    Netskope

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...optimize containerized inference execution for the latest...  ...security patches)Contribute VLM-related features to Open...  ...-grade AI distributed systems, backend services,...  ...SGLang, Torch, TRT, TRT-LLM).Proficiency with Python...  ...already?Experience with ML model engineering: training... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $226k - $307k

     ...generation of autonomous system intelligence.As a...  ...for more efficient inference by sharing various...  ...We are looking for experts with hands-on...  ...you will optimize ML models, write custom...  ...driving paradigms (VLM/VLA models, Foundation...  ...technologies (e.g., TensorRT-LLM).$226,000 - $307,00... 
    Senior
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    4 days ago
  • $165k - $238k

     ...team of experienced ML researchers,...  ...professionals or finance experts interact with...  ...the role:As a Senior Research Scientist you will be a key...  ...architect of the core AI systems powering our...  ...high-fidelity inference over extremely large...  ...blocks, such as LLM-as-a-judge... 
    Senior
    Full time
    Work at office
    3 days per week

    X Company

    Mountain View, CA
    1 day ago
  • $192.2k - $260k

     ...are looking for a talented Senior Applied Scientist to join our team of scientists...  ...on high-impact prediction systems that directly drive advertiser...  ...incrementality) serving at inference latencies under 10ms at millions...  ...to the broader Amazon ML science community through papers... 
    Senior
    Local area
    Worldwide
    Flexible hours
    Shift work

    Amazon

    Palo Alto, CA
    1 day ago
  • $192.2k - $260k

    We are looking for a Senior Applied Scientist to help drive the research and development...  ...building the post-training systems (reward modeling,...  ...roadmap, and work closely with inference engineers to ensure your models...  ...to open-source speech/audio ML systems or widely used... 
    Senior
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    3 days ago
  • d-Matrix inc. is looking for a Senior Staff ML Researcher to join our Algo team in Santa Clara, CA. This hybrid position involves working...  ...successful candidate will develop algorithms for optimizing LLM inference on our DNN accelerators. Ideal applicants should have a MSc... 
    Senior
    3 days per week

    d-Matrix inc.

    Santa Clara, CA
    5 hours ago
  • $226k - $306k

     ...team develops novel AI/ML solutions that power intelligent...  ...modeling, causal inference, simulation-based...  ...agentic and multi-agent systems, neuro-symbolic AI, and LLM-based reasoning for business...  ...We are looking for a Senior Staff AI Research Scientist to shape and drive the... 
    Senior

    Intuit

    Mountain View, CA
    1 day ago
  •  ...Santa Clara, CA, headquarters 3 days per week. The role Senior Staff ML Researcher - LLM Algorithmic Optimization What You Will Do d-Matrix is...  ...algorithms that will be used to optimize large language model inference on DNN accelerators we develop. You would be part of a... 
    Senior
    3 days per week

    d-Matrix inc.

    Santa Clara, CA
    5 hours ago
  • $117.2k - $313.7k

     ...outstanding AI Research Scientists and Research Engineers....  ...Large language model (LLM)-powered agents, reinforcement...  ..., self-evolving agent systems, computer use agents,...  ...-language models (VLM), video understanding,...  ...distillation, evaluation, causal inference, and time series... 
    Full time

    Salesforce

    Palo Alto, CA
    1 day ago
  •  ...Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You...  ..., code generators, and GPU kernel innovations for LLM workloads. Join a team that designs extensible abstractions... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • Voltai in California (Palo Alto) seeks a senior formal verification researcher to develop new...  ...collaborate with RTL, verification, and ML teams to scale AI-hardware verification, prototype...  ...RTL, and turn research into practical systems. You will work closely with cross-... 
    Senior

    Voltai

    Palo Alto, CA
    3 days ago
  • $119.8k - $234.7k

     ...representations, and heterogeneous event streams to infer user intent and advertiser value, even...  .... The team owns end-to-end ML systems, including large-scale data and label construction...  ...marketplace dynamics. Engineers and scientists on the team work at the intersection of... 
    Senior
    Ongoing contract
    Work at office
    Local area
    Shift work

    Microsoft Corporation

    Sunnyvale, CA
    1 day ago
  •  ...Member of Technical Staff for research on LLM agents in Palo Alto, California. You will...  ...collaborate with engineers to create impactful AI systems. Essential qualifications include a solid...  ...candidates also have familiarity with ML frameworks like PyTorch or TensorFlow.... 

    NeoCognition Inc.

    Palo Alto, CA
    4 days ago
  • $161.3k - $274.2k

     ...with all of their business systems through natural language...  ...help build cutting edge ML infrastructure for building and serving LLM’s at Moveworks. This...  ...distributed training and inference pipeline for large language...  ..., machine learning experts, and product to build new... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    22 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Systems Scientist: LLM/VLM Inference Expert. Be the first to apply!