Software Engineer, Model Inference & LLM Deployment
Google LLC
Google DeepMind seeks a Software Engineer for Model Inference to advance production-grade ML serving systems. You will collaborate with ML researchers and engineers to deploy large language models and optimize inference on GPUs/TPUs within Google's infra. You'll work across model hosting, testing, and performance tuning, contributing to scalable, low-latency serving infrastructure and end-to-end deployment pipelines in a mission-driven team. #J-18808-Ljbffr Google LLC
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Model Inference & LLM Deployment in Mountain View, CA vacancy
$193.3k - $261.5k
...builds AWS Neuron, the software development kit... ...unparalleled ML inference and training performance... ...a wide range of models and supporting... ...software boundary, our engineers build systematic... ...a wide variety of LLM model families,... ...and frameworks for deployment on custom ML...SuggestedWork experience placementInternshipLocal areaFlexible hoursAmazon
Cupertino, CA6 days ago$184k - $287.5k
...! The Algorithmic Model Optimization Team... ...language models (LLM) and diffusion models for maximal inference efficiency using techniques... ..., and automated deployment strategies. Our... ...an innovative software platform (TRT Model... ...externally by research and engineering teams alike...SuggestedFull timeNvidia
Santa Clara, CA7 days ago$195.2k - $262.2k
...enterprises from data and model training through to production deployment, without the cost... .... Built by engineers, for engineers.... ...orchestration to inference optimization, we own... ...across hardware, software and AI R&D. The role... ...in efficient LLM and VLM inference...SuggestedTemporary workImmediate startRemote work- ...leading training and inference speeds; over 10 times... ...works with the leading model labs, global... ...partnership with Cerebras, to deploy 750 megawatts of... ...Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to productionize... ..., SGLang, TensorRT-LLM, Triton Inference Server...Suggested
Cerebras Systems
Sunnyvale, CA5 days ago $162k - $243k
...Inc. Job Area: Engineering Group, Engineering Group... ...for experienced software engineers to help build... ...ecosystem for large-scale LLM inference on Qualcomm platforms... ...-d integration and deployment capabilities for... ..., and other forms of model parallelism Multi-...SuggestedWork experience placementWork from homeQUALCOMM, Inc.
Santa Clara, CA2 days ago$150k
...Colossus supercomputers, to Grok models, to our suite of... ...Grok Voice Model team as a software engineer. You'll design, build, and run... ...distributed training to production deployment. RESPONSIBILITIES... ...performance across training and inference, including throughput, latency...Temporary workSpaceXSI
Palo Alto, CA1 day ago$145k - $200k
...builds the world’s leading software for data-driven decisions and... ....The Role We are a software engineering team with expertise in enabling ML models in production. We deploy AI models to run in variety... ...across the full stack, from inference engines, GPU scheduling to deployment...Full timeWork experience placementWork at officeRemote workWork from homeRelocation packagePalantir Technologies
Palo Alto, CA7 days ago- ...enabling human life on Mars.SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING)The... ...platform that serves the best models internally at SpaceX to... ...g., SGLang, vLLM, TensorRT-LLM) Develop custom tools for tracing... ...for seamless endpoint deployment, image publishing, and inference...Permanent employmentTemporary workRemote workWorldwideWeekend work
SpaceX
Palo Alto, CA5 days ago $184k - $287.5k
...built. We are seeking a Senior Software Engineer - AI Inference Performance to advance innovative LLM and VLM inference. You will... ...systems. Your work will span models, serving software, distributed... ...work will improve production deployments and help build future NVIDIA platforms...Full timeNvidia
Santa Clara, CA3 days ago$165.2k - $223.6k
...AWS Neuron SDK, the software development kit... ...accelerators.The Neuron Inference organization is at... ...wide range of ML models and model... ...software boundary, our engineers build systematic infrastructure... ...a wide variety of LLM model families,... ..., testing, deploying, and operating...InternshipLocal areaFlexible hoursAmazon
Cupertino, CA4 days ago$184k - $287.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As... ...efficient large-scale model serving and inference.... ...platforms, facilitating smooth deployment and serving of... ...improvements for state-of-the-art LLM and Generative AI...Full timeNvidia
Santa Clara, CA2 days ago$152k - $241.5k
Senior Software Engineer, GPU Code Generation for Machine Learning Inference# CAREERS AT NVIDIA## Senior Software Engineer... ...of-the-art generative AI models for local and enterprise deployments. We solve challenging... ...Runtime, TensorRT, TensorRT-LLM, vLLM, and SGLang.* A track...Full timeLocal areaRemote workNVIDIA Corporation
Santa Clara, CA18 hours ago- ...Luma Model Serving Engineer You'll own how Luma's models get served — integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping expensive GPU... ...Face, vLLM, SGLang, TensorRT-LLM, or similar. Experience with...
Luma AI
Redwood City, CA3 days ago - ...SR Principal Software Engineer - LLM Engineering and 1 more Job Information... ..., and development of Model serving solutions for different... ...training, versioning, deployment, monitoring, and governance... ...and optimization using Model Inference servers such as Triton Inference...Full timeOverseasShift work
Testing Site - JPMC
Palo Alto, CA1 day ago $232.75k - $325k
...SR Principal Software Engineer - LLM Engineering and 4 more Job Identification... ..., and development of model serving solutions for different... ...training, versioning, deployment, monitoring, and governance... ...and optimization using model inference servers such as Triton...Full timeShift workJPMorgan Chase & Co.
Palo Alto, CA1 day ago$148k - $324k
...rebuilding the AI software stack from the ground... ...development and deployment. By rethinking the... ...: In the Cloud Inference team, we are... ...to end distributed LLM inference deployments... ...deploying and scaling models for enterprises... ...alike. We're seeking engineers who are passionate...Full timeWork experience placementWork at officeLocal areaRemote workModular Inc
Los Altos, CA5 days ago$193.3k - $261.5k
We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud... .... Join us to optimize the latest models to run really fast on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard...InternshipLocal areaFlexible hoursAmazon
Cupertino, CA6 days ago$254.4k
...Senior Research Scientist/Software Engineer, LLM/Agent Platform (TikTok-Content... ...for the entire lifecycle of models and agents—from data processing and training to deployment, monitoring, and governance.... ...large-scale model training and inference, including distributed...Temporary workLocal areaTikTok
San Jose, CA1 day ago$160.36k - $240.54k
...enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics... ...and a flexible, partner-led business model, Nuro is working toward a future where... ...-road validation.Maintain an in-house ML inference platform to serve large language models efficiently...Immediate startFlexible hoursNuro
Mountain View, CA3 days ago$207k - $300k
Build infrastructure for model creators to be able to... ...Model-as-a-service deployments.Minimum qualifications... ...years of experience in software development.5 years of... ...AI tools or LLM interfaces into workflows... ...Master’s degree or PhD in Engineering, Computer Science, or...Google
Sunnyvale, CA2 days ago- ...are at the forefront of software and hardware... ...Principal System Software Engineer, AI Inference ExecutionWhat you will... ...the next-generation AI deployment software. You have had... ...with inference servers/model serving frameworks (such as TensorRT-LLM, vLLM, SGLang, etc.)Experience...3 days per week
d-Matrix
Santa Clara, CA6 days ago $179k - $223k
...generations. Role Summary As a Software Engineer specializing in safety-critical self-... ...role in the design, development, and deployment of software that underpins essential self... ...software that runs Rivian's Perception models that underpin all self-driving features...Full timeContract workLocal area$190k - $250k
...AI We are looking for an AI Inference engineer to join our growing team. Our current... ...opportunity to work on large-scale deployment of machine learning models for real-time inference.... ...Explore novel research and implement LLM inference optimizations Qualifications...Full timeKindredventures
Palo Alto, CA1 day ago$150k - $183k
...enterprise users, AI agents, and LLM providers, inspecting... ...hiring a Machine Learning Engineer to own the detection models behind that product:... ...into models small enough to deploy.Optimize and serve models... ...Deploy and tune them on Triton Inference Server and vLLM — batching...Full timeWorldwideFortinet
Sunnyvale, CA7 days ago- Build a model customization and deployment lifecycle platform, including fine-tuning pipelines and evaluation harnesses. Develop... ...a Bachelor's degree in Computer Science or Engineering and over 7 years of experience with LLM serving infrastructure. Must have deep...
$224k - $356.5k
...now looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is... ...paced team building Generative AI inference platform to make design and deployment of new AI models easier and accessible to all... ...engines (vLLM, SGLang, TRT-LLM) and expand these capabilities...Full timeNvidia
Santa Clara, CA3 days ago$218.4k
...Senior Software Engineer, Machine Learning (LLM & Agentic AI - TikTok - Content Ecology Local Services) Location... ...NLP, Computer Vision, conversion modeling, global optimization, and causal... ...engineering, and production deployment capabilities. - Proven ability to...Temporary workLocal areaWorldwideTikTok
San Jose, CA1 day ago$160.36k - $240.54k
...enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics... ...and a flexible, partner-led business model, Nuro is working toward a future where... ...road validation. Maintain an in-house ML inference platform to serve large language models efficiently...Immediate startFlexible hours$193.93k - $352.29k
...mobility ecosystem to deploy autonomy at scale,... ...-led business model, Nuro is working toward... ...inside Nuro's own engineering organization,... ...About You3+ years of software engineering... ...current taste in LLM research. You understand... ...under the hood at inference. Attention and KV-...Immediate startFlexible hoursNuro
Mountain View, CA3 days ago$272k - $431.25k
...high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed... ...enables efficient, resilient deployment of cutting-edge LLM workloads.We are seeking a Principal Systems Engineer to define the vision and roadmap...Full timeLocal areaRemote workNvidia
Santa Clara, CA6 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Model Inference & LLM Deployment. Be the first to apply!
Related searches
- software engineer amazon Mountain View, CA
- information technology software engineer Mountain View, CA
- federal - software developer Mountain View, CA
- graduate software developer Mountain View, CA
- rust software engineer Mountain View, CA
- software development engineer (robotics engineer) Mountain View, CA
- software engineer remote Mountain View, CA
- junior software developer internship Mountain View, CA
- remote entry level software developer Mountain View, CA
- software engineer contract Mountain View, CA