Senior ML Systems Scientist — High-Performance Inference
ByteDance
ByteDance Technology in San Jose is seeking a Senior Research Scientist to lead machine learning system development. You will help build and optimize large-scale distributed ML training and inference infrastructure, integrating GPU/NPU/RDMA and storage to run complex models reliably. Join a global team and contribute to cutting-edge LLM/AI system work while enhancing performance analysis, distributed systems, and decision-making processes across multiple regions. #J-18808-Ljbffr ByteDance
$212.8k - $387.6k
Senior Research Scientist - Machine Learning System Location: San Jose Team: Technology Employment... ...Responsibilities The Machine Learning (ML) System sub-team... ...ML training and Inference system/services around the world, providing high-performance, highly reliable, scalable...SeniorPerformanceTemporary workLocal area- ...Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the... ...deployment software and collaborating with ML, compiler, and hardware experts.... ...and experience with distributed, high-performance software. #J-18808-Ljbffr...SeniorPerformance
$184k - $287.5k
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme... ...and implement high-performance inference stacks, optimize... ...frontier for the field of ML Systems; survey recent publications...SeniorPerformanceFull time$173k
...travelers everywhere. Senior Machine Learning Scientist The Senior... ...Owns end‑to‑end ML and GenAI projects... ..., scalable ML systems (batch and/or streaming... .... Apply causal inference and experimental... ...production is highly desired.... ..., and sustained performance in the role. The...SeniorPerformance$168k - $264.5k
...looking for a Research Scientist New Graduate with... ...Machine Learning Systems (MLSys). NVIDIA... ...infrastructure technology for ML systems of all... ...to maximize performance and energy... ...distributed systems, inference and training systems... ...opportunity employer. As we highly value diversity in...Performance$192k - $304.75k
...are now looking for a Senior Research Scientist for Human‑AI... ...world.We, the Human Performance and Experience (HPX)... ..., and HRI to create systems that perceive, learn... ...multi-GPU training and inference workflows.Familiarity... ...opportunity employer. As we highly value diversity in...SeniorPerformanceFull time$192k - $304.75k
We are now looking for a Research Scientist with a focus in System Software and I/O!NVIDIA is seeking Research... ...systems, and compilers, to achieve high throughput while improving energy... ...experience in profiling and system performance analysis tools. NVIDIA has pioneered...SeniorPerformanceFull timeWork experience placement$148.75k - $361k
...About the team The Advertising Performance group focuses on performance... ..., Publishers and Roku. The systems and solutions span across different... ..., Experimentation and Inference Platform that powers the entire... ...domainContributions to open-source ML projects #LI-DH2What's Roku's...SeniorPerformanceWork at officeLocal areaRemote workMonday to ThursdayFlexible hours- ...days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will do:The role... ...working closely with other software (ML and compilers) and hardware experts... ...toolsExperience with distributed, high-performance software design and implementationSelf...Performance3 days per week
- NVIDIA is seeking a Senior Agentic AI Software Engineer (Finance) to build agentic systems and advance AI inference workloads in real-world finance... ...experimental agents, optimize performance, and contribute to cutting... ..., and engineers to ensure high-quality results. #J-18808...SeniorPerformance
- .... in Cupertino is seeking a Senior Machine Learning Scientist to design scalable models for... ...will build production-grade systems to optimize budgets and bids, delivering high-quality ad experiences at... ..., ensure privacy, and drive performance improvements for advertisers...SeniorPerformance
- Bitdeer is seeking a Senior AI Storage Infrastructure Engineer to build the critical... ...NeoCloud. You will architect high-performance storage solutions powering AI model training and inference, spanning NVMe caching, parallel file systems, and kernel-level I/O with...SeniorPerformance
$224k - $356.5k
...within NVIDIA’s Networking Systems & Software... ...computing interconnects.The Senior Architect role is to own... ...and implementing high-performance communication and memory... ...debugging.Understanding of ML systems concepts—... ...distributed training and inference patterns.Ways to stand...SeniorPerformanceFull time- ...that Apple provides the most relevant and high quality ads experience while maintaining... ...optimize for their campaign goals and performance on the Apple Ads. You will have the opportunity... ...learning, quantitative methods, control systems, or reinforcement learning Ability to...SeniorPerformance
$148.75k - $361k
About the Team The Advertising Performance group focuses on performance... ..., Publishers and Roku. The systems and solutions span across different... ..., Experimentation and Inference Platform that powers the entire... ...Contributions to open‑source ML projects Our Hybrid Work Approach...SeniorPerformanceWork at officeRemote workMonday to ThursdayFlexible hours$224k - $356.5k
We are now looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is hiring... ...-paced team building Generative AI inference platform to make design and deployment... ...of objectives: build robust, scalable, high performance software components to support our distributed...SeniorPerformanceFull time$208k - $327.75k
...Platforms Group is seeking a Senior System Architect to define, design,... ...across accelerated compute, high-performance networking, storage,... ...observability, automation, and AI/ML operations. This person can... ...for training, fine-tuning, inference, agentic AI, physical AI, and...SeniorPerformanceFull time$160k - $198k
...noise.Our sights are set high and our problems are... ....What You’ll DoAs a Senior AI Systems Engineer, you will architect... ...AI model training and inference. You will ensure our... ...raw data and high-performance AI models.Infrastructure... ...dedicated focus on AI/ML systems, high-...SeniorPerformanceLocal area$224k - $356.5k
...applications like NemoClaw, LLM inference via NIM, Hermes agents,... ...for the multi-GPU, high-bandwidth architecture... ...for a deeply technical systems software engineer who... ...delivers best-in-class performance for real AI workloads... ...hands-on experience in AI/ML workload optimization,...SeniorPerformanceFull timeLocal area$184k - $287.5k
...intersection of research and systems engineering, where we turn new ideas into reliable, high-performance systems for developers and customers... ..., rendering, and real-time inference from prototype through release... ...vision, or large-scale ML systems.Experience building and...SeniorPerformanceFull time- Netskope is seeking a Senior Staff Machine Learning Scientist in Santa Clara to own the inference and optimization layer for AI in agentic workflows. You will fine-tune... ...optimization, and hardware acceleration, partnering with systems and backend engineers to ship end-to-end...Senior
$184.7k - $324.8k
Senior Machine Learning Scientist - Ad Campaign Optimization Cupertino, California, United... ...the most relevant and high quality ads experience while... ...their campaign goals and performance on the Apple Ads. You will... ...will develop models and systems that improve our platform...SeniorPerformanceRelocation- ..., gaming and embedded systems. Grounded in a culture... ...ROLE:AMD is seeking a Senior Product Manager to drive... ...on large-scale model inference on AMD Instinct™ and... ...open-source community, high-performance computing, and production... ...in the open-source AI/ML community: monitor...SeniorPerformanceRemote work
$224k - $356.5k
...globally!We are hiring a Senior Systems Software Engineer to... ...deep learning inference for autonomous vehicles... ...level. They will locate performance issues through kernel... ...Crowd:Experience with ML compiler frameworks (TVM... ...opportunity employer. As we highly value diversity in our...SeniorPerformanceFull timeImmediate start$182.5k - $260.5k
...are available at Senior Staff and above.... ...Learning Scientist, you own the inference and optimization... ...in it for you High-impact ownership... ...that changes the performance and economics of... ...Partner with the systems and backend engineers... ...years hands-on in ML/AI (model...SeniorPerformanceWork at office$193.3k - $261.5k
AWS designs custom SoCs (System on Chips) that power... ...learning training and inference clusters. Our organization... .... As part of the ML accelerator systems modeling... ...models and emulators, to performance analysis on live... ...Enjoy working on a small, high-impact team where you own...SeniorPerformanceLocal areaFlexible hours$224k - $356.5k
...Station across both operating systems.What you’ll be doing:... ...Validate AI/DL workload performance—training, fine-tuning, and inference—and work with the CUDA team... ...CUDA, TensorRT, or AI/ML frameworks on Windows and... ...manageability software on high-end workstations or servers...SeniorPerformanceFull time$193.3k - $261.5k
...Inferentia and Trainium ML accelerators.... ...unparalleled ML inference and training performance.The Inference... ...and create high-performance kernels... ...the stack from system level optimizations... ...team of applied scientists, system... ...mentorship. Our senior members enjoy one...SeniorPerformanceWork experience placementInternshipLocal areaFlexible hours$192k - $304.75k
...re looking for a passionate scientist at the intersection of quantum... ...path-find the future of high-fidelity, real-time models for... ...experiments, decoding, and system performance. You will develop physics-informed... ...prediction and parameter inference without full experimental...SeniorPerformanceFull timeRemote work$152k - $241.5k
## Senior Software Engineer, Deep Learning Inference - TensorRTApplylocations: US, CA, Santa... ...functionality and performance* Develop components... ..., NVIDIA’s SDK for high-performance deep... ...Experience developing System Software.*... ...ONNX Runtime or other ML frameworks.NVIDIA is...SeniorPerformance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Scientist — High-Performance Inference. Be the first to apply!
- molecular biology scientist San Jose, CA
- water quality scientist San Jose, CA
- machine learning scientist San Jose, CA
- image scientist San Jose, CA
- machine learning research scientist San Jose, CA
- materials scientist San Jose, CA
- health scientist San Jose, CA
- scientist San Jose, CA
- graduate scientist San Jose, CA
- quality control scientist San Jose, CA

