Senior ML Systems Scientist — High-Performance Inference
ByteDance
ByteDance Technology in San Jose is seeking a Senior Research Scientist to lead machine learning system development. You will help build and optimize large-scale distributed ML training and inference infrastructure, integrating GPU/NPU/RDMA and storage to run complex models reliably.
Join a global team and contribute to cutting-edge LLM/AI system work while enhancing performance analysis, distributed systems, and decision-making processes across multiple regions.
#J-18808-LjbffrVacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Senior ML Systems Scientist — High-Performance Inference in San Jose, CA vacancy
$212.8k - $387.6k
...Senior Research Scientist - Machine Learning System Location: San Jose Team: Technology Employment... ...The Machine Learning (ML) System sub-team... ...distributed ML training and Inference system/services around the world, providing high-performance, highly reliable,...SeniorPerformanceTemporary workLocal areaByteDance
San Jose, CA6 hours ago- ...Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the... ...deployment software and collaborating with ML, compiler, and hardware experts.... ...and experience with distributed, high-performance software. #J-18808-Ljbffr...SeniorPerformance
$184k - $287.5k
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme... ...and implement high-performance inference stacks, optimize... ...frontier for the field of ML Systems; survey recent publications...SeniorPerformanceFull time$173k
...travelers everywhere.Senior Machine... ...Machine Learning Scientist is responsible... ...Owns end-to-end ML and GenAI projects... ...across highly complex post‑booking... ...challenges, from inference problems on... ...robust, scalable ML systems (batch and/or... ...and sustained performance in the role. The...SeniorPerformanceFull timeWorldwide$192k - $304.75k
...are now looking for a Senior Research Scientist for Human‑AI... ...world.We, the Human Performance and Experience (HPX)... ..., and HRI to create systems that perceive, learn... ...multi-GPU training and inference workflows.Familiarity... ...opportunity employer. As we highly value diversity in...SeniorPerformanceFull time$168k - $264.5k
...looking for a Research Scientist New Graduate with... ...Machine Learning Systems (MLSys). NVIDIA... ...infrastructure technology for ML systems of all... ...to maximize performance and energy... ...distributed systems, inference and training systems... ...opportunity employer. As we highly value diversity in...Performance$192k - $304.75k
We are now looking for a Research Scientist with a focus in System Software and I/O!NVIDIA is seeking Research... ...systems, and compilers, to achieve high throughput while improving energy... ...experience in profiling and system performance analysis tools. NVIDIA has pioneered...SeniorPerformanceFull timeWork experience placement$148.75k - $361k
...About the team The Advertising Performance group focuses on performance... ..., Publishers and Roku. The systems and solutions span across different... ..., Experimentation and Inference Platform that powers the entire... ...domainContributions to open-source ML projects #LI-DH2What's Roku's...SeniorPerformanceWork at officeLocal areaRemote workMonday to ThursdayFlexible hours- ...days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will do:The role... ...working closely with other software (ML and compilers) and hardware experts... ...toolsExperience with distributed, high-performance software design and implementationSelf...Performance3 days per week
- ...NVIDIA is seeking a Senior Agentic AI Software Engineer (Finance) to build agentic systems and advance AI inference workloads in real-world finance... ...experimental agents, optimize performance, and contribute to cutting... ..., and engineers to ensure high-quality results. #J-1880...SeniorPerformance
Nvidia Corporation in
Santa Clara, CA6 hours ago $224k - $356.5k
...at the forefront of AI and high-performance computing. As a Senior / Principal Deep Learning... ...Engineer — Model Evaluation & AI Systems, you will play a... ...alongside model training, inference, and product divisions to... ...frameworks, benchmarks, or ML infrastructure used by other...SeniorPerformanceFull time$224k - $356.5k
...within NVIDIA’s Networking Systems & Software... ...computing interconnects.The Senior Architect role is to own... ...and implementing high-performance communication and memory... ...debugging.Understanding of ML systems concepts—... ...distributed training and inference patterns.Ways to stand...SeniorPerformanceFull time$208k - $327.75k
...Platforms Group is seeking a Senior System Architect to define, design,... ...across accelerated compute, high-performance networking, storage,... ...observability, automation, and AI/ML operations. This person can... ...for training, fine-tuning, inference, agentic AI, physical AI, and...SeniorPerformanceFull time$224k - $356.5k
We are now looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is hiring... ...-paced team building Generative AI inference platform to make design and deployment... ...of objectives: build robust, scalable, high performance software components to support our distributed...SeniorPerformanceFull time- ...that Apple provides the most relevant and high quality ads experience while maintaining... ...optimize for their campaign goals and performance on the Apple Ads. You will have the opportunity... ...learning, quantitative methods, control systems, or reinforcement learning ~ Ability...SeniorPerformance
Socket.dev
Cupertino, CA6 hours ago $160k - $198k
...noise.Our sights are set high and our problems are... ....What You’ll DoAs a Senior AI Systems Engineer, you will architect... ...AI model training and inference. You will ensure our... ...raw data and high-performance AI models.Infrastructure... ...dedicated focus on AI/ML systems, high-...SeniorPerformanceLocal area$152k - $241.5k
...are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make... ...TensorRT, NVIDIA’s SDK for high-performance deep learning inference... ...:Experience developing System Software.Proficiency in... ...ONNX Runtime or other ML frameworks.NVIDIA is...SeniorPerformanceFull time$148.75k - $361k
...the Team The Advertising Performance group focuses on performance... ...Advertisers, Publishers and Roku. The systems and solutions span across... ..., Experimentation and Inference Platform that powers the entire... ...Contributions to open‑source ML projects Our Hybrid Work Approach...SeniorPerformanceWork at officeRemote workMonday to ThursdayFlexible hoursRoku
San Jose, CA6 hours ago$224k - $356.5k
...applications like NemoClaw, LLM inference via NIM, Hermes agents,... ...for the multi-GPU, high-bandwidth architecture... ...for a deeply technical systems software engineer who... ...delivers best-in-class performance for real AI workloads... ...hands-on experience in AI/ML workload optimization,...SeniorPerformanceFull timeLocal area$184k - $287.5k
...intersection of research and systems engineering, where we turn new ideas into reliable, high-performance systems for developers and customers... ..., rendering, and real-time inference from prototype through release... ...vision, or large-scale ML systems.Experience building and...SeniorPerformanceFull time- ..., gaming and embedded systems. Grounded in a culture... ...ROLE:AMD is seeking a Senior Product Manager to drive... ...on large-scale model inference on AMD Instinct™ and... ...open-source community, high-performance computing, and production... ...in the open-source AI/ML community: monitor...SeniorPerformanceRemote work
$224k - $356.5k
...globally!We are hiring a Senior Systems Software Engineer to... ...deep learning inference for autonomous vehicles... ...level. They will locate performance issues through kernel... ...Crowd:Experience with ML compiler frameworks (TVM... ...opportunity employer. As we highly value diversity in our...SeniorPerformanceFull timeImmediate start- ...Netskope is seeking a Senior Staff Machine Learning Scientist in Santa Clara to own the inference and optimization layer for AI in agentic workflows. You will fine-tune... ...optimization, and hardware acceleration, partnering with systems and backend engineers to ship end-to-end...Senior
Netskope
Santa Clara, CA6 hours ago $193.3k - $261.5k
AWS designs custom SoCs (System on Chips) that power... ...learning training and inference clusters. Our organization... .... As part of the ML accelerator systems modeling... ...models and emulators, to performance analysis on live... ...Enjoy working on a small, high-impact team where you own...SeniorPerformanceLocal areaFlexible hours$182.5k - $260.5k
...are available at Senior Staff and above.... ...Learning Scientist, you own the inference and optimization... ...in it for you High-impact ownership... ...that changes the performance and economics of... ...Partner with the systems and backend engineers... ...hands-on in ML/AI (model development...SeniorPerformanceWork at officeNetskope
Santa Clara, CA6 hours ago$224k - $356.5k
...Station across both operating systems.What you’ll be doing:... ...Validate AI/DL workload performance—training, fine-tuning, and inference—and work with the CUDA team... ...CUDA, TensorRT, or AI/ML frameworks on Windows and... ...manageability software on high-end workstations or servers...SeniorPerformanceFull time$193.3k - $261.5k
...Inferentia and Trainium ML accelerators.... ...unparalleled ML inference and training performance.The Inference... ...and create high-performance kernels... ...the stack from system level optimizations... ...team of applied scientists, system... ...mentorship. Our senior members enjoy one...SeniorPerformanceWork experience placementInternshipLocal areaFlexible hours$192k - $304.75k
...re looking for a passionate scientist at the intersection of quantum... ...path-find the future of high-fidelity, real-time models for... ...experiments, decoding, and system performance. You will develop physics-informed... ...prediction and parameter inference without full experimental...SeniorPerformanceFull timeRemote work$183.83k - $275.98k
...advancements in the field of ML and large-scale learning to the... ...-to-end autonomous driving system.This role requires working with... ...model optimization and inference speeds. You will use your applied... ...pipelines.Develop practical, performant solutions and deploy them to...SeniorPerformanceImmediate startFlexible hours$192k - $304.75k
...looking for a passionate scientist at the intersection of... ..., decoding, and system performance. You will develop physics... ...characterization to produce high-quality training data... ...and parameter inference without full experimental... ...quantum systems and AI/ML research.Hands-on...SeniorPerformanceFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Scientist — High-Performance Inference. Be the first to apply!
Related searches
- machine learning scientist San Jose, CA
- scientist San Jose, CA
- quality control scientist San Jose, CA
- qc scientist San Jose, CA
- regulatory scientist San Jose, CA
- research scientist - biology San Jose, CA
- applied scientist San Jose, CA
- operations research scientist San Jose, CA
- image scientist San Jose, CA
- support scientist San Jose, CA