ML Systems Engineer
$250k - $350kPeriodic Labs
About Periodic Labs We're an AI and physical sciences company building state-of-the-art models to accelerate breakthroughs across materials, energy, and beyond. Backed by world-class investors and growing rapidly, we operate at the pace the frontier requires. Our team brings deep expertise, genuine ownership, and an insatiable drive to push the boundaries of what's scientifically possible. About the Role You'll work alongside some of the world's leading ML systems engineers, including leaders behind Megatron-LM, SGLang, Liger Kernel, TorchRec, CleanRL, TorchRL, and JAX-MD . We're looking for exceptional ML Systems Engineers to build the agentic infrastructure powering our large-scale training, inference, and reinforcement learning. You'll own critical pieces of the ML systems stack to maximize performance, scalability, reliability, and productivity for both engineers and AI agents. What You'll Do
- Build and optimize large-scale training and reinforcement learning infrastructure while ensuring its correctness
- Develop high-performance inference and serving systems
- Design distributed runtimes and scheduling systems for complex ML workloads
- Build secure and large-scale sandboxing and execution environments
- Optimize memory, GPU kernels and communication for maximum throughput and end-to-end efficiency
- Improve scalability, reliability, and efficiency across the ML systems stack
- Strong systems programming and performance engineering skills
- Experience building high-performance ML infrastructure at scale
- Ability to own complex technical problems end-to-end
- Strong coding ability and engineering judgment, including the ability to work effectively with AI agents to design, implement, test, and debug complex systems
- High ownership, fast execution, and a passion for pushing the frontier of AI systems and accelerating scientific discovery
- Training: Strong experience building, debugging and optimizing large-scale training systems with Megatron-LM. Familiarity with TorchTitan, FSDP, veRL, Slime, or other distributed training systems is a plus.
- Distributed Runtime: Strong experience with Ray . Familiarity with Monarch or other distributed execution frameworks is a plus.
- Inference: Strong experience with SGLang . Familiarity with vLLM, TensorRT-LLM, or production LLM serving systems is a plus.
- Sandboxing: Strong experience with secure execution environments, containers, virtualization, or code sandboxing.
- GPU Kernels: Strong experience with CUDA, Triton, CUTLASS, CuTe, or custom GPU kernel development.
- GPU Communication: Strong experience with NCCL, NVLink, InfiniBand, RDMA, GPUDirect RDMA, or large-scale communication optimization.
Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer in Menlo Park, CA vacancy
$250k - $350k
...ML Systems EngineerYou'll work alongside some of the world's leading ML systems engineers, including leaders behind Megatron-LM, SGLang, Liger Kernel, TorchRec, CleanRL, TorchRL, and JAX-MD.We're looking for exceptional ML Systems Engineers to build the agentic infrastructure...SuggestedVisa sponsorship- Recruiting From Scratch is seeking a Machine Learning Systems Engineer to design and operate large-scale ML training and inference infrastructure in Palo Alto. The role focuses on building high-performance, GPU-accelerated systems for model serving and deployment across...Suggested
$300k - $400k
...possible. About the Role You will own the systems layer that makes our frontier model... ...Profiling and benchmarking distributed ML systems to identify and eliminate bottlenecks... ...team of the world’s best — the scientists, engineers, and problem-solvers who don’t just follow...SuggestedVisa sponsorshipFlexible hoursShift work- ...Member of Technical Staff — Training to design and optimize large-scale distributed training systems for frontier AI models. Candidates should have 5+ years of experience in ML systems and be proficient in Python along with another systems language, such as C++. This role...Suggested
$174.9k - $261.3k
...and understand the world!The Data Labeling Engineering team designs, builds, and operates hybrid... ...engineering, data engineering, and AI/ML, defining the strategies, tooling, and quality... ...leadership, and direct impact on systems that unblock the next generation of AV capabilities...SuggestedFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours$90.1k - $191.8k
...and understand the world!The Data Labeling Engineering team designs, builds, and operates high‑... ...engineering, data engineering, and ML, defining labeling strategies, tooling, and... ...technical leadership, and work directly on systems that unblock the next generation of AV models...Full timeWork experience placementLocal areaRemote workWork from homeRelocation packageFlexible hours- Rhoda AI is building next-generation generalist robots and is seeking a Staff / Principal ML Training Systems Engineer to own training systems performance end-to-end. You will optimize large-scale multimodal training, define parallelism strategies, and drive efficiency...
- ...development into deployment, shaping data flow across the product. You'll work on scalable features, ML infrastructure, and collaborate with early customers and design partners to define the roadmap and deliver essential capabilities for engineers. #J-18808-Ljbffr Vinci
- Rhoda is building the next generation of generalist robotic systems in Mountain View, CA. We are seeking a senior or staff-level Research Engineer or ML Systems Engineer to make the robot-learning pipeline reliable and measurable from end to end. You will own the supported...
$204k - $259k
...autonomous driving technology company is looking for an experienced engineer to improve compute performance in machine learning systems. This hybrid role involves collaboration with a world-class ML team and requires strong expertise in ML software or systems. The ideal...- ...deployed on-premise inside sovereign data centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to...
$227.87k
...developing and executing solutions that enhance the Pinterest marketplace, primarily focusing on backend systems and statistical models. Candidates need strong software engineering skills and a graduate degree in a related field. The position is unique, allowing collaboration...Work at officeFlexible hours- General Motors’ Data Labeling Engineering team is building cutting‑edge labeling tools and pipelines that power autonomous vehicle ML models. The role sits at the intersection of software... ...and ML, focusing on scalable labeling systems and foundations for foundation‑model...
- General Motors in the United States seeks a Senior Engineer on the Embodied AI Scaling Foundations team to measure and visualize autonomous vehicle model performance across the stack. You will design, implement, and iterate evaluation and introspection tools, collaborate...Remote jobRelocation package
$144.7k - $261.3k
...challenges for autonomous vehicle development. We engineer high-performance tools that identify top-... ...models and partner with data-intensive ML teams to drive rapid innovation. Why Join... ...of next-generation autonomous systems. About the Role As a Senior Engineer in the...Local areaRemote workWork from homeFlexible hours- SpaceXAI is seeking exceptional Applied engineers to join a high-priority project used by hundreds of millions of users monthly. You will... ...and real-world impact, applying your skills to recommendation systems, ranking algorithms, search technologies, and more. You will design...
$200k - $300k
Machine Learning Systems Engineer Location - Palo Alto, CA (On-site) - Five days per week in-office in the Bay Area. Compensation - $200,000... ...Design, build, and operate infrastructure supporting large-scale ML training and inference systems Develop high-performance...H1bWork at office- JPMorgan Chase & Co. is seeking a Senior Machine Learning Engineer-Digital Intelligence in the Digital Intelligence team. You will specialize... ..., interpretability, and related algorithms, driving end-to-end ML solutions in a fast-paced environment. Ideal candidates bring a...
- Rhoda AI is hiring a Senior/Staff-level Research Engineer to ensure our robot-learning pipeline is reliable from data collection through... ..., and real-robot evaluation. You will build validation systems, observability, and robust operating practices to distinguish model...
- SpaceXAI is seeking exceptional Applied engineers to join a high-priority project used by hundreds of millions of monthly users. You will... ...data, iterate with real-time feedback, and ensure scalable ML systems that connect users with relevant content and experiences. #J-...
- Rhoda AI in Mountain View is seeking a Staff / Principal ML Training Systems Engineer to lead the performance of large-scale multimodal training systems. This role involves improving training efficiency and collaborating closely with research teams to accelerate model...
- Unity Technologies seeks a Machine Learning Engineer to join the Offline Infrastructure team,... ...generate training datasets, support multi-stage ML workflows, and collaborate with researchers to translate ideas into scalable systems. The role blends research and production,...
- A leading technology company is seeking a Principal Software Engineer for the Economy ML team. You will lead data engineering efforts, setting standards for high-scale data systems and pipelines. Collaborate with Product and Data Science teams to prioritize business growth...
$169k - $338k
...Segment: Home OfficePosition Summary...As a Distinguished AI/ML Engineer within Walmart Global Tech's Site Reliability Engineering organization... ...lead the technical development of next-generation agentic AI systems and intelligent automation solutions that ensure mission-...Full timeTemporary workPart time- ...We bridge this exact gap by applying deep systems programming, software-defined networking,... ...at UT Austin and world-renowned ML systems researcher with a pedigree spanning... ...Seniority ~5+ years of production experience engineering ML systems, OR a PhD from a top-tier...Shift work
$250k - $350k
About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this... ...improvements to model speed and efficiency, ensuring our creative AI systems deliver industry-leading user experiences at scale.You will...Work at office3 days per week$148.5k - $223.9k
...the right place! Agentforce is the future of AI, and you are the future of Salesforce.This role is for a Senior Machine Learning Engineer within the Trust Intelligence Platform team who will architect data-driven strategies for threat detection across the security organization...Full time- ...leading AI solutions provider in Palo Alto is looking for a Senior ML Engineer to take ownership of the entire machine learning lifecycle.... ...in Python, and significant expertise with production systems using PyTorch. You will work closely with product and data teams...
- Rhoda AI is seeking a Staff / Principal ML Training Systems Engineer in Mountain View to enhance the training systems performance. This role focuses on large-scale multimodal training, driving efficiency, and scalability in compute use across thousands of GPUs. The ideal...
$189.72k - $332.01k
A leading social media platform based in Palo Alto is seeking a Machine Learning Engineer. The role involves building innovative systems using deep learning and machine learning, improving their models across various product areas, and utilizing data-driven methods for...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer. Be the first to apply!
Related searches
- healthcare systems engineer Menlo Park, CA
- systems engineer Menlo Park, CA
- senior staff systems engineer Menlo Park, CA
- system performance engineer Menlo Park, CA
- machine learning scientist Menlo Park, CA
- machine learning Menlo Park, CA
- machine learning research scientist Menlo Park, CA
- artificial intelligence - machine learning intern Menlo Park, CA
- machine learning engineer
- machine learning software engineer


