Get new jobs by email
$320k
Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to...Suggested- xAI is seeking an engineer to advance low precision RL training and inference. Design and optimize the inference stack across RL workloads, from small ablations to production runs, and work with the modelling team to implement novel RL techniques. You will tackle performance...Suggested
$225k
Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems, optimizing performance, and ensuring high reliability for RL and post-training workflows. The ideal candidate...Suggested- ...is seeking a Member of Technical Staff focused on ML Systems & Inference in San Francisco, California. This role includes building and... ...production AI workloads. The ideal candidate has strong software engineering roots and experience in inference systems. You will influence...Suggested
- xAI is seeking a Member of Technical Staff - Inference in Palo Alto to design and optimize large-scale model serving systems. You will own distributed infrastructure from global KV caches and auto-scaling to low-level GPU kernel optimizations, shaping how Grok users interact...Suggested
- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing...Suggested
- Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance for ML inference, ensuring scalability and efficiency in solutions used by both open-source and corporate clients...Suggested
- 2100 NVIDIA USA is seeking a Senior System Software Engineer to join their GPU-accelerated deep learning software team. This role focuses on developing cutting-edge inference serving software for AI models while collaborating within the open-source community. Ideal candidates...Suggested
- RadixArk is hiring a Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will design and optimize... ...models across thousands of GPUs. The role blends systems engineering, ML infrastructure, and performance optimization to shape how...SuggestedWorldwide
- ...infrastructure company in California is seeking a Member of Technical Staff — Inference to design and optimize large-scale AI inference systems. The role demands 5+ years in systems engineering and expertise in large-scale inference systems. Successful candidates will...SuggestedFlexible hours
- Reflection seeks a skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with...Suggested
$192.6k - $271.9k
...‑world impact converge at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure those models depend on... ...with a focus on the performance, reliability, and scalability of inference systems. Join us and help influence how billions of gaming...SuggestedWork at officeWorldwideRelocation package$198k - $326k
A prominent tech company in Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of experience in software engineering, extensive knowledge of ML systems,...Suggested- We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry...Suggested
- Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today, but simply adding more hardware isn't the answer. We're partnering with a well-funded Series A startup, founded by entrepreneurs with a proven track record of building successful...Suggested
$200k - $280k
A research-driven AI company in the U.S. offers a role in research engineering. The position involves translating RL algorithms into production-grade systems with a focus on inference performance. Candidates need a strong foundation in ML systems, and experience with RL...- Vast.ai Inc. is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You will design and optimize GPU kernels and tensor libraries, leveraging CUDA/C++ and related frameworks to push the bleeding edge of AI performance. This...
- xAI is seeking an engineer for the RL infrastructure team to help with low precision RL training and inference. You will design and optimize the inference stack for RL workloads, profile performance, and collaborate with the modelling team to implement novel RL techniques...
- Vast.ai is seeking a systems engineer to scale AI inference and optimize GPU performance at our San Francisco or Los Angeles offices. You will leverage your HPC background to push the bleeding edge of AI, working with CUDA/C++ and a modern tech stack. Ideal candidates...Full time
$168k - $270.25k
NVIDIA is seeking a Senior Engineer in New York to design and build automation for NVIDIA Inference Microservices. You will create pipelines for AI models validated across cloud and on-prem environments, collaborate with teams to enhance infrastructure efficiency, and...- d-Matrix is looking for a Senior Staff Runtime Systems Engineer to join our team. This hybrid position requires working onsite at our... ...architecture, development, and validation of runtime software for AI inference. The ideal candidate possesses a Bachelor's degree in computer...3 days per week
- Vast.ai is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You’ll leverage your knowledge of high-performance systems to optimize GPU performance at the bleeding edge of AI. This full-time, on-site position is based in...Full time
$152k - $241.5k
...technology for safety‑critical applications? Join NVIDIA's TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high‑performance AI inference solutions for automotive safety and other specialized platforms. Your expertise will help...- ...solutions provider in Dallas is seeking an AI Infrastructure Engineer with expertise in C++ and CUDA. The role involves designing and... ...-performance system design. Responsibilities include building inference pipelines, supporting model deployment, and working closely with...
- Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure. Candidates...Worldwide
- Tesla Motors, Inc. AI Hardware team leads the development of AI inference silicon and the Dojo supercomputer, powering neural networks for FSD and Optimus. This role owns silicon test from concept to high‑volume ramp, ensuring reliable commercialization of Tesla’s AI SOCs...
$300k
A forward-thinking AI company in San Francisco is seeking an experienced software engineer to join their Inference team. The role focuses on building and optimizing systems for AI model deployment, with a strong emphasis on technical excellence and societal impact. Candidates...- Tensordyne in Sunnyvale, California is searching for a Hardware Design Engineer to take ownership of hardware system development for cutting-edge AI Inference products. In this role, you will engage with ASIC, software, product, and operations teams to ensure successful...
- Gravity Engineering Services Pvt Ltd. in San Francisco is looking for a specialized engineer to advance the efficiency of ML inference systems. The role encompasses algorithm design, system optimization, and the integration of RL-driven training techniques. Ideal candidates...
- NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD...