Staff Inference Systems Engineer
xAI
xAI is seeking a Member of Technical Staff - Inference in Palo Alto to design and optimize large-scale model serving systems. You will own distributed infrastructure from global KV caches and auto-scaling to low-level GPU kernel optimizations, shaping how Grok users interact with our platform at massive scale. You'll lead latency reduction, throughput improvements, and reliable serving for billions of inferences. #J-18808-Ljbffr xAI
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Inference Systems Engineer in Palo Alto, CA vacancy
- xAI is seeking an engineer for the RL infrastructure team to help with low precision RL training and inference. You will design and optimize the inference stack for RL workloads... ...building and optimizing large-scale distributed systems and proficiency in Python, C++, or Rust,...Suggested
$180k - $250k
A leading AI infrastructure firm is seeking a TPU Systems Engineer to develop high-performance systems using JAX, XLA, and Pallas. This role involves pushing large-model workloads on TPU hardware and optimizing performance across the stack. Candidates should have at least...Suggested- 2100 NVIDIA USA is seeking a Senior System Software Engineer to join their GPU-accelerated deep learning software team. This role focuses on developing cutting-edge inference serving software for AI models while collaborating within the open-source community. Ideal candidates...Suggested
- xAI is seeking an engineer to advance low precision RL training and inference. Design and optimize the inference stack across RL workloads, from small ablations... ...will tackle performance bottlenecks in large-scale systems, contribute hands-on across the stack, and help...Suggested
- ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor...Suggested
- ...capacity planning and fleet strategy for our Inference Service organization. This is a highly visible role working directly with Engineering, Product, Infrastructure, SRE, Operations... ...requirements. Forecast model replicas, system-hours, and spares by customer and by...
$178.7k - $268.1k
...at scale. We’re hiring a Senior Backend Engineer to build and operate the infrastructure... ...You’ll design and operate the distributed systems that power billions of daily decisions,... ..., reliability, and scalability of inference systems. What You’ll Be Doing Design,...Work at officeRelocation package- Unity in Mountain View is hiring a Senior Backend Engineer to design and operate distributed systems that power large-scale online model inference. You will work on performance, reliability, and scalability of these critical systems. The position requires expertise in...Worldwide
- NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team that...
$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...- NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD...
- NVIDIA is seeking a System Software Engineer to work on Dynamo‑Triton Inference Server in Santa Clara, CA. You will contribute to a high-performance, GPU-accelerated AI inference platform that serves both LLM and non-LLM workloads and participate in a fast-paced open source...
$184k - $287.5k
NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies, significantly impacting AI workloads. Candidates should have a Master's degree (PhD preferred) and...- NVIDIA is seeking outstanding AI systems engineers in Santa Clara to advance the inference software stack. You will build libraries, code generators, and GPU kernels for NVIDIA hardware, designing abstractions for LLM serving engines and JIT compilers to accelerate large...
$255k - $405k
...company based in California is seeking candidates to build backend systems for AI-powered features. The role involves optimizing service... ...experience with high-throughput services, be familiar with AI inference patterns, and have proficiency in Python and NodeJs among other...$184k - $356k
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve...$165k - $242k
Dormont Manufacturing Co is seeking a Senior Engineer to lead designs and improve engineering... ...on evolving our Kubernetes-native inference platform and ensuring reliability across... ...have 5-8 years experience with distributed systems, cloud services, and strong coding...- d-Matrix inc. is seeking a Staff Runtime Systems Engineer to join our team in Santa Clara, CA. This hybrid role involves working onsite three days a week and focuses on runtime software engineering for an AI compute platform. You will be responsible for the architecture...3 days per week
- Systems Test Engineer, Cybersecurity, Mid-Level Join to apply for the Systems Test Engineer, Cybersecurity, Mid-Level role at Jobright.ai Systems... ...increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical insurance Vision...Full timeH1b
- ...building generalized physical AI —robotic systems capable of dexterous, adaptive, and... ...infrastructure. We’re looking for a Research Engineer to build the core systems that enable... ...models in production environments Optimize inference performance and reliability where needed...
- NVIDIA is seeking an experienced Senior System Engineer to work on GPU rack platforms. This role involves integration, validation, and troubleshooting ensuring full functionality before deployment in data centers. Key responsibilities include collaborating on AI server...
$200k - $250k
...architecture and requirements development for a cross-functional micromobility vehicle platform program (Electrical Engineering, Firmware, Product Design) from a systems engineering perspective, ensuring alignment from concept through validation. Serve as the primary technical...Local areaFlexible hoursALSO
Palo Alto, CA11 hours ago- Apple’s Server ML Frameworks team in Cupertino seeks engineers to optimize high-performance GenAI applications. This role focuses on ML inference framework projects and GPU programming while collaborating with cross-functional teams to enhance performance. The ideal candidates...
- We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. Academic and commercial groups around the world are using GPUs to power a revolution...
- ...and world model teams. 3+ yrs distributed systems / ML infra. About Orbifold AI Orbifold... ...We are hiring a Machine Learning Engineer to scale and optimize the ML infrastructure... ...and tune distributed training jobs and inference deployments to maximize GPU/CPU utilization...
$230k - $250k
Cerebras Systems in Sunnyvale, CA, seeks a Sr. Member of Technical Staff to develop resilient software for their AI chip. Responsibilities include designing robust software features, maintaining deployment workflows using AWS, and debugging software issues. Candidates should...Remote job$215k - $263k
...Position Summary We are seeking a Staff Analyst to partner closely... ...with Marketing, Product, and Engineering to translate business needs... ...Engineering to productionize these systems at scale. Develop and... ...using uplift modeling, causal inference, and experimentation rigor (MMM...Work at officeLocal area2 days per week- AMD is seeking a hands-on Systems Development engineer in Santa Clara to lead server hardware bring-up, validation, and NPI qualification with OEM partners. You will drive deployments through compliance stages and collaborate with hardware, software, power, thermal, and...
$207k - $235k
...Staff Data Analyst Quince is seeking a talented and highly analytical... ...and performance measurement systems to understand what drives... ...functionally with Data, Product, Engineering, and Finance teams to improve... ...design, causal inference, and marketing measurement best...Local areaShop Circle
Palo Alto, CA2 days ago$180k - $235k
Lightmatter is seeking a Staff Machine Learning Systems Researcher to join their Machine Learning team in Mountain View, California. The role emphasizes... ...technology and modeling performance for training and inference workloads. This position requires a PhD and experience in...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Inference Systems Engineer. Be the first to apply!
Related searches
- technology administrator Palo Alto, CA
- engineering aide Palo Alto, CA
- senior staff systems engineer Palo Alto, CA
- assistant electrical engineer Palo Alto, CA
- staff design engineer Palo Alto, CA
- assistant mechanical engineer Palo Alto, CA
- staff data engineer Palo Alto, CA
- software engineer staff Palo Alto, CA
- senior staff engineer Palo Alto, CA
- assistant engineer Palo Alto, CA