Staff Engineer, DevTech: Fast AI Inference on GPUs
RadixArk
RadixArk is seeking a Member of Technical Staff to accelerate LLM inference and training on modern GPUs. You will profile, tune, and implement kernels and model support, with focus areas in inference performance or kernel enablement. You’ll work closely with partners to translate complex problems into practical, production-ready solutions. You will collaborate across teams to push SGLang and Miles forward, delivering day-0 model support and scalable performance across NVIDIA and AMD platforms. #J-18808-Ljbffr RadixArk
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Engineer, DevTech: Fast AI Inference on GPUs in Palo Alto, CA vacancy
- ...InworldInworld is a research lab and inference provider focused on realtime AI for consumer-facing... ...backgrounds who learn fast, thrive in ambiguity, and... ...performance out of NVIDIA GPUs.Distributed Systems & Scaling... ...to major inference engines, or deep-dive technical write...SuggestedFull timeWork at officeRelocation package
Inworld AI
Mountain View, CA3 days ago $155k - $235k
...the potential of generative AI to power the transformation... ...possibilities of AI. Staff Test & Release Engineer, Inference CloudLocation: Santa Clara,... ...Matrix Corsair accelerators and GPUs, and that hardware is scarce... ...including flaky tests and fast routing of failures to the...SuggestedRemote workShift workd-Matrix
Santa Clara, CA1 day ago$175k - $218.7k
Uniphore is the Business AI company. Our sovereign, composable and secure AI platform... ..., and recognized on the Deloitte Fast 500, Uniphore delivers on the promise of... ...transformative force for business. Job Description:Staff Inference Engineer -Uniphore is building an enterprise AI...SuggestedFull timeUniphore
Palo Alto, CA1 day ago- ...the potential of generative AI to power the transformation... ...what’s possible with LLM inference on heterogeneous hardware.... ...are an applied research and engineering team that moves fast, ships real systems, and works... ...-Matrix silicon with CPUs, GPUs, and custom accelerators....Suggested
d-Matrix
Santa Clara, CA3 days ago $207k - $340k
...approval. We’re hiring a Principal Staff Software Engineer to lead LinkedIn’s GPU-Based... ...Platform, a foundational AI infrastructure stack that... ...with NCCL, distributed inference, multi-GPU communication, or... ...such as NVIDIA H100 or H200 GPUs.3+ years of experience with...SuggestedFor contractorsWork at officeRemote workWork from homeFlexible hoursLinkedin
Mountain View, CA1 day ago$207k - $300k
Build advanced AI-generated content (AIGC) quality... ...advanced context engineering and agentic feedback loops... ...optimizing machine learning inference, resolving system-level... ...as you and our fast-paced business grow and... ...fulfill user interests. As a Staff Machine Learning...Google
Mountain View, CA19 hours ago- ...we areMoveworks is the Agentic AI Assistant platform that... ...Moveworks was also named one of Fast Company’s 2025 Most Innovative... ...automation with Moveworks’ Reasoning Engine and natural language... ...including distributed training and inference pipeline for large language models...Permanent employmentWork at officeRemote workFlexible hours
Moveworks
Mountain View, CA2 days ago $171k
Sr. Staff ll, AI Engineer - Search (L7-2)We exist to wow our customers. We know we’re doing the right... ...Korean commerce, and we are growing fast in Taiwan commerce as well.We are... ...including vector databases, high-throughput inference, and real-time data pipelines for...Temporary workFlexible hoursCoupang
Mountain View, CA1 day ago$197.5k - $272k
...driving the transformation to AI-enabled software-defined... ...combines the agility of a fast-growing company with the scale... ...are looking for a great Staff Machine Learning Engineer to join our seasoned AI team... ...modern C++ (C++14/17 for inference). ~ Deep proficiency with...Work at officeWorldwideFlexible hoursShift work3 days per weekSonatus
Mountain View, CA6 days ago$175k - $265k
...the potential of generative AI to power the transformation of... ...possibilities of AI. Senior Staff Inference Performance EngineerLocation:... ...OverviewThe Inference Cloud Engineering team builds the deployment and... ...Matrix Corsair accelerators and GPUs, with more heterogeneous...Permanent employmentRemote workShift workd-Matrix
Santa Clara, CA1 day ago$210k - $275k
At Commure, we're building the AI Operating System for healthcare, the... ...care is immediate. We move fast, deploy daily, and take full ownership... ...model timeouts, and rapidly changing inference infrastructure. We’re hiring a Staff Backend Engineer to help build and operate this...Work at officeImmediate start$250k - $300k
...Our client is a healthcare AI company building clinical documentation... .../ why it matters As Staff Backend Engineer, you will own the... ...recording sessions, compute-heavy inference and unreliable networks. You... ...• Comfort with ambiguity, fast iteration and taking work from...Full timeWork at officeRelocation package3 days per weekRaydar
Mountain View, CA4 days ago$173k - $237.95k
...and tissue tests, real-world data and AI analytics. Guardant tests help... ...and external data integration.The HPC engineering team is looking for a Staff-level engineer with broad, all-round... ...operations. To support Guardant Health's fast growth over the next few years, we need...Full timeWork at officeRemote workWork from homeFlexible hoursGuardant Health
Palo Alto, CA1 day ago- Uniphore, a leading Business AI company, seeks a Staff Inference Engineer to own the inference layer across cloud and on-premises. You will implement context-aware runtimes, optimize KV-cache and prompt-prefix handling, and drive high-performance multi-GPU deployments....
$215.28k - $364.32k
...innovation, integrating advanced AI and autonomous driving... ...tuning, PTQ, QAT, on-vehicle inference and related fields.Key ResponsibilitiesDevelop... ...programming and software engineering skills.Ability to work... ...with the ability to thrive in a fast-paced and collaborative environment...Full timeXPENG Motors
Santa Clara, CA19 hours ago$152k - $277k
...that can be easily consumed by engineers and scientists. You will also... ...including services like Vertex AI, BigQuery or... ...independently and manage ambiguity in fast-paced environmentsPay & BenefitsOur... ...compensation.The base pay for Staff position ranges from $152K/year...Temporary workCoupang
Mountain View, CA4 days ago$170k - $260k
...Learning /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...States and Europe, Plus was named by Fast Company as one of the World’s Most... ...QualificationsModel distillation, quantization, and inference optimization (ONNX/TensorRT, mixed...Full timePlus.ai
Santa Clara, CA2 days ago$202.5k - $274k
....Job OverviewIntuit is looking for a Staff Machine Learning Engineer to own the data and platform layer beneath... ...and evaluation frameworks, real-time inference serving, and the handoff into our... ...can put a tradeoff in front of an AI scientist, a platform owner, and a risk...WorldwideIntuit
Mountain View, CA3 days ago$201.3k - $352.3k
...entrepriseIt all started when engineer Fred Luddy wrote code that automated... .... Today, ServiceNow is the AI control tower for business... ...products evolve in line with the Fast paced world of Agentic AI —... ...Exposure to LLM fine-tuning or inference optimization in productionWhy...Work experience placementWork at officeImmediate startRemote workFlexible hoursServiceNow
Santa Clara, CA1 day ago$278k - $330k
...projects to build and deploy cutting-edge AI technology to help people get... ...alongside industry-veteran scientists and engineers. As a Staff Machine Learning Engineer, you’ll bring... ...training, fine-tuning, post-training, and inference strategies for large language and speech...Permanent employmentOtter.ai
Mountain View, CA1 day ago$247k - $290k
...their careers. We're a high-performing, fast-moving team with ethics at the center... ...adversaries who are increasingly leveraging AI to move faster and go deeper.The threat... ...attackers — and we need a Senior Staff Security Engineer to help us build them.As a Senior Staff...Work at officeFlexible hoursShift work3 days per weekRobinhood Financial
Menlo Park, CA4 days ago$130k - $220k
Santa Clara, CASoftware Engineering - Motion Planning /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual... ...and Europe, Plus was named by Fast Company as one of the World’s... ...TensorRT, ONNX Runtime, CUDA, or ML inference optimization.Experience with...Full timePlus.ai
Santa Clara, CA1 day ago- Cerebras Systems is seeking a Staff Engineer to lead the Inference Platform team, owning orchestration across datacenter clusters and connecting cloud components with ML services. You will solve hard problems in Kubernetes operators, security policies, and CI/CD, driving...
$149.7k - $187.1k
...generations. Role Summary We are seeking a Staff Network Engineer to design, implement, and support... .... Explore and apply automation, AI-assisted tools, and emerging technologies... ...to manage multiple priorities in a fast‑paced environment. Preferred Industry...Full timeContract workTemporary workPart timeWork experience placementLocal areaRemote workShift workRivian
Palo Alto, CA1 day ago$160k - $210k
...Staff Network EngineerAt Snowflake, we are powering the era of the... ...usher in this new era, we seek AI-native thinkers across every... ...individuals who thrive in dynamic and fast-moving environments and move... ...looking for a Senior Network Engineer to lead the design, operation,...Work at officeFlexible hoursStreamlit
Menlo Park, CA3 days ago$170k - $225k
...!About the RoleAs a Senior/Staff Machine Learning Engineer, you will be working on a myriad... ...foundations in Physical AI. Additionally, you will be... ...performant training and inference pipelines using PyTorch, with... ...experience or experience in fast-paced, cross-disciplinary...WorldwideDexterity
Redwood City, CA19 hours ago- ...the future. Very few people in AI can say this. Every role here,... ..., plugs into that. About Our Engineering Teams The Performance Architecture... ...across training and cloud inference, so that performance unlocks new... ...- what makes code fast, secure and reliable Not ticking...Work at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work
$152k
...data objects that can be easily consumed by engineers and scientists. You will also be... ...Cloud Platform including services like Vertex AI, BigQuery or SageMaker Experience working... ...work independently and manage ambiguity in fast‑paced environments Pay & Benefits Our compensation...Temporary workFlexible hours$300k
About the Team: Grindr is an AI-native platform powering how millions of gay people connect... ..., and a team of fewer than 200, we move fast, stay lean, and tackle technical problems... .... Collaborate cross-functionally with engineering, data science and product teams to turn...Casual workWork at officeImmediate startWorldwideFlexible hours$176.1k - $308.2k
...Description It all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...in this role: As a Staff AI Engineer, you will own... ...reasoning about model routing, inference cost, and latency... ...~ Comfort operating in fast-moving, ambiguous,...Full timeWork at officeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, DevTech: Fast AI Inference on GPUs. Be the first to apply!
Related searches
- staff engineer Palo Alto, CA
- engineering aide Palo Alto, CA
- technology administrator Palo Alto, CA
- assistant engineer Palo Alto, CA
- senior staff engineer Palo Alto, CA
- senior staff systems engineer Palo Alto, CA
- software engineer staff Palo Alto, CA
- assistant project engineer
- staff engineer
- assistant civil engineer