Staff Engineer, GPU AI Inference & RL Infrastructure
B Capital
B Capital is seeking a skilled engineer for GPU infrastructure in San Francisco. This role involves designing and operating high-performance systems for model inference, synthetic data generation, and reinforcement learning. The ideal candidate has strong GPU systems experience, optimization skills, and a passion for working in cutting-edge AI. Benefits include top-tier compensation, comprehensive health insurance, and paid parental leave. #J-18808-Ljbffr B Capital
$200k - $400k
A leading AI technology company located in San Francisco is seeking an infrastructure engineer to build distributed systems for their AI inference engine. The role involves designing systems that ensure minimal latency and maximum reliability. Candidates should have a...SuggestedVisa sponsorship- ...looking for a Member of Technical Staff, specializing in ML Infrastructure and Inference, focused on building and... ...performance challenges in modern AI models and collaborating with various... ...candidate will possess strong software engineering fundamentals, experience with...Suggested
- ...Company in San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that... ...API and build global low-latency, high-throughput GPU ML inference infrastructure. The ideal candidate will have solid experience...SuggestedVisa sponsorship
- Acceler8 Talent is seeking an early engineer to join their team focused on developing compiler and runtime infrastructure for next-generation AI systems. This role emphasizes ownership, collaboration with deeply technical peers, and contribution to efficient workload execution...Suggested
- A tech startup focusing on AI optimization is seeking engineers in San Francisco to enhance their GPU kernel optimization framework. Candidates should possess strong... ...a small team committed to solving complex AI infrastructure challenges while fostering a fast-paced, no-nonsense...Suggested
- ...looking for a Member of Technical Staff in San Francisco to optimize GPU performance for AI workloads. This role emphasizes high ownership and engineering excellence, ideal for those... ...collaborate across teams to enhance AI infrastructure. Strong software fundamentals and...
$200k - $225k
...Recruiting Researchers & Engineers with Foundational AI Experience A fast-growing... ...AI company is seeking a Staff Cloud Infrastructure Engineer to build and scale high-performance GPU compute infrastructure. You... ...performance tools for AI inference Collaborating with...Full time$220k
We build and run the inference engine behind every Perplexity query and deploy dozens of model... ...and multimodal models in our inference infrastructure, from weight loading, request scheduling... ...management to support in API Gateway. GPU kernels migration to CuTe DSL. Port our...$190.9k - $232.8k
A leading data and AI company is seeking a Staff Software Engineer for GenAI inference to lead the architecture and optimization of the inference engine. The role requires expertise in CUDA, GPU programming, and distributed systems design. Ideal candidates will have a strong...- ...Francisco is seeking a Member of Technical Staff focused on kernels and GPU performance. This role involves... ...optimizing GPU and accelerator kernels for AI workloads by analyzing performance... ...candidates have strong software engineering foundations and experience with performance...
- A cutting-edge AI research firm in San Francisco is seeking talent to build and optimize GPU infrastructure for large-scale model inference and training workloads. The ideal candidate will have hands-on experience with GPU systems and optimization techniques, actively...
$350k
Mirendil in San Francisco is searching for an engineer to develop and optimize inference systems for cutting-edge AI models. You will handle the complete inference stack, enhancing performance and reliability. The role involves partnering with teams to deploy new architectures...$276.5k - $300k
...accelerate people in the age of AI. As bots and autonomous... ...software, AI, cryptography, mobile engineering, and global operations. Our... .... About the Team Our Infrastructure team is a collaborative group... ...We are looking for a Staff Infrastructure Engineer to help...Flexible hours$160k - $300k
...Apiphany is a pioneering foundational AI company for physical product development... ...Character, our mission is to revolutionize how engineering decisions are made, turning complexity... .... About the Role As a Senior / Staff Infrastructure Engineer at Apiphany, you’ll design, build...Work at officeVisa sponsorshipFlexible hours$192k - $260k
A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have... ...across teams to ensure operational excellence in GPU serving workloads. Competitive salary range of $192,000...$250k - $325k
...Type Full time Department Engineering Compensation $250K – $3... ...de-risk the largest infrastructure build‑out in history. When people finance GPU clusters, the datacenters... ...for computer and inference, but sell to customers... ...market? Otherwise, as AI scales, compute only becomes...Long term contractFull timeContract workFixed term contractWork at officeLocal areaVisa sponsorshipShift work3 days per week- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing...
$350k
...opportunities? Join a rapidly growing AI infrastructure provider delivering large-... ...solutions for AI training and inference across global cloud and GPU environments. The organization... ...This opportunity is for a Staff Site Reliability Engineer to lead the reliability of...Permanent employment- ...pioneering the future of agentic AI and our focus is to transform... .... Our innovative platform is engineered from the ground up to boost... .... Responsibilities As a Staff Engineer, you will: Help define... ...serve, creating robust analytics infrastructure to measure AI performance,...Immediate startShift work
- Jaide Health is seeking an engineer for their Model Efficiency team in San Francisco. The role... ...advanced performance techniques such as GPU/CUDA optimizations and collaborate... ...C++ or Python and insights into the LLM inference ecosystem. A commitment to diversity and...Remote job
$240k - $280k
About the Role Together AI is hiring a Staff Platform Engineer to join the Product Foundations engineering... ...organization and drive its service infrastructure strategy. Product Foundations... ...products, including API Platform (non-Inference), web UI Platform, Billing, and...Full time$220k - $280k
About the Role Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform... .... We're looking for a Staff ML Engineer to drive the model serving layer... ...to the frontier. You'll profile GPU utilization, design batching strategies...Full time$200k - $400k
Inferact is looking for a Developer Relations Engineer in San Francisco, California, to help developers utilize vLLM for AI inference. This unique role involves teaching... ...educational content, and engaging with the AI infrastructure community. The ideal candidate will have...Remote work$150k - $300k
Prime Intellect is looking for a skilled ML Systems Engineer to build and optimize LLM serving infrastructure and inference systems. This hybrid role involves contributing... ...platforms, and a desire to work on cutting-edge AI infrastructure. They offer a cash compensation...Relocation package- ...the best way to talk to AI and humans together — where... .... Member of Technical Staff is the title we use for engineers who own hard problems end... ...fine-tuning, evaluation, inference, or RAG at scale High-performance... ...at scale Realtime infrastructure (WebRTC, WebSockets, streaming...
$190k - $270k
AI Chopping Block, Inc. in San Francisco is looking for an AI Infrastructure Engineer responsible for maintaining user-facing services and production systems. This role requires 5+ years of related experience, proficiency in Ansible, Terraform, and Kubernetes, and offers...$207k - $290k
...Description About JazzX AI: Vision:... ...experienced AI Engineer with deep... ...Learning (RL) to join our team as a Senior Staff Architect. In this... ...ensuring the RL infrastructure can scale to... ...techniques , including inference-time search,... ...(Kubernetes, GPU/TPU clusters,...WorldwideFlexible hours- A leading AI company based in San Francisco is searching for a Member of Technical Staff - Infrastructure Security. You will secure and enhance multi-cloud Kubernetes environments, designing security controls from scratch. Applicants should have extensive experience with...
$300 per month
...We’re crafting the engine that powers a world... ...create ambitiously with AI — without... ...transformative cloud infrastructure. About the Role As a Senior Staff Cloud Support Engineer... ...Troubleshoot NCCL, IB, GPU driver/firmware... ...workloads (training + inference) with performance...Full timeTemporary work$200k
...training, domain‑specific RL, ultra‑long context, and inference‑time compute to achieve... ...build internal tools and infrastructure that make the team more productive... ..., packaging, and engineering best practices What we’re... ...Not Required Deep ML/AI expertise (this is a tooling...Work at officeRelocationVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, GPU AI Inference & RL Infrastructure. Be the first to apply!
- staff engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff design engineer San Francisco, CA
- assistant engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior staff engineer San Francisco, CA
- staff security engineer San Francisco, CA
- software engineer staff San Francisco, CA
- assistant engineering manager San Francisco, CA

