Staff Infra Engineer: Global GPU ML Inference at Scale
Jack & Jill
The Token Company in San Francisco, USA, is hiring a Member of Technical Staff, Infrastructure to own the end-to-end cloud infrastructure for a high-performance compression API. Build global, low-latency GPU ML inference systems that sit in the critical path of customer traffic, and drive reliability, scalability, and cost-efficiency. You will join a 5-person team on a high-growth AI product, with housing, visa sponsorship, and an equity-friendly compensation package. #J-18808-Ljbffr Jack & Jill
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Infra Engineer: Global GPU ML Inference at Scale in San Francisco, CA vacancy
- ...Company in San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you... ...systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure. The ideal candidate will have solid...SuggestedVisa sponsorship
- ...enterprise AI infrastructure. As a Staff AI Infrastructure Engineer, you will design, build, and... ...platforms that enable large‑scale training, serving, evaluation,... ...systems, Kubernetes, GPU infrastructure, high‑performance inference, and enterprise AI platforms to...Suggested
$225k
Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed... ...engineering fundamentals and experience with large-scale systems. Compensation includes a competitive salary range from...Suggested$280k
...experienced Infrastructure Engineers to join our team and support the development, scaling, and maintenance of our... ...: The research infra team addresses the problem... ...Kubernetes clusters with GPU/TPU/Tranium workloads.... ...Currently, we expect all staff to be in one of our...SuggestedWork at officeHome officeVisa sponsorshipRelocation package- A tech startup focusing on AI optimization is seeking engineers in San Francisco to enhance their GPU kernel optimization framework. Candidates should possess... .... Previous experience in GPU programming and AI/ML research is advantageous. Join a small team committed...Suggested
$150k - $300k
Prime Intellect is looking for a skilled ML Systems Engineer to build and optimize LLM serving infrastructure and inference systems. This hybrid role involves contributing to the scalability of their reinforcement learning training. Successful candidates will have over...Relocation package- A cutting-edge AI research firm in San Francisco is seeking talent to build and optimize GPU infrastructure for large-scale model inference and training workloads. The ideal candidate will have hands-on experience with GPU systems and optimization techniques, actively...
- ...building it. We're looking for a Staff ML Platform Engineer - Large Scale Training (LLMOps/MLOps) to... ..., optimizing multi-GPU training, and shipping production... ..., and love solving gnarly infra challenges—this is your... ...-throughput, low-latency inference pipelines for state-of-the...Flexible hours
- ...technology company in San Francisco is seeking a Data Platform Engineer to drive architecture and implementation of core systems. The ideal... ...and demonstrates strong analytical skills in fields such as ML and statistics. Responsibilities include planning technical roadmaps...
- ...financial services. We are scaling rapidly and need... ...The Opportunity Our Edge Inference team compiles Liquid Foundation... ...understanding of both ML architectures and... ...kernels for CPU, NPU, and GPU architectures across... ...proficiency Embedded software engineering experience or work on...
- B Capital is seeking a skilled engineer for GPU infrastructure in San Francisco. This role involves designing and operating high-performance systems for model inference, synthetic data generation, and reinforcement learning. The ideal candidate has strong GPU systems experience...
$220k
We build and run the inference engine behind every Perplexity query and deploy... ...of model architectures at scale with tight latency and cost budgets... ...to support in API Gateway. GPU kernels migration to CuTe DSL.... ...Good if you touched any of ML compilers and framework internals...$192k - $260k
...leading data and AI company is seeking a Staff Engineer to design and implement core systems for... ...0 years of experience in building large-scale distributed systems and will collaborate... ...to ensure operational excellence in GPU serving workloads. Competitive salary range...- ...production, and do it at scale without compromise.... ...where high‑performance inference, orchestration, and... ...looking for a Security Engineer, Infrastructure to secure... ...fal.ai’s platform: GPU compute, multi‑cloud environments... ...with platform, infra, and ML teams to drive shift‑...Shift work
- Stripe is seeking a Staff Engineer for its ML Platform team in San Francisco, California. You will lead the architectural design and technical direction... .... Preferred qualifications include experience with large-scale ML infrastructure and familiarity with AI tools and cloud...
$215k - $265k
...Networks (DDN) is a global market leader... ...data management at scale. Our cutting-edge... ...experienced Senior Staff Engineer specializing in AI... ...next-generation AI inference pipelines. This role... ...movement across GPU, memory, and distributed... ...Partner with AI/ML engineering teams...Local area- Jaide Health is seeking an engineer for their Model Efficiency team in... ...focuses on building reliable ML systems while enhancing core performance... ...techniques such as GPU/CUDA optimizations and collaborate... ...and insights into the LLM inference ecosystem. A commitment to diversity...Remote job
- ...solutions company in San Francisco is seeking a Staff Software Engineer - Computer Vision Deployment to design and scale infrastructure for AI-driven warehouse intelligence... .... The role involves creating distributed cloud GPU systems and optimizing computer vision models...
- ...to incubate and scale revolutionary AI... ...over 2,000+ major global customers,... ...experienced AI Engineer with deep expertise... ...team as a Senior Staff Architect. In this... ...in AI/ML engineering, including... ...techniques , including inference‑time search,... ...infrastructure (Kubernetes, GPU/TPU clusters,...Flexible hours
$225k - $300k
Staff / Senior Engineer San Francisco, CA · On-site (5 days) · Full-... ...and build a team that scales from 5 to 50 Bridge research... ..., agent frameworks, inference optimization, tool use... ...Production AI/ML systems: inference, orchestration... ...consumed abstracted infra. Can’t code live in...Full timeLive inImmediate start$207k - $290k
...enterprises don't scale expertise—they... ...portfolio serves 2,000+ global enterprise... ...experienced AI Engineer with deep... ...team as a Senior Staff Architect. In this... ...experience in AI/ML engineering, including... ..., including inference-time search,... ...infrastructure (Kubernetes, GPU/TPU clusters,...WorldwideFlexible hoursJazzX AI
San Francisco, CA25 days ago- Gravity Engineering Services Pvt Ltd. is seeking a Staff Software Engineer for AI Research Infrastructure. You will develop and run a research stack... ..., building services that orchestrate large-scale training and inference workloads across thousands of GPUs. Ideal candidates...
$300 per month
...re crafting the engine that powers a world... ...sacrificing scale, speed, or sustainability... ...As a Senior Staff Cloud Support... ..., and AI/ML infrastructure,... ...infrastructure globally. What You’ll Be... ...Troubleshoot NCCL, IB, GPU driver/firmware... ...workloads (training + inference) with...Full timeTemporary work$179k - $218k
...sense of urgency, who believe in the scale of our ambition and thrive on a path... ...bridged. We are seeking a Senior Staff Data Center Operations Engineer, GPU Hardware Architecture to be the... ...Operations & Telemetry: Leverage AI/ML methodologies to analyze fleet-wide...Temporary workCrusoe
San Francisco, CA25 days ago$227.87k
...strategy and vision for ML systems that improve... ..., Trust & Safety, Ads, Infra) to translate ambiguous... ...Mentor and grow junior ML engineers through technical... ...them to real‑world, high‑scale ecosystem problems. Demonstrated... ...design, or causal inference applied to ecosystems/...Work at officeLocal areaRelocationRelocation package$181.1k - $318.4k
Staff/Sr. Machine Learning Engineer, Foundation Models - AI, Search & Knowledge... ...and make it run at scale of Apple. Description... ...Research team to optimize inference for cutting edge... ...etc. Familiar with GPU programming concepts... ...with one of the popular ML Frameworks like...Relocation- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing...
- Acceler8 Talent is seeking a Member of Technical Staff focused on ML Systems & Inference in San Francisco, California. This role includes building and... ...AI workloads. The ideal candidate has strong software engineering roots and experience in inference systems. You will...
- Attentive Mobile, Inc. is seeking a Staff Software Engineer to join their Machine Learning Operations team in San Francisco, California. This role focuses on building and maintaining ML infrastructure, working primarily with Kubernetes and AWS. The ideal candidate will...
- A leading logistics company is seeking a Staff Backend Engineer in Seattle to develop and maintain their large-scale infrastructure. The ideal candidate will have 8+ years of experience and strong capabilities with backend technologies and microservices. This hybrid role...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Infra Engineer: Global GPU ML Inference at Scale. Be the first to apply!
Related searches
- assistant chief engineer San Francisco, CA
- technology administrator San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant electrical engineer San Francisco, CA
- staff design engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- staff data engineer San Francisco, CA