AI Inference GPU Systems Engineer
Vast.ai Inc.
Vast.ai Inc. is seeking a systems/GPU engineer to develop kernels and algorithms that enhance AI model performance. The role is based on-site in San Francisco or Los Angeles, working closely with the technical founder and talented team. Qualified candidates should possess strong skills in C++/CUDA, GPU architecture, and neural network tooling. Benefits include comprehensive insurance and early-stage equity. #J-18808-Ljbffr Vast.ai Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Inference GPU Systems Engineer in San Francisco, CA vacancy
- MakerMaker, based in San Francisco, is seeking a highly skilled kernel engineer to write and optimize GPU kernels that enhance performance for training and inference. This role involves deep, low-level work to close the significant performance gap that exists in modern...Suggested
- A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving... ...candidates should have strong software engineering skills and experience with ML inference...Suggested
- A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning... .... You will design distributed training systems and optimize GPU utilization while collaborating with cross...Suggested
- MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability... ..., and have strong knowledge in GPU-accelerated inference. Excellent...Suggested
$58 - $63 per hour
About The Role As a Systems Research Engineer Intern specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely with the modeling and algorithm team, you will...SuggestedHourly payInternship- TryApplyNow is looking for a mid-level Software Engineer specializing in AI Inference Systems in San Francisco, California. This full-time role offers the opportunity to work on cutting-edge AI performance and infrastructure challenges within a growing Series A startup....Full time
- ...powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...help build the platform engineers turn to to ship AI... ...building the global operating system for distributed,... ...foundational engineers to lead our GPU Networking efforts,...Flexible hours
- Gravity Engineering Services Pvt Ltd. in San Francisco is looking for a specialized engineer to advance the efficiency of ML inference systems. The role encompasses algorithm design, system optimization, and the integration of RL-driven training techniques. Ideal candidates...
$120k - $180k
Vast.ai in San Francisco is looking for a Systems Software Engineer to enhance their GPU cloud infrastructure. This role involves improving performance and reliability of critical systems and collaborating in a fast-paced startup environment. The ideal candidate has strong...- United States Digital Space LLC in San Francisco seeks a skilled engineer to design and maintain distributed systems, ensuring AI functionality for millions globally. The role involves load balancing, request routing, and maximizing compute efficiency in a hybrid work...
$225k
...‑specific RL, ultra‑long context, and inference‑time compute to achieve this goal. About The Role As a Software Engineer on the Inference & RL Systems team, you will design and operate the... ...eliminate performance bottlenecks across GPU, networking, and storage layers...RelocationVisa sponsorship- Gravity Engineering Services Pvt Ltd. is seeking a Technical Program Manager for Inference in San Francisco, California. This role is essential... ...initiatives across inference systems, ensuring reliability and... ...program management within ML/AI systems, strong skills in stakeholder...
- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing...
$248.8k - $311k
...Scale's Physical AI business unit is dedicated to solving the... ...The Role As an ML Systems Engineer on the Physical AI team, you... ...performance tracking of model inference. Lead: Own projects end-to... ...cloud environments, including GPU-level algorithm optimizations...Full timeScale AI
San Francisco, CA4 days ago$190k - $270k
As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline...Full timeWork experience placementInternship- .... is looking for a Member of Technical Staff focused on ML systems and inference in San Francisco. You will design and build inference systems... .... Candidates should have strong foundations in software engineering, experience with ML inference systems, and performance tuning...
$200.8k - $251k
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning... ...for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch...Full time- # Software Engineer - AI Inference SystemsAcceler8 TalentFull TimemidSan Francisco, California, USPosted Yesterday## Role OverviewAcceler8 Talent is hiring a mid-level Software Engineer - AI Inference Systems. This is a full-time role in San Francisco, California. posted...Full time
$264.8k - $331k
...AI is becoming vitally important in every function... ...As an ML Sys Research Engineer, you'll work on building... ...to optimize our ML system. Your customer will be... ...optimize our training and inference framework. Post-train... ...architecture of the modern GPU cluster Experience...Full timeScale AI
San Francisco, CA3 days ago- AI Systems Engineer - Codex Core Agents About the team: The Codex Core Agents team builds the agent... ...the stack: harness, model interaction, inference, sandboxed execution, orchestration,... ...model behavior, inference/runtime stack, GPU fleet, and product surface. You’ll work...
- AI Systems Engineer - Codex Core Agents Location San Francisco Employment Type Full time Department... ...harness issues, model behavior, inference/runtime issues, and product failures.... ...kernels, runtimes, inference optimization, GPU systems, benchmarking, profiling, or performance...Full timeWork at officeLocal areaRelocation packageFlexible hours
- MissionHires in San Francisco is looking for a distributed systems software engineer to develop our in-house resource orchestration system for GPU compute nodes. This role entails designing resilient architectures for high availability and performance optimization. The...
$135.2k - $306.4k
Job Overview Oracle hardware platform development engineering is seeking a highly driven GPU/CPU Platform System Engineer at the Principal Engineer level. The GPU System... ...for Oracle’s rapidly growing and successful Cloud AI platforms. You will participate in platform...Temporary workWork experience placementRemote workFlexible hours$250k
...Join a rapidly scaling AI cloud infrastructure provider... ...a next-generation GPU platform designed for... ..., experimentation, and inference at scale. The company is... ...Staff Site Reliability Engineer to support and scale large... ...infrastructure systems Improve CI/CD pipelines...Permanent employmentRemote work$190k - $270k
AI Chopping Block, Inc. is seeking an experienced AI Infrastructure Engineer to manage user-facing services and production systems. The role encompasses participating in on-call rotations, building infrastructure with tools like Ansible, Terraform, and Kubernetes, and...Full timeInternship$160k - $320k
...About Us Vast.ai ’s cloud powers AI projects... ...excellence. We seek engineers/researchers with strong... ...We’re looking for a systems engineer with HPC or parallel... ...to help scale AI inference. You’ll leverage your knowledge... ...systems to optimize GPU performance at the bleeding...Full timeWork at office$180k - $250k
...the next generation of AI products. We build the... ...where high-performance inference, orchestration, and observability... ...experienced software engineer who thrives on building... ...scale distributed systems that deal with high... ...orchestration, scheduling, GPU autoscaling, large...Currently hiringRemote workRelocation packagefeatures and labels
San Francisco, CA3 days ago$245k - $385k
...implementation for model code, training, and inference. Our priorities are to maximize... ...capabilities. About the Role As a Distributed Systems/ML engineer, you will work on improving the... ...implementing, and optimizing state-of-the-art AI models), writing bug‑free machine...Work at officeRelocation package- Develop and optimize GPU-accelerated kernels and algorithms for ML/AI applications. Work closely with the modeling and algorithm team to co-design GPU kernels... ...to enhance the performance and efficiency of our AI systems. Collaborate with the hardware and software teams to...
$300k
...startup building out their AI and cloud platform, powered... ...full-scale model training, or inference. As a Platform Engineer/Senior Site Reliability... ...performance, and automation of this GPU-powered infrastructure,... ...AI workloads, automate systems at petascale, and be part of...Hamilton Barnes Associates Limited
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Inference GPU Systems Engineer. Be the first to apply!
Related searches
- ai engineer remote San Francisco, CA
- ai developer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- application system engineer San Francisco, CA
- system engineer remote San Francisco, CA