GPU Systems Engineer — HPC & AI Inference (On-site)
Vast.ai
Vast.ai is seeking a systems engineer to scale AI inference and optimize GPU performance at our San Francisco or Los Angeles offices. You will leverage your HPC background to push the bleeding edge of AI, working with CUDA/C++ and a modern tech stack. Ideal candidates have advanced C++, experience with parallel frameworks, and a strong track record in high-performance systems. This role is full-time and on-site, offering equity and a fast-paced startup environment. #J-18808-Ljbffr Vast.ai
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GPU Systems Engineer — HPC & AI Inference (On-site) in San Francisco, CA vacancy
- Vast.ai Inc. is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You will design and optimize GPU kernels and tensor libraries, leveraging CUDA/C++ and related... .... This role is based on-site in San Francisco or Los Angeles...Website
- About Us Vast.ai’s cloud powers AI projects... .... We seek engineers with strong intrinsic... .... LOCATION: On-site at our office in... ...re looking for a systems engineer with HPC or parallel... ...to help scale AI inference. You’ll leverage... ...systems to optimize GPU performance at the...WebsiteFull timeWork at office
$250k
...a rapidly scaling AI cloud infrastructure... ...a next-generation GPU platform designed... ..., and inference at scale. The company... ...a Senior / Staff Site Reliability Engineer to support and scale large-scale HPC and cloud environments... ...available infrastructure systems Improve CI/CD...WebsitePermanent employmentRemote work- ...Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco... ...been quietly building the systems, network, and orchestration... ...platform routes training and inference jobs across global supply,... ...to ML/AI infrastructure or GPU-based systems (CUDA, Slurm,...WebsiteFull timeRemote work
Andromeda Cluster
San Francisco, CA3 days ago - A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving... ...candidates should have strong software engineering skills and experience with ML inference...Suggested
- A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning... .... You will design distributed training systems and optimize GPU utilization while collaborating with cross...
$300k
...building out their AI and cloud platform,... ...model training, or inference. As a Platform Engineer/Senior Site Reliability Engineer... ...automation of this GPU-powered infrastructure... ...workloads, automate systems at petascale, and be... ...performance computing (HPC) or AI/ML training...WebsitePermanent employment$58 - $63 per hour
About The Role As a Systems Research Engineer Intern specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely with the modeling and algorithm team, you will...Hourly payInternship$175k - $225k
...Principal Systems Engineer – GPU Supercluster Bringup We are building AI infrastructure for frontier-scale workloads. Our platform... ...scale AI superclusters across sites. You will own the full lifecycle... ...large-scale infrastructure or HPC environments. ~ Proven experience...WebsiteFlexible hoursNscale
San Francisco, CA5 days ago$156.86k - $191.72k
...Computing Center (NERSC) is seeking a System Infrastructure / Platform Engineer to help build and manage HPC systems and Linux-based... ...-edge technologies such as CPU/GPU clusters, parallel storage, high... ...position requires substantial on-site presence, but is eligible for a...WebsitePermanent employmentFull timeRemote workFlexible hours- Gravity Engineering Services Pvt Ltd. in San Francisco is looking for a specialized engineer to advance the efficiency of ML inference systems. The role encompasses algorithm design, system optimization, and the integration of RL-driven training techniques. Ideal candidates...
$350k
...a rapidly growing AI infrastructure provider... ...AI training and inference across global cloud and GPU environments. The organization... ...is for a Staff Site Reliability Engineer to lead the... ...maintain observability systems, GPU telemetry... ...environments, Slurm, or HPC schedulers...WebsitePermanent employment$225k
...‑specific RL, ultra‑long context, and inference‑time compute to achieve this goal. About The Role As a Software Engineer on the Inference & RL Systems team, you will design and operate the... ...eliminate performance bottlenecks across GPU, networking, and storage layers...RelocationVisa sponsorship- About Mistral At Mistral AI, we build high-... ...open, and efficient AI systems designed to power the next... ...systems, cloud platforms, and HPC environments to support... ...are looking for Systems Engineers / System Administrators... ...Code / automation tooling GPU or AI/ML experience Profile...
$160k - $220k
...Business Development Manager, AI Inference (Startup GTM) Position Type:... ...infrastructure, and direct engineering support for teams shipping to... ...Bay Area and able to work on‑site in Mountain View Preferred... ...selling AI infrastructure, MaaS, GPU compute, or LLM API products...WebsiteWork experience placement- A leading AI research company in San Francisco is seeking a software engineer for its Fleet High Performance Computing team. In this role, you'll ensure the reliability... ...of the compute fleet, working with automation systems and monitoring tools. Ideal candidates have...
- UCSF Health is seeking a Storage Systems Engineer (SYS ADM 4) to design, deploy and operate large-scale research storage and data infrastructure... ...cluster to enable performant and reliable data access for AI and data science workloads. Responsibilities include architecture...
- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing...
- Gravity Engineering Services Pvt Ltd. is seeking a Technical Program Manager for Inference in San Francisco, California. This role is essential... ...initiatives across inference systems, ensuring reliability and... ...program management within ML/AI systems, strong skills in stakeholder...
- # Senior Site Reliability EngineerHybrid - San Francisco... ...as both a central engineering function and an embedded... ...engineering and systems engineering. The best SREs... ...Experience with AIOps - using AI/ML-based tooling for... ...services (e.g., LLM inference latency, non-determinism...WebsiteWork at officeImmediate startWorldwideMonday to FridayFlexible hours
Careers at Drata
San Francisco, CA3 days ago $166.9k - $225.9k
...operates as both a central engineering function and an... ...software engineering and systems engineering. The best SREs... ...years of experience in Site Reliability Engineering... ...with AIOps—using AI/ML‑based tooling for anomaly... ...backed services (e.g., LLM inference latency, non‑...WebsiteFlexible hoursDrata
San Francisco, CA3 days ago- ...term career. Job Title: Founding Engineer, Systems & Infrastructure Location | On-Site — San Francisco, CA Time Zone | PST... ...technical core of a fast-moving AI video infrastructure startup. The... ...latency, throughput, memory, CPU/GPU, I/O - Track record of improving...WebsiteContract work
$150k - $300k
...cloud LLM serving, LLM inference optimization and RL systems. You will be working... ...across our cloud GPU fleets. GPU‑Aware Scheduling... ...: LLM Inference engine development and integration... .... Regular team off‑sites and conference... ...shape decentralized AI and RL at Prime Intellect...WebsiteWork at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work- .... is looking for a Member of Technical Staff focused on ML systems and inference in San Francisco. You will design and build inference systems... .... Candidates should have strong foundations in software engineering, experience with ML inference systems, and performance tuning...
$200.8k - $251k
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning... ...for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch...Full time$160k - $250k
...About the Team Together AI is building the Inference Platform that brings the... ...data centers and model engine pods. Develop auto-scaling systems to dynamically allocate... .... ~ Familiarity with GPU software stacks (CUDA, Triton, NCCL) and HPC technologies (InfiniBand...Full timeLocal area- IntelliPro is seeking a Business Development Manager for AI Inference in the Bay Area. You will own the front end of the sales motion, identifying... ...or handoffs to Account Management, reporting to the CMO. On-site presence in Mountain View is required. #J-18808-Ljbffr...Website
$175k - $250k
...Senior Cloud Infrastructure Engineer Location: San Francisco,... .... Modality: On-Site only. Must live within commuting... ...with generative AI. They are the team behind... ...large-scale distributed systems that power AI workloads.... ...scale Manage and automate GPU compute clusters using tools...WebsiteFull timeRemote workRelocationRelocation package- The CoreHPC team at UCSF is seeking an HPC Systems Engineer to play a key role in the development, maintenance, and day‑to‑day operations of the... ...UCSF researchers so they can address complex computational, AI, and data science problems. Responsibilities Define, design...Work experience placementWorldwide
$180k
...s mission is to create AI systems that can accurately understand... ..., and focused on engineering excellence. This... ...are seeking a talented Site Reliability Engineer (SRE... ...performance computing (HPC) infrastructure, powering... ...with HPC environments, GPU clusters, or large-scale...WebsiteTemporary workRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Systems Engineer — HPC & AI Inference (On-site). Be the first to apply!
Related searches
- application system engineer San Francisco, CA
- system engineer remote San Francisco, CA
- senior staff systems engineer San Francisco, CA
- data systems engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA
- mission system engineer San Francisco, CA
- director systems engineering San Francisco, CA
- senior windows systems engineer San Francisco, CA
- operations support system engineer San Francisco, CA
- distributed systems engineer San Francisco, CA