Senior AI Infra Engineer: LLMOps, GPU, Kubernetes
eloquentai
Eloquent AI is seeking a Senior Software Engineer, AIOps & Infrastructure based in San Francisco. The role involves designing scalable AI infrastructure, automating MLOps workflows, and optimizing AI systems for efficiency. Applicants should have over 5 years of experience in software engineering, deep expertise in Kubernetes, and a strong understanding of cloud platforms. Join us in redefining AI operations! #J-18808-Ljbffr eloquentai
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Infra Engineer: LLMOps, GPU, Kubernetes in San Francisco, CA vacancy
- ...Francisco is partnering with a rapidly growing AI infrastructure company to own the core... ...heterogeneous AI cloud. You will manage large CPU/GPU/accelerator clusters, bare‑metal provisioning, and production readiness across Kubernetes and other schedulers. This role focuses on...Senior
- Harrison Clarke is seeking a Senior Platform Engineer to take ownership of their core platform... ...involves designing multi-region Kubernetes clusters, managing GPU infrastructure, overseeing networking... ...you have a passion for building AI systems, apply now! #J-18808-Ljbffr...Senior
$225k - $250k
...the leading open‑source AI coding agent. Trusted by the world's largest engineering organizations and... ...engineers and ML teams. As a Senior Infrastructure Engineer... ...resource utilization (GPU scheduling, autoscaling... ...container orchestration (Kubernetes, Helm). Strong...Senior- Seekr is building the next generation of enterprise AI infrastructure. As a Staff AI Infrastructure Engineer, you will design, build, and operate the... ...agents. You will work across distributed systems, Kubernetes, GPU infrastructure, high‑performance inference, and enterprise...Suggested
- Gravity Engineering Services Pvt Ltd. is seeking an experienced software engineer specialized in machine learning infrastructure. The... ...have over 10 years of experience, deep expertise in Python, Kubernetes, and a strong understanding of cloud platforms. An ideal candidate...Senior
$220k
Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience...Senior$190k - $270k
AI Chopping Block, Inc. is looking for an AI Infrastructure Engineer to maintain user-facing services and production systems. You'll lead operations with tools like Ansible, Terraform, and Kubernetes while ensuring reliability and scalability. The role requires a strong...Senior- ...source technology company in San Francisco is seeking a Senior Cloud Infrastructure Engineer to design and manage large-scale distributed systems.... ...infrastructure engineering, is skilled in tools like Python, Kubernetes, and Terraform, and thrives in a fast-paced startup...Senior
$160k - $225k
Cacheflow is seeking a Senior Software Engineer for AI Runtime at Databricks, located in San Francisco. You will be instrumental in building and scaling systems for large-scale GPU training, ensuring high throughput and resilience in training across expansive fleets of...Senior- Gravity Engineering Services Pvt Ltd. is seeking a Senior Software Engineer for AI Runtime in San Francisco, California. The role involves driving the architecture of a managed GPU training platform, solving complex training challenges, and enhancing performance and reliability...Senior
- Dynamo AI is looking for a Senior Software Engineer to design, develop, and maintain secure and scalable infrastructure and applications. This role involves... ...candidate will have over 3 years of experience with Kubernetes and cloud services, and strong coding skills in...Senior
- Accenture is seeking a seasoned AI Infrastructure Architect in San Francisco to design and implement scalable AI infrastructure, including... ...for enterprise clients. The role requires deep experience with GPU/DPUs, networking, storage, and orchestration tools, plus strong...Senior
$135.2k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level,... ..., high throughput, GPU efficiency, reliability,... ...Establish AgentOps and LLMOps practices for tracing, monitoring... ...~ Strong expertise with Kubernetes, Docker, cloud-native...SeniorTemporary workFlexible hoursOracle
San Francisco, CA19 hours ago- Crusoe Energy Systems is seeking a Production Engineer in San Francisco to design and operate cloud infrastructure for AI-first compute environments. This role... ...cloud providers like GCP or AWS and expertise in Kubernetes. The ideal candidate will have a track record...Senior
- ...security research , Strong expertise across the AI/ML stack, including MLOps, inference architectures... ...and securing LLM pipelines and AI workflows in Kubernetes and/or bare-metal environments , Strong software engineering foundations with experience shipping production...Senior
- ...seeking an experienced Infrastructure Security Engineer to design and implement security in a... ...environment. You'll be essential in securing Kubernetes ecosystems while defining the long-term security roadmap for advanced AI systems. Your role includes auditing, hardening...Senior
- QuantumBlack, AI by McKinsey is seeking a Platform Engineer in San Francisco to deploy and scale cutting-edge AI platforms. This role requires a blend of... ..., proficiency in Python, and a strong grasp of Kubernetes. The position offers a competitive salary, a global community...Senior
- BrainCo in California is seeking an experienced infrastructure engineer to design and scale their AI application infrastructure. You will work on Kubernetes and Terraform-based systems, ensuring reliability under growing workloads while supporting high-performance data...
$96.8k - $306.4k
Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands... ..., high throughput, GPU efficiency, reliability,... ...Establish AgentOps and LLMOps practices for tracing, monitoring... ...Strong expertise with Kubernetes, Docker, cloud‑native...SeniorTemporary workFlexible hours- Compa is seeking a Staff Engineer for their Platform team in San Francisco, California. The... ...platform engineering across cloud, data, and AI/ML systems, driving multi-cloud... ...software engineering experience, strong Kubernetes and Python skills, and a passion for building...Senior
$115k - $140k
Lightning-Ai in San Francisco is seeking an AI Platform Support Engineer to support engineering teams with ML training and inference workloads. The role is vital... ...successful candidate will have extensive experience with Kubernetes, distributed ML systems, and debugging tools like...Work at office2 days per week$180k - $250k
...build custom compute environments in San Francisco. Responsibilities include managing Linux and Kubernetes, optimizing GPU performance, and automating provisioning with AI. Candidates should have over 5 years of Linux virtualization experience, strong networking skills...SeniorVisa sponsorship- ...interact with the web by building AI agents that can reliably do... ...Responsibilities: Scale infra for post-training of multimodal... ...Work closely with product engineers to translate cutting‑edge AI capabilities... ...with ML infrastructure (GPU clusters) and supporting networking...Work at officeRelocationVisa sponsorship
Yutori
San Francisco, CA1 day ago - ...Brain Co. is an applied AI startup co-founded by... ...Role: As our Security Engineer, Infrastructure, you'll... ...cloud infrastructure, Kubernetes, identity, networking,... ...shoulder-to-shoulder with our infra team as a true... ...forward. Work alongside senior engineers from Tesla, DeepMind...Worldwide
- Baseten in San Francisco seeks an engineer to own the Model API surface for... ...serving experiences across multi‑GPU setups. You will collaborate with product and infra teams to ship robust APIs, metering... ...to a platform used by leading AI deployments. #J-18808-Ljbffr Baseten
- Together AI is building the AI Acceleration Cloud. We seek an experienced observability and infrastructure engineer to design scalable monitoring, logging, and tracing for a distributed AI platform, enabling real-time insights and reliable operations. Responsibilities...Senior
$216.2k - $270.25k
A technology company is seeking a Software Engineer to join their ML Infrastructure team in San Francisco. You will design platforms for... ...Compensations include a base salary range of $216,200—$270,250 USD, plus equity and comprehensive benefits. #J-18808-Ljbffr Scale AISenior- ...seeking a Principal Customer Reliability Engineer to define the technical reliability... ...designs and scales high-performance GPU infrastructure and includes... ...experience, with deep expertise in Linux, Kubernetes, and large-scale AI workloads. Excellent communication skills...
$180k - $220k
A tech company specialized in AI is looking for a Senior Application Security Engineer to secure AI, machine learning, and inference platforms. The role requires deep security reviews and implementing security within modern AI infrastructure. Candidates should have strong...Senior- Kindredventures is hiring senior and staff engineers for our AI product engineering team in San Francisco. This hands-on role focuses on fine-tuning LLMs and optimizing data flows, impacting how companies hire exceptional talent. The ideal candidate will have 5+ years of...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infra Engineer: LLMOps, GPU, Kubernetes. Be the first to apply!
Related searches
- ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- senior trade analyst San Francisco, CA
- senior app developer San Francisco, CA