Staff Software Engineer: AI Inference Infra & Kubernetes
Cerebras Systems
Cerebras Systems in Sunnyvale, CA is seeking a Member of Technical Staff (Software Engineer) to implement infrastructure for high-performance, low-latency inference services. Applicants should have a Master’s degree in Computer Science or a related field and at least one year of software development experience. The position involves deploying Kubernetes services, optimizing resource allocation, and collaborating with machine learning engineers. Strong skills in Docker, Python, and infrastructure documentation are essential. The environment supports growth and diversity in tech. #J-18808-Ljbffr Cerebras Systems
$188k - $275k
...Staff Software Engineer, Inference CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and... ...Inference team builds and operates CoreWeave's Kubernetes-native inference platform, powering low-...SuggestedPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hours$188k - $275k
...is The Essential Cloud for AI™. Built for pioneers by pioneers... ...at [ What You’ll Do: Inference Platform Team The... ...builds and operates CoreWeave’s Kubernetes-native inference platform,... .... About the role: As a Staff Software Engineer (IC5) on the Inference team...SuggestedPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$169.6k - $175k
Cerebras in Sunnyvale is seeking a Member of Technical Staff (Software Engineer) to implement infrastructure for high-performance inference services. You will deploy Kubernetes, optimize resource allocation, and develop Python scripts for data preprocessing. A Master’s...SuggestedRemote work$230k - $250k
...is seeking a Sr. Member of Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates... ...tools like Docker and Kubernetes. A competitive salary between $230,00...Suggested$220k - $250k
...Staff Software Engineer Crusoe is on a mission to accelerate the abundance of energy and intelligence... .... As the only vertically integrated AI infrastructure company built from the... ...instrumental in advancing our managed Kubernetes and AI training clusters, ensuring...SuggestedTemporary work$248.71k - $292.6k
About Groq Groq delivers fast, efficient AI inference. Our LPU-based system powers... ...anything is possible. Build fast. Sr. Staff Software Engineer - High Performance GPU Inference Systems... ...optimizing ML/HPC workloads on GPU clusters (Kubernetes, Slurm, Ray, etc.). Hands‑on...$179.4k - $303.6k
..., integrating advanced AI and autonomous driving... ...Work on systems such as inference platform, ETL pipeline,... ...Collaborate with ML algorithm engineers and data analysts to... ...big data engineers and infra engineers to build a... ...technology (Docker, Kubernetes); hands-on ML systems/ADAS...Full timeH1bWork visa$272k - $431.25k
...Principal Ai And Ml Infra Software Engineer, Gpu Clusters We are seeking a Principal AI and ML Infra... ...scheduling & orchestration (e.g., Slurm, Kubernetes, LSF), high-speed networking (e.g.,... ...processing, model training, and inference pipelines. ~ Proficiency in...- ...resilience. Powered by the Illumio AI Security Graph, our breach... ...Our Team's Vision: Our Engineering team is driven by a culture... ...container platforms such as Kubernetes, Istio, OpenShift, AKS, EKS,... ...building distributed & scalable software systems. ~ Proficient in at...Immediate start
- ...Systems builds the world's largest AI chip, 56 times larger than... ...-leading training and inference speeds and empowers machine learning... ...We're hiring a Staff Engineer to own major areas of the architecture... ...~8+ years of experience in software engineering, with substantial...
$262k - $365k
Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing... ...stack as we continue to push technology forward. Applied AI builds conversational agents deployed at a large...Full time$190k - $250k
A finance technology firm is seeking an AI Infrastructure Engineer to work in a hybrid environment. The role involves designing and managing Kubernetes clusters for AI model training and inference, optimizing Slurm-based environments, and developing robust APIs. Candidates...- ...computing experiences-from AI and data centers, to... ...looking for a Senior Staff AI Infra Engineer who is passionate... ...of hardware and software to optimize performance... ...accelerate LLM training and inference on AMD GPUs,... ...inference platforms using Kubernetes, Ray, or Kubeflow....
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our... ...deliver industry-leading training and inference speeds and empowers machine learning... ...inference services. About The Role As a software engineer on our AI cloud platform, you will work...
$275.8k - $340.5k
...the team: The AV ML Infra team at GM builds ML infrastructure... ...the unique demands of AI and ML innovation,... ...the productivity of ML engineers, and drive the adoption... ...: AI Validation & Inference: Ensures robust model... .... Experience with Kubernetes. Understanding...Local areaRemote workWork from homeRelocationRelocation packageFlexible hours- ...with hands-on experience in building multi-tenant SaaS platforms. The role requires knowledge of Kubernetes, cloud services (AWS/GCP/Azure), and the ability to integrate AI tools for enhancing productivity. Responsibilities include maintaining observability platforms and...
- Advanced Micro Devices in Santa Clara, California, seeks a strategic software engineering lead. This role entails developing techniques for optimizing key applications, particularly for large-scale inference within the K8s ecosystem. Successful candidates should possess...
$296.3k
...the team: The AV ML Infra team at GM builds ML infrastructure... ...the unique demands of AI and ML innovation,... ...the productivity of ML engineers, and drive the adoption... ...: AI Validation & Inference: Ensures robust model... .... Experience with Kubernetes. Understanding...Local areaWork from homeFlexible hours$165k - $242k
...Senior Software Engineer II, Inference Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology... ..., and hardware teams to evolve our Kubernetes-native inference platform and meet...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$192.6k - $305.6k
...Mountain View, CA, USA Staff Software Engineer, AI Authoring Location Mountain View, CA, USA... ..., including CI/CD automation, Kubernetes management, infrastructure-as-code,... ...implementation, powering asset generation, LLM inference, and the ML-driven tools that bring...Temporary workWork at officeWorldwideRelocation package$185k - $275k
...Staff Software Engineer, Cluster Orchestration Bellevue, WA / Sunnyvale, CA... ...is The Essential Cloud for AI™. Built for pioneers by pioneers... ...including SUNK (Slurm on Kubernetes) and beyond, our Kubernetes... ...powers AI training and inference at scale. This is an opportunity...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hours$145k - $235.5k
...Integrity, and Inclusion. We weave AI into the fabric of everything we do... ...Job Summary We are seeking a Sr Staff Software Engineer for our Global Infra Team to develop and maintain the backend... ...technologies, specifically Kubernetes and/or Docker. Knowledge of AI/ML...Full timeWork at officeVisa sponsorshipWork visa$184k - $230k
...Business Area: Engineering Seniority Level: Mid... ...Cloudera is looking for a Staff Software Engineer to join the Enterprise AI Platform team and help... ...enterprise-quality AI inference services powered by... ...development (Go, GRPC, SQL) on Kubernetes ~ Demonstrate...Work from homeRelocationFlexible hours$196.5k - $219.3k
...features. Mentor junior engineers on secure backend... ...delivery of high-quality software features while adhering... ...language models or other AI/ML systems (e.g. implementing model inference pipelines, fine-tuning... ...Docker) and orchestration (Kubernetes). Comfortable with...Full timeWorldwide$130k - $170k
NTT DATA, Inc. is seeking a Platform Engineer in Santa Clara, California, to lead the design... ...of scalable infrastructure platforms for AI/LLM solutions. You will act as a... ...posture while managing production-grade Kubernetes environments. The ideal candidate will have...$130k - $170k
NTT DATA is hiring a Platform Engineer in Santa Clara, California, to lead the design and operation... ...of scalable infrastructure supporting AI/LLM-based solutions. The ideal candidate... ...Engineering. Your role involves managing Kubernetes environments, driving Infrastructure-as-...- Google Inc. is looking for a Staff Software Engineer in Sunnyvale, CA, to develop next-generation technologies and lead high-impact projects and... ...with bonuses and equity. Join Google's mission to empower users through innovative AI solutions. #J-18808-Ljbffr Google Inc.
$184k - $287.5k
...We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency... ...with containers and orchestration (Docker, Kubernetes, Slurm); familiarity with Linux namespaces and cgroups...$181k - $297k
...seeking an HPC Network Engineer to design, deploy,... ...networks supporting AI/ML training, inference, and HPC workloads.... ...GPU, platform, and software teams to build scalable... .... As a Senior Staff Software Engineer, you... ...in host-level and Kubernetes pod networking architectures...For contractorsWork at officeFlexible hours$192k - $260k
...world's best data and AI infrastructure platform... ...in the world. Our engineering teams build highly technical... ...of the largest scale software platforms. The fleet... ...environments. Core Infra: Build the core... .... We run thousands of Kubernetes clusters across all regions...Work at officeLocal areaWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer: AI Inference Infra & Kubernetes. Be the first to apply!
- javascript software engineer Sunnyvale, CA
- senior c# .net software developer Sunnyvale, CA
- ultimate software Sunnyvale, CA
- software technical support engineer Sunnyvale, CA
- software intern Sunnyvale, CA
- healthcare software sales Sunnyvale, CA
- mobile software developer Sunnyvale, CA
- software quality assurance Sunnyvale, CA
- software sales Sunnyvale, CA
- embedded software Sunnyvale, CA

