AI Infra SRE: Scalable On‑Prem & Cloud Ops
Calance
Calance is hiring for a Site Reliability Engineer to own the reliability and automation of our infrastructure across colo, on-prem labs, and cloud platforms (AWS/Azure/GCP). You will provision servers, configure OS and networks, manage storage, and troubleshoot hardware from bare metal to live incidents. You will build and operate IaC with Terraform and Ansible, create automated remediation and self-service tooling, and develop monitoring dashboards and alerting using Prometheus, Grafana, and #J-18808-Ljbffr Calance
- ...looking for experienced professionals to enhance their cloud infrastructure. You will craft scalable solutions handling millions of jobs and petabytes of storage... ...successful candidate must have a strong background in AI/ML and cloud solutions, with over 8 years in...Cloud
- NVIDIA is seeking a highly skilled engineer to architect and scale AI infrastructure across on-prem and cloud environments. You will act as a technical specialist supporting sales and customer accounts, with emphasis on deep learning inference and NVIDIA systems expertise...Cloud
$118k - $170k
...you will work on large-scale cloud networking platforms that support... ...working with modern cloud and SRE technologies in a... ...to help improve reliability, scalability, operational excellence, and customer... ...environments. Our solutions combine AI-powered automation, proactive...CloudWork at officeRelocation3 days per week$170.7k - $300.2k
...California. This position focuses on building and supporting large-scale distributed systems using cloud technologies like AWS and Kubernetes. With 8+ years of experience in SRE/MLOps and strong programming skills in Python/Java, ideal candidates will contribute to...Cloud$168k - $322k
NVIDIA in Santa Clara is hiring a Senior AI Platform Engineer to build and maintain next-gen AI-powered enterprise products. This role requires 10+ years of experience in cloud, platform, or SRE roles. Responsibilities include architecting infrastructure, mentoring, and...Cloud- NVIDIA is seeking a Senior Site Reliability Engineer (SRE) to join the Compute Farm team in Santa Clara, California. This role involves... ...will have extensive experience working with HPC solutions and cloud environments. Key responsibilities include automating service provisioning...Cloud
$208k - $327.75k
...Architect to define and design enterprise AI factory reference architectures in Santa Clara... ...architecture and expertise in AI and cloud-native infrastructure. This role encompasses... ...and executing plans, while ensuring scalable and high-performance solutions. The position...Cloud- Phizenix is seeking a hands‑on Site Reliability Engineer to own infrastructure across colo, on‑prem, and cloud environments. You will provision, configure, and troubleshoot hardware and services, build automation, and manage networking interconnects. You will design monitoring...CloudPermanent employment
- ...Site Reliability Engineer to design and operate cloud-native infrastructure across GCP and AWS. This role involves leveraging AI and automation to enhance operational... ...candidate will have over 7 years of experience in SRE or DevOps, with expertise in multi-cloud environments...Cloud
- Google in Sunnyvale, CA seeks a Software Engineering Manager II to lead the AI and Infrastructure team within Google Cloud Compute. You will guide multiple teams, shape technical roadmaps, and ensure delivery of large‑scale infrastructure projects while mentoring engineers...Cloud
- Siemens is seeking a Software Engineer to help shape AI-native products that blend cloud, ML, and hardware. You will define robust, scalable architecture and guide teams across infra, ML, and product to deliver impactful, intelligent systems. The role emphasizes technical...Cloud
- ...logistics, is seeking a Senior/Staff Site Reliability Engineer to support scalable, reliable data offload for our fleet. You will partner with infra and platform teams to manage on‑prem and cloud environments, develop BI dashboards, and automate monitoring and deployments...CloudWork at officeRemote work
- ...in Santa Clara to redefine the operational future of Enterprise AI. You will manage the software-defined transformation of DGX hardware... ...has over 12 years in Product Management with expertise in cloud-native environments and on-premise infrastructure management. This...Cloud
- ...our CPU Compute platform. You’ll drive end-to-end technical management for initiatives in large AI clusters. The ideal candidate will have significant experience in cloud infrastructure, manage technical programs effectively, and excel in defining milestones and deliverables...Cloud
- Crusoe Energy Systems in Sunnyvale, California, is seeking a Site Reliability Engineer focused on sustainable AI-first cloud infrastructure. You will leverage over 5 years of experience in Linux systems and virtualization to optimize Crusoe's compute capabilities. This...Cloud
- VITURE, based in Cupertino, CA, is seeking an experienced Site Reliability Engineer to build and scale cloud infrastructure vital for our intelligent eyewear. You will create and maintain highly available environments, working closely with teams across hardware and software...Cloud
$218.8k - $335.3k
Job Description Staff AI/ML Engineer, AV ML Infra We're General Motors (GM), a company driving the future... ..., Data Science, and more. We enable scalable and efficient ML experimentation,... ...scale ML training and inference across cloud and on-premcomputeresources. AV Pipelines...CloudLocal areaWork from homeFlexible hours- ...Site Reliability Engineer to manage large-scale systems and ensure reliability for Google Workspace. The role requires oversight of AI features, operating storage topologies, and orchestrating data recovery operations, making it crucial for maintaining service integrity...Cloud
$166k - $244k
Senior Software Engineer, Infra, Vertex Gemini API+ Serving - Sunnyvale... ...this role, you will build the scalable and reliable infrastructure... ...and technology on the Vertex AI platform, bridging the gap... ...applications. Design and implement cloud APIs and services for model...CloudFull time- Sr. Product Manager - Runtime Infra, AI/ML, Annapurna Labs (Cupertino) An Amazon Web Services... ...best-in‑class ML performance in the cloud. You will lead runtime and infrastructure... ...from customer needs, drive performance and scalability features across Neuron Runtime and...Cloud
$192.6k - $289k
...intelligent edge, focusing on AI, edge computing and connectivity... ...and industries. AI on‑prem Appliance is a new product line... ...on‑device, on‑prem, and hybrid cloud scenarios. As a Principal Agentic... ...define, develop, document and own scalable and customizable blueprints...CloudWork experience placementWork from home$272k - $431.25k
...hiring a Principal Software Engineer for its DGX Cloud team in Santa Clara, CA. This role involves leading the development of scalable systems that drive NVIDIA's GPU... ...equity and benefits. If you're passionate about AI and cloud computing, join us to craft platforms...Cloud$200k - $322k
Senior Technical Program Manager - Cloud Security As a Senior Technical... ...This role ensures Product and Infra Security is woven into... ...teams in Security, Compliance, SRE, and Engineering to continually... ...and help us build the future of AI infrastructure with your expertise...Cloud- ...Description: The Principal Cloud and Production... ...hands-on builder, ensuring scalability, resilience, and security... ...across multi-cloud and on-prem environments.... ...engineering teams to implement SRE-inspired practices, including... ...model •Exposure to AI/ML infrastructure or data...Cloud
- A leading electric vehicle manufacturer is seeking a Staff Software Engineer, Data Ops in Palo Alto, CA to join their Data team. This role requires expertise in cloud and data engineering, particularly with the AWS Cloud Data Platform. Responsibilities include building...Cloud
$300 per month
...engine that powers a world where people can create ambitiously with AI — without sacrificing scale, speed, or sustainability. Be a part... ...a team that’s setting the pace for responsible, transformative cloud infrastructure. About the Role: We are seeking a Production...CloudTemporary work$196k - $368k
NVIDIA is looking for an experienced architect to create scalable datacenter solutions for enterprise AI and ML systems. This role requires a bachelor's degree... ...infrastructure architecture, as well as expertise in cloud-native solutions. The ideal candidate will lead...Cloud- ...technology company for AI and Bitcoin mining... ...offers advanced cloud capabilities to customers... ...and hands-on Cloud SRE Architect to lead... ..., ensuring global scalability, reliability, and... ...-engineering / infra-architecture, including... ...— NVIDIA GPU ops (DCGM, MIG, vGPU, NVLink...CloudFull timeContract workLocal areaShift work
- ...position allows you to architect and build foundational data platform infrastructure that supports Crusoe's AI and cloud operations. Your role includes designing scalable data systems, driving technical excellence, and collaborating with software engineers and data...CloudFull time
- General Motors is seeking a Staff AI/ML Engineer in Sunnyvale, California, to drive the design and implementation of scalable ML infrastructure solutions. This role focuses on the... ...in distributed systems and proficiency in cloud technologies such as GCP and Azure. Join GM...Cloud
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infra SRE: Scalable On‑Prem & Cloud Ops. Be the first to apply!

