Sr. Cloud AI Infrastructure Engineer
$145.1k - $273.2kTencent America
Business Unit & What the Role Entails Architecture Research: Conduct in-depth research into the underlying hardware logic of various AI accelerators; evaluate the power-efficiency ratio and suitability of different heterogeneous architectures in the context of Large Language Model (LLM) inference and training. Operator & Performance Optimization: Design and optimize high-performance operator libraries for large-scale cloud computing environments; resolve long-tail latency issues in hardware scheduling, memory management, and distributed communication. Interconnect Architecture Definition: Define the interconnect architecture; drive the virtualization, standardized access, and efficient pooling of heterogeneous computing resources in the cloud. Technology Trend Analysis: Monitor global trends in semiconductors and accelerators; perform feasibility studies and experimental validation for the implementation of emerging technologies within cloud infrastructure. Who We Look For Education: Master’s or Ph.D. degree in Computer Engineering, Electronic Engineering, Microelectronics, or a related field. Core Expertise: Expertise in GPGPU architectures or other mainstream AI accelerator architectures. Programming & Frameworks: Proficient in parallel computing frameworks; deep understanding of low-level operator development languages (e.g., CUDA, Triton). Network & Distributed Systems: Solid understanding of large-scale distributed systems, cluster topologies (e.g., Fat-tree, Torus), and high-performance network protocols. Industry Insight: Familiar with the architectural evolution of global leading computing enterprises; ability to objectively analyze the technical pros/cons and engineering challenges of different architectural paths. Experience: Experience in the application, optimization, or architectural design of ultra-large-scale accelerator clusters is preferred. Framework Optimization: Experience in the low-level adaptation and performance tuning of mainstream deep learning frameworks (e.g., PyTorch, TensorFlow) is preferred. Location State(s): US-California-Palo Alto Compensation The expected base pay range for this position in the location(s) listed above is $145,100.00 to $273,200.00 per year. Actual pay may vary depending on job-related knowledge, skills, and experience. Employees hired for this position may be eligible for a sign on payment, relocation package, and restricted stock units, which will be evaluated on a case‑by‑case basis. Benefits Subject to the terms and conditions of the plans in effect, hired applicants are also eligible for medical, dental, vision, life and disability benefits, and participation in the Company’s 401(k) plan. The Employee is also eligible for up to 15 to 25 days of vacation per year (depending on the employee’s tenure), up to 13 days of holidays throughout the calendar year, and up to 10 days of paid sick leave per year. Your benefits may be adjusted to reflect your location, employment status, duration of employment with the company, and position level. Benefits may also be pro‑rated for those who start working during the calendar year. Equal Employment Opportunity As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals. #J-18808-Ljbffr
$220k - $350k
...with the ultimate goal of enabling human life on Mars. SR AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMS As an AI Engineer, Platform Infrastructure... .... Implement profile-driven rendering for public cloud, enterprise on-prem, and classified air-gap targets based...CloudSeniorPermanent employmentTemporary workImmediate startWeekend work$137.6k - $267k
...Itlearn360 in Mountain View, CA is seeking a Principal Software Engineer to work on AI security for Microsoft Copilot. You will tackle challenging... ...engineering experience in various programming languages and cloud platforms. Competitive compensation ranges from USD $137,600...CloudSenior$180k - $240k
...operations. About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform... ..., shadow deployments, and rollback mechanisms Cloud-Native Foundations & Data Integration Infrastructure as...CloudSeniorOdd jobWork at office- ...issues. Candidates must hold a Bachelor's degree and have programming experience in Python or C++, as well as expertise in machine learning infrastructure. The position comes with a competitive salary, bonus, equity, and comprehensive benefits. #J-18808-Ljbffr Google Inc.CloudSenior
$141k - $202k
...technology company based in Mountain View, CA seeks a Software Engineer to work on product development and GenAI solutions. This role demands proficiency in Python or C++ and machine learning infrastructure. You'll collaborate with teams, troubleshoot issues, and contribute...CloudSenior$160k - $240k
...redefining what’s possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI... ...'re looking for a skilled Platform Engineer to contribute to the development of... ...Experience with one of the major cloud platforms (AWS, GCP, or Azure) and...CloudSeniorLive inFlexible hours3 days per week$171k - $260k
...products. As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, Infrastructure Platforms team, you are an integral part... ...and deploy secure, scalable cloud infrastructure platforms optimized for AI and machine learning workloads. Collaborate...CloudSeniorFor contractors$170k - $240k
...remote if the candidate is in the Seattle, Washington area. About Us The AI Cloud and Developer Infrastructure organization is responsible for delivering and maintaining the tools and services engineers at GM use every day to do their best work and drive our cars forward....CloudSeniorWork experience placementWork at officeLocal areaRemote workRelocation packageFlexible hours3 days per week- ...Senior Lead Software Engineer Be an integral part of an agile team that... ...Chase within the Corporate Sector, Infrastructure Platforms team, you are an... ...Architect and deploy secure, scalable cloud infrastructure platforms optimized for AI and machine learning workloads....CloudSeniorFor contractors
- ...& Lineage team at GM builds core infrastructure that supports the end-to-end AI lifecycle of ML pipelines—from local... ...-facing interfaces, enabling ML engineers and researchers to develop, understand... ...: Utilize the latest cloud technologies (GCP/Azure) to design...CloudSeniorLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours
$356.5k
...NVIDIA Gruppe is seeking an experienced AI infrastructure software engineer to join its DGX Cloud AI Efficiency Team in Santa Clara, California. This role focuses on developing the infrastructure for optimizing AI workloads and ensuring high availability and efficiency...CloudSenior$170.6k - $261.3k
...leading automotive company in Sunnyvale seeks a Senior AI/ML Full-Stack Engineer to design and build software products for machine learning infrastructure. This hands-on role requires expertise in full-stack development, cloud technologies, and system design. The ideal...CloudSenior$168k - $322k
...NVIDIA Gruppe is seeking a Senior AI Platform Engineer to improve engineering efficiency and data security through AI... ...powered products. The role involves working with Cloud and AI/ML teams to build and scale infrastructure and shape the technological future of the...CloudSenior- ...Snorkel is seeking a Senior Software Engineer for its AI Platform in Redwood City, CA, focusing on architecting solutions for synthetic data... ...systems. This hybrid role calls for extensive experience in cloud-native software systems and deep knowledge in AI and ML. The...CloudSenior
- ...NVIDIA Gruppe in Santa Clara is looking for a seasoned engineer to work on their GeForce NOW Cloud Gaming service. Your main tasks will include architecting production-ready AI agents and enhancing customer experience through intelligent systems. The ideal candidate will...CloudSenior
- ...Palo Alto Networks, Inc. is seeking a Sr Principal Software Engineer to lead technical initiatives and deliver next-generation cloud security solutions. You will work collaboratively with cross-functional teams to tackle complex challenges in network security architecture...CloudSeniorFull time
- ...About Obvio AI Each year, more than 40,000 people in the U.S... ...lifecycle layer. Stand up the infrastructure that loads versioned CV models... ...pipeline downtime. Set the engineering standard. This is an early hire... ...for our use case. Strong cloud infrastructure fundamentals....CloudSeniorLocal area
$184k - $356.5k
NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming...CloudSenior- ...should have 5-7 years of experience in software development and test automation, with a proven ability to deliver reliable testing for cloud SaaS products. A strong background in Python, Go, and Javascript is essential. This role offers a competitive salary and benefits,...CloudSeniorFull timeContract work
$140k - $215k
CrowdStrike, Inc. is seeking a Software Development Engineer for the Cloud Runtime Protection team. In this role, you will design critical features for the Falcon platform, focusing on AI and cloud-native workloads. Experience with C/C++, Linux, and eBPF is required. This...CloudSeniorWork at office$140k - $215k
CrowdStrike, Inc. in Sunnyvale, California is seeking an AI Engineer to develop cutting-edge AI applications. The ideal candidate will have over 6 years experience in cloud app development, particularly in Generative AI Apps and cloud services like AWS, GCP, and Azure....CloudSenior2 days per week3 days per week$180k
...firm based in California seeks a skilled Detection & Response Engineer to enhance its security operations. This role involves detecting and responding to security incidents across cloud-native infrastructures, as well as conducting investigations and developing...Cloud- A leading technology company based in Sunnyvale, CA is seeking a Senior Staff Software Engineer to innovate within AI/ML and Google Cloud Applications. The role entails designing and enhancing large-scale software solutions, leading technical direction on impactful projects...CloudSenior
$120k - $192k
...Israelvcforum is seeking a highly skilled Applied AI Engineer to join the VMware Cloud Foundation Division in Palo Alto, California. This position... ...on VCF. The successful candidate will design AI infrastructure solutions, optimize AI workloads, and collaborate with...Cloud- ...Getaida, an innovative B2B enterprise AI company based in Palo Alto, is looking for a strong AI Engineer. The ideal candidate will have a solid background in building Large Language Models (LLMs) and an eye for new emerging models. This position involves collaborating...Cloud
$184k - $287.5k
...Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on developing tools... .... We are seeking an AI infrastructure software engineer to join our team. You'll be instrumental in...CloudSenior$184k - $287.5k
...Joining NVIDIA's DGX Cloud Lepton Team means contributing to the... ...product that powers innovative AI research and developers. We... ...well as developing scalable AI infrastructure services globally. We are... ...an AI infrastructure software engineer to join our team. You'll be instrumental...CloudSenior- Google Inc. is seeking a Senior Software Engineer for AI/ML in Sunnyvale, CA. The candidate will develop technologies that enhance user interaction and handle massive scale information. Responsibilities include writing code, testing, design collaboration, and ML solutions...CloudSenior
$212k - $318.4k
...Senior Software Engineer - AI Observability - AI, Search & Knowledge Platform Cupertino, California... ...Apple Intelligence, Search, and AI infrastructure powering Apple's intelligent products.... ...observability services, blending AI, cloud-first engineering, and industry standards...CloudSeniorRelocation package$152k - $241.5k
...NVIDIA is looking for an outstanding, passionate, and dedicated Senior AI Infrastructure Engineer to join our DGX Cloud group. This engineering role will design, build and maintain large-scale production systems with high efficiency and availability using a combination...CloudSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Cloud AI Infrastructure Engineer. Be the first to apply!
- senior cloud solutions architect Palo Alto, CA
- senior cloud security engineer Palo Alto, CA
- cloud network engineer Palo Alto, CA
- big data cloud engineer Palo Alto, CA
- cloud architect Palo Alto, CA
- cloud engineering manager Palo Alto, CA
- lead cloud architect Palo Alto, CA
- senior cloud data engineer Palo Alto, CA
- cloud engineer Palo Alto, CA
- remote cloud architect Palo Alto, CA

