Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift - An LTTS Company

Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distributed AI-RAN Environments) We challenge conventional limits by building transformative products that fully exploit our state-of-the-art (SOTA) infrastructure—including NVIDIA GB200 (e.g., liquid‑cooled NVL72 rack‑scale systems with 72 Blackwell GPUs and 36 Grace CPUs unified via massive NVLink domains), MGX modular architectures, and DGX Grace Hopper platforms—combined with cloud‑native software. These solutions power massive centralized AI data centers and pioneering distributed AI Radio Access Network (AI‑RAN) deployments, where AI is embedded directly into radio networks for superior efficiency, edge intelligence, and new capabilities. We're seeking experienced senior engineers passionate about innovation, ready to shape foundational AI infrastructure software on world‑class GPU systems. Minimum Qualifications Bachelor's degree in Computer Science, Electrical Engineering, or a related technical field. 5+ years of experience in software engineering, hardware platforms, distributed systems, or infrastructure development. 2+ years in technical lead roles, owning high‑impact projects and leading teams. Proven hands‑on experience building systems software, AI frameworks, or applied AI systems. Preferred Qualifications Master's degree in a relevant technical discipline (e.g., CS, Systems Engineering). Direct experience with Kubernetes and container orchestration at scale. Hands‑on work with GPU‑accelerated systems and high‑performance computing (HPC) environments. Familiarity with AI developer frameworks, MLOps tools, automation pipelines, and CI/CD systems. Role Overview Join our infrastructure team as a key contributor building foundational systems software atop next‑generation GPU platforms to support large‑scale AI workloads (training, fine‑tuning, and serving). Own significant portions of our new AI infrastructure stack, with a strong emphasis on Kubernetes orchestration and GPU resource management. Drive architectural innovation in systems software and automation to achieve maximum efficiency and utilization. As a Senior Software Engineer, collaborate closely with Engineering Leads, Product Management, and Program teams to execute toward commercialization and market impact. Key Responsibilities Design and develop robust systems software to enable AI workloads on large‑scale GPU clusters (e.g., GB200 NVL72 rack‑scale systems). Deliver critical control plane components for workload scheduling, orchestration, and resource management; build management plane for underlying hardware platforms. Create northbound APIs and interfaces for customer portals and self‑service access to the infrastructure. Contribute to product requirements documents (PRDs), sprint planning, and agile program execution. Help attract, mentor, and grow top engineering talent. Exemplify and cultivate a culture of humility, bold innovation, and disciplined delivery to bring products to market. We are pushing the boundaries of AI by challenging conventional approaches and building groundbreaking products that fully harness our state‑of‑the‑art (SOTA) infrastructure—including NVIDIA GB200 NVL72 (liquid‑cooled, 72‑GPU rack‑scale systems with massive NVLink domains for exascale performance), MGX modular architectures, and DGX Grace Hopper platforms. These products power both massive centralized AI data centers and innovative distributed AI Radio Access Network (AI‑RAN) deployments, where AI is natively integrated into radio networks for enhanced efficiency, edge intelligence, and new revenue opportunities. We're seeking passionate, experienced practitioners eager to drive innovation and deliver transformative AI products on world‑class hardware. Minimum Qualifications Bachelor's degree in Computer Science, Electrical Engineering, Mathematics, Statistics, or a related technical field. 3+ years of hands‑on experience in machine learning, deep learning, and software engineering. Proficiency in Python; experience with C/C++. Strong working knowledge of major AI/ML frameworks (PyTorch, TensorFlow, JAX, or similar). Solid foundation in data structures, algorithms, and software design principles. Preferred Qualifications Master's or PhD in Computer Science, AI/ML, or a related discipline. Experience with Large Language Models (LLMs), Generative AI, or Computer Vision. Familiarity with distributed training frameworks and techniques (e.g., Ray, DeepSpeed, Megatron‑LM). Proven expertise optimizing models for GPU inference (e.g., TensorRT, Triton Inference Server). Knowledge of MLOps tools and practices (Kubeflow, MLflow, etc.). Role Overview As a core member of our AI engineering team, you will design, develop, and optimize cutting‑edge AI models and workloads that run natively on our high‑performance GPU clusters. Leverage our SOTA infrastructure to train, fine‑tune, and serve massive‑scale models at unprecedented efficiency. Collaborate across infrastructure, product, and research teams to align hardware capabilities with real‑world AI demands, driving breakthroughs in performance, scalability, and innovation. Key Responsibilities Design, implement, and train state‑of‑the‑art ML models for high‑impact applications (e.g., NLP, Computer Vision, Network Optimization). Optimize AI workloads for extreme performance and scalability on large‑scale GPU systems like GB200 NVL72, using tools such as Dynamo, vLLM, and advanced inference engines. Partner with cross‑functional teams to co‑design hardware‑software solutions that maximize AI processing efficiency. Build robust tools, data pipelines, evaluation frameworks, and deployment systems. Track and incorporate the latest AI research and technological advancements. Contribute to product requirements (PRDs) and agile execution (sprint planning and delivery). Champion a culture of humility, bold innovation, and high‑velocity product delivery. #J-18808-Ljbffr Intelliswift - An LTTS Company

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...] in Sunnyvale, CA vacancy
  • $174k - $253k

     ...maintaining, or launching software products, and 1...  ...large-scale infrastructure, distributed systems...  ...experience with data structures/algorithms...  ...Google's software engineers develop the next-...  ...our data centers to building the next...  ...experience possible. The AI and Infrastructure... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $207k - $275k

     ...is The Essential Cloud for AI™. Built for pioneers by pioneers...  ...combines superior infrastructure performance with deep technical...  ...SaaS platform that lets our engineers ship software quickly, reliably, and...  ...each day in our office and data center locations A casual work environment... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    4 days ago
  • $174k - $253k

     ...of experience with software development in C++...  ...large-scale infrastructure, distributed systems...  ...of experience with data structures and algorithms...  ...Google's software engineers develop the next-...  ...our data centers to building the next...  ...experience possible. The AI and Infrastructure... 
    Senior
    Temporary work
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $166k - $244k

    Senior Software Engineer, Infrastructure, Platforms Infrastructure Engineering Mid Experience...  ...languages, and with data structures/algorithms. 3...  ...software solutions. The AI and Infrastructure team works...  ...users worldwide. We’re at the center of amazing work at Google... 
    Senior
    Full time
    Worldwide

    Google Inc.

    Sunnyvale, CA
    3 days ago
  • $165k - $242k

     ...Essential Cloud for AI™. Built for...  ...combines superior infrastructure performance with...  ...About The Role The Data Platforms Team serves...  ...We are seeking a senior engineer with...  ...experience in a software or infrastructure...  ...office and data center locations A casual... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    4 days ago
  • Senior Software Engineer, Server Fleet Infrastructure Join to apply for the Senior Software Engineer, Server Fleet Infrastructure...  ...role at CoreWeave Get AI-powered advice on this job and more...  ...operated a growing footprint of data centers covering every region of the US and... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    4 days ago
  • $200k - $220k

     ...vertically integrated AI infrastructure company built from...  ...energy, manufacturing, data center construction, and...  ...Crusoe Energy as a Senior Data Engineer, an early and pivotal...  ...hire on our growing central Data Science and Engineering...  ...Teams: Partner with software engineers, data... 
    Senior
    Full time
    Temporary work

    Crusoe Energy Systems

    Sunnyvale, CA
    4 days ago
  • $184k - $287.5k

     ...Libraries Group is seeking excellent software engineers to enable the next wave of NVIDIA’s highest...  ...design and develop scalable, modular infrastructure that streamlines development, build,...  ...for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  •  ...builds the shared infrastructure that helps DoorDash...  ...for Generative AI at DoorDash, leading...  ...serving and inference engines, fine‑tuning and...  ...engineers, data scientists, and platform...  ...of DoorDash’s centralized GenAI platform, including...  ...experience in software engineering. Deep... 
    Senior
    Hourly pay
    Work at office
    Flexible hours

    DoorDash

    Sunnyvale, CA
    4 days ago
  • $152k - $241.5k

    NVIDIA seeks a senior software engineer to join the AI Networking co‑design and benchmark R&D team. In this pivotal role, the candidate is responsible...  ...the most efficient utilization of system resources at data center scale. The role involves working on distributed Deep... 
    Senior

    Nvidia Corporation

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...is seeking an exceptional Senior Software Engineer to help design and build our...  ...for scalable cloud infrastructure powered by Kubernetes, ConnectX...  ...largest supercomputers and data centers. This is a fast‑paced,...  ...solutions to accelerate HPC and AI workloads using NVIDIA’s... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $300 per month

     ...As the only vertically integrated AI infrastructure company built from the ground up, we...  ...experts across energy, manufacturing, data center construction, and cloud services....  ...at Crusoe. About the Role: As a Senior Software Engineer - Software Defined Networking, you... 
    Senior
    Temporary work

    Crusoe Energy Systems

    Sunnyvale, CA
    4 days ago
  • $224k - $356.5k

     ...transforming how the world uses AI, cloud, and accelerated computing, and trust is at the center of that mission. Our...  ...integrity of NVIDIA platforms across data center, AI, networking, and partner...  ...and containers, CI/CD, infrastructure as code, observability tools,... 
    Senior

    NVIDIA AI

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...forefront of the generative AI revolution, building the software and systems that power...  .... We are looking for a Senior Software Engineer to lead the bring-up,...  ...‑scale AI clusters, infrastructure, and end‑to‑end workloads...  ...LLM workloads using data, tensor, pipeline, and... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $156k - $229k

    Senior DFT Engineer, Test Infrastructure, Google Cloud Sunnyvale, CA, USA Job Level...  ...with PCIE, Double Data Rate (DDR) and HBM...  ...shape the future of AI/ML hardware acceleration...  ...the future. From software to hardware our teams...  ...Networking, Data Center operations, systems... 
    Senior
    Full time
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • $224k - $356.5k

     ...into the unlimited potential of AI to define the next era of...  ...security, silicon, and cloud engineering teams to turn embedded hardware...  ...and digital systems across Data Center, Automotive, Networking, and...  ...security, silicon, platform, and software teams to deliver end‑to‑end... 
    Senior
    Remote work

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...increasingly known as “the AI computing company.” We are...  ..., creative Factory System Software and Diagnostics Integration engineer to join the Datacenter...  ...Monitor, collect, and analyze data to identify and address...  ...up and deployment in data centers. Proven understanding of Firmware... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $174k - $253k

     ...maintaining, or launching software products, and 1 year...  ...large-scale infrastructure, distributed systems or...  ...years of experience with data structures/algorithms....  ...job Google's software engineers develop the next-generation...  ...maintaining our data centers to building the next generation... 
    Senior

    Google

    Sunnyvale, CA
    4 days ago
  • $182k - $242k

     ...Essential Cloud for AI™. Built for...  ...combines superior infrastructure performance with...  ...CoreWeave's Fleet Engineering Organization, which...  ...This team plays a central role in CoreWeave...  ...hardware RMA, data center operations, node...  ...the role: As a Senior Software Engineer on the Box... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    8 days ago
  • $139k - $204k

    CoreWeave, the AI Hyperscaler™, acquired Weights...  ...growing footprint of data centers covering every region...  ...industry‑leading cloud infrastructure with the best‑in‑class...  ...at the intersection of software, hardware, and AI,...  ...The Role As a Software Engineer, you’ll lead efforts to... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Weights & Biases

    Sunnyvale, CA
    4 days ago
  • $182k - $242k

     ...Essential Cloud for AI™. Built for pioneers...  ...CoreWeave combines superior infrastructure performance with...  ...and innovative Senior Software Engineer of Network Services...  ...to protect customer data and infrastructure....  ...our office and data center locations * A casual... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • $165k - $242k

     ...Essential Cloud for AI™. Built for...  ...combines superior infrastructure performance with...  ...standing up new data centers at an extraordinary...  ...that gives network engineers, fleet engineers,...  ...of sites. As a senior backend engineer...  ...to build bespoke software to model our infrastructure... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    more than 2 months ago
  • $159k - $231k

    Senior Robotics Automation Engineer, Platforms Infrastructure This is a specialized role which requires physical...  ...in a simulated data center environment, utilizing...  ...compliance with embodied AI safety standards across...  ...closely with hardware, software and system engineers to... 
    Senior
    Contract work
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $174k - $253k

    Google is seeking a Software Engineer in Sunnyvale, CA, to develop next-generation technologies that change user interactions. This role...  ...development, technical leadership, and a background in large-scale infrastructure and distributed systems. This position offers a competitive... 
    Senior

    Google

    Sunnyvale, CA
    4 days ago
  • $182k - $242k

     ...Essential Cloud for AI™. Built for...  ...superior infrastructure performance with...  ...Infrastructure Engineering team sits at...  ...the core of our Data Infrastructure...  ...role: As a Senior Software Engineer, you...  ...while playing a central role in building...  ...and data center locations A casual... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    2 days ago
  • $236k - $330k

     ...equipment in a simulated data center environment,...  ...development and processing of engineering hardware must be...  ...latency tele-operation infrastructure, haptic feedback...  ...closely with hardware, software, and system engineers...  ...compute environments. The AI and Infrastructure... 
    Senior
    Contract work
    Remote work
    Worldwide
    Flexible hours

    Google

    Sunnyvale, CA
    4 days ago
  • $168k - $264.5k

    NVIDIA is at the forefront of where AI meets VLSI, merging innovative technology with a legacy of innovation. Join our CAD team...  ...highly automated and customizable flows using modular software engineering and object‑oriented techniques. Collaborate closely with a diverse... 
    Senior
    Work experience placement

    NVIDIA AI

    Santa Clara, CA
    4 days ago
  • $204k - $259k

     ...The Simulation ML Infrastructure team builds scalable AI/ML infrastructure to...  ...seek an experienced senior IC to lead the...  ...role reports to an Engineering Manager. You will:...  ...the intersection of data engineering, model...  ...years of professional software engineering experience... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    4 days ago
  • $216k - $333.5k

    Are you an experienced Software Infrastructure Engineer looking for an opportunity in Autonomous Vehicles Software? Come and join our international team! The continuous integration (CI) environment of Autonomous Vehicles Software (AV SW) group is a critical resource for... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    With the latest advances in AI, verification and feedback loops...  ...becoming the clock speed of software development. We are looking...  ...who wants to build AI speed infrastructure for Tegra: a ridiculously...  ...fundamentally a performance engineering role. You will be ruthlessly... 
    Senior
    Local area
    Remote work

    NVIDIA

    Santa Clara, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]. Be the first to apply!