Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineering Manager - KV Cache Platform

$225k - $275k

DataDirect Networks

DDN is seeking a Senior Software Engineering Manager to lead the engineering organization responsible for our KV Cache Platform—a distributed memory and storage platform that accelerates large-scale LLM inference across GPU clusters.In this role, you will lead geographically distributed engineering teams responsible for building highly scalable, low-latency distributed systems that power AI inference. You will define the technical vision and execution strategy for the platform while partnering closely with Product Management, Sales, Customer Engineering, NVIDIA, and executive leadership to deliver innovative AI infrastructure that meets customer needs and supports DDN's long-term product strategy.This is a highly visible leadership role with responsibility for engineering execution, customer success, roadmap delivery, and building a world-class engineering organization.ResponsibilitiesLead, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical excellence, innovation, ownership, and collaboration.Define and execute the technical strategy and roadmap for the KV Cache Platform, ensuring scalability, reliability, security, and operational excellence.Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, NVIDIA BlueField DPUs, and emerging AI infrastructure technologies.Partner closely with Product Management, Sales, Customer Engineering, NVIDIA, and strategic technology partners to prioritize customer requirements, drive proof-of-concepts (POCs), influence product direction, and successfully deliver customer deployments.Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure timely, high-quality software delivery.Establish engineering best practices for software quality, observability, automation, performance, testing, and production readiness.Collaborate across engineering, infrastructure, and hardware teams to deliver scalable, production-ready AI infrastructure while developing future engineering leaders and driving continuous improvement.QualificationsRequired15+ years of experience building distributed systems, cloud infrastructure, storage platforms, or AI infrastructure software.7+ years leading high-performing software engineering organizations, including geographically distributed teams.Proven experience delivering large-scale distributed infrastructure products from architecture through production deployment.Strong background in distributed systems, Linux, networking, performance engineering, and cloud-native architectures.Hands-on programming experience with Go and Python; experience with C/C++ is a plus.Demonstrated ability to lead cross-functional initiatives and influence technical direction across multiple organizations.Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions.Experience with technologies such as NVIDIA Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure.Background in HPC, distributed storage, networking, or enterprise infrastructure software.Experience working directly with strategic customers, technology partners, OEMs, or hyperscalers to deliver enterprise AI solutions.Compensation Range: $225K - $275KLocationSanta Clara ColocationEmployment TypeFull timeLocation TypeHybridDepartmentDepartmentEngineeringEngineeringInfinia EngineeringCompensation$225K – $275K

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineering Manager - KV Cache Platform in Santa Clara, CA vacancy
  • $237.6k - $401.7k

    Role Number: 200682542Team: Software and ServicesLocation: CupertinoWeekly Hours: 40Posted: 2026-09-10SummaryApple...  ...express their creativity and vision on Apple platforms. We are looking for a seasoned engineering leader to manage a high-performing team of domain expert... 
    Platform
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $192k - $278k

     ...spanning native Google Cloud Platform (GCP) and other multi-clouds...  ...frictionless exception management workflows. Drive the product...  ...footprint.Partner closely with engineering leads to translating the product...  ...expanding ecosystem.As a Senior Product Manager for the Alphabet... 
    Platform
    Senior

    Google

    San Jose, CA
    3 days ago
  • $207.4k - $372.7k

    Role Number: 200595304Team: Software and ServicesLocation: Cupertino...  ...by our ML researchers and engineers to build generative AI features...  ...seeking experienced Product Managers to work closely with internal...  ..., ML infrastructure and data platforms.DescriptionWe are building AI... 
    Platform
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $160k - $320k

     ...transforming the enterprise, and hardware-software synergy is the engine driving it. We are seeking a visionary Senior Product Manager to join our high-impact product...  ...enterprise infrastructure software, hardware platforms, or hybrid cloud solutions.Deep Technical... 
    Platform
    Senior
    Work at office
    Remote work
    Relocation package
    3 days per week

    Nutanix

    San Jose, CA
    5 days ago
  • $136k - $218.5k

    We are now looking for a Senior Logic Design Engineer!As a member of our CPU Logic Design Team, you will...  ...coherency and last-level and system caches, focusing on such tasks as micro-architectural...  ...is possible today and define the platform for the future of computing.What you'... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $136k - $218.5k

    As a member of our CPU Cache Coherent Interconnects Design Team, you will be responsible...  ...what is possible today and define the platform for the future of computing.What you'll...  ...need to see:Master’s Degree in Electrical Engineering, Computer Engineering or Computer... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $176k - $276k

     ...leader in AI, is looking for a Sr Marketing Manager to join our Cloud Partner Marketing team...  ...of NVIDIA accelerated computing platforms.Define joint co-marketing objectives, annual...  ...building skills with the ability to influence senior leadership and external partners.... 
    Platform
    Senior
    Full time
    Flexible hours

    Nvidia

    Santa Clara, CA
    4 days ago
  • $200k - $322k

    NVIDIA is seeking a Senior Technical Program Manager to help develop the strategy and implementation model for DGX Cloud platform infrastructure. In this role, you will...  ...across infrastructure, platform software, and multi-functional engineering teams to transform technical... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $192k - $278k

     ...Seek out and identify change management opportunities that increase program...  ...in product development with engineers. The AI and Infrastructure...  ..., and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping... 
    Platform
    Senior
    Work experience placement
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $152k - $241.5k

    We are seeking an experienced Senior Cache Coherency Architect to join our ambitious team at...  ...consumer graphics to automotive and AI platforms.What you’ll be doing:Define consistent...  ...need to see:Master’s degree in electrical engineering, Computer Engineering, Computer Science... 
    Platform
    Senior
    Full time
    Night shift

    Nvidia

    Santa Clara, CA
    18 hours ago
  • $200k - $322k

    NVIDIA is seeking a Senior Technical Program Manager to drive infrastructure operations across DGX Cloud....  ...role, you will partner closely with engineering, operations, and reliability teams to...  ...health, operational readiness, and platform reliability.Partner with engineering... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184.5k - $249.6k

     ...Job Overview Arm is looking for a Senior Partner Manager (Cloud AI & Datacenter Silicon) to drive...  ...infrastructure companies, digital platform leaders, storage and networking innovators...  ...with Arm Field Applications Engineers, business units, product management, engineering... 
    Platform
    Senior
    Work at office
    Local area

    Arm Limited

    San Jose, CA
    2 days ago
  • $168k - $258.75k

    NVIDIA's deep learning platforms are at the forefront of innovation...  ...skilled Technical Program Manager (TPM) to join our NVIDIA DGX...  ...emerging cloud providers and engineering teams internally to help build...  ..., Infrastructure, Software teams and their leadership,... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    18 hours ago
  •  ...Apple Inc. is seeking an experienced Engineering Program Manager to drive programs focused on building Apple’s Cloud Observability and Storage Platforms. You will partner with engineers to build scalable, highly available cloud services that power Apple products globally... 
    Platform
    Senior

    Jobleads-US

    Cupertino, CA
    5 days ago
  •  ...Nile Global Inc. is seeking a Senior Director of Cloud Operations to lead the...  ...infrastructure supporting our cloud-managed enterprise networking platform. The role covers Google Cloud...  ...CI/CD practices in partnership with Engineering, Security, and Product teams. This... 
    Platform
    Senior

    Jobleads-US

    San Jose, CA
    1 day ago
  • $200k - $322k

    NVIDIA is looking for a Senior Technical Program Manager to partner with Production Engineering and drive execution across critical...  ...high-priority infrastructure and platform programs.Define and drive...  ...production engineering, infrastructure software, cloud platforms, or related... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...Google Cloud is seeking a Share Group Product Manager in Sunnyvale, CA to drive strategic product initiatives across cloud, SaaS, and...  ...teams with the product vision. You will partner with engineering, UX, marketing, and legal to define roadmaps, GTM plans, and scalable... 
    Platform
    Senior

    Jobleads-US

    Sunnyvale, CA
    16 hours ago
  • $192k - $278k

     ...Senior Product Manager, Generative AI, Google Cloud X Applicants in San Francisco...  ...cross-functionally with engineering, UX/UI, sales finance, and...  ...~3 years of experience in software development or engineering....  ...transform our Google Cloud Platform (GCP) products to provide... 
    Platform
    Senior

    Jobleads-US

    Sunnyvale, CA
    16 hours ago
  • $262k - $364k

     ...role.5 years of experience in a people management or team leadership role.Experience...  ...Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering...  ...for computer use and tool calling.The Platforms and Devices team encompasses Google's... 
    Platform
    Senior

    Google

    Mountain View, CA
    3 days ago
  • $188k - $274k

     ...Share Senior Program Manager I, Google Cloud This role may also be located in our Playa Vista, CA campus....  ...global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future... 
    Platform
    Senior
    Temporary work
    Worldwide

    Jobleads-US

    Sunnyvale, CA
    1 day ago
  • $240k - $265k

     ...About the role We are looking for a Senior Software Engineering Manager to lead the team responsible for building the platform that operates the flight and payload systems for on-orbit satellites. This team owns the core software, services, and tools that implement... 
    Platform
    Senior
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    3 days ago
  • $170k - $225k

     ...California, United StatesProducts - Engineering /Fulltime /HybridOver 50,000...  ...the Extreme team.Position: Senior Manager, QA Engineering - Cloud...  ...for our Cloud Networking platform. In this role, you will build...  ...practical experience).10+ years of software quality engineering... 
    Platform
    Senior
    Full time
    Shift work

    Extreme Networks, Inc.

    San Jose, CA
    17 hours ago
  • $267.8k - $401.7k

    Role Number: 200631982Team: Software and ServicesLocation: CupertinoWeekly...  ...experiences across our platforms, including acceleration for...  ...looking for a talented software manager with both deep rendering...  ...graphics compositing and rendering engine that powers visual... 
    Platform
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  •  ...Job Summary As a Principal Product Manager for our SASE solution, you will shape the...  ...deployment of a new public cloud security platform by enhancing and expanding Prisma Access...  .... Work with legal, InfoSec, and engineering teams to ensure adherence to various privacy... 
    Platform
    Senior
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Jobleads-US

    Santa Clara, CA
    1 day ago
  • $168k - $258.75k

     ...NVIDIA's deep learning platforms are at the forefront of innovation...  ...skilled Technical Program Manager (TPM) to join our NVIDIA DGX...  ...well as key internal teams (Software Engineering, Production Engineering/SRE,...  ...gather feedback, and align senior multi‑functional collaborators... 
    Platform
    Senior
    Remote work

    Jobleads-US

    Santa Clara, CA
    1 day ago
  • $124.5k - $272k

     ...Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network...  ....Positions are available at Senior Staff and above. Candidates are assessed...  ...live here: quantization, KV-cache and memory management, sparsity, fine-tuning, and hardware... 
    Platform
    Senior

    Netskope

    Santa Clara, CA
    2 days ago
  • $192k - $278k

     ...Senior Technical Program Manager I, Infrastructure, Google Cloud Share Senior Technical...  ...product development with engineers. The AI and...  ...and providing the essential platforms that enable developers to build the future. From software to hardware our teams are... 
    Platform
    Senior
    Work experience placement
    Worldwide

    Jobleads-US

    Sunnyvale, CA
    1 day ago
  • $240k - $265k

     ...About the role Muon seeks a Senior Software Engineering Manager to lead our Software Platform team. This team builds and operates the paved roads (CI/CD, Kubernetes, Terraform, Bazel, AWS, IAM, data infrastructure, and more) that underpin both our internal tooling and... 
    Platform
    Senior
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    4 days ago
  •  ...Senior Director, Cloud Operations Onsite, Santa Clara...  ...networking, cybersecurity, cloud software, and AI to disrupt a $100...  ...supporting Nile’s cloud-managed enterprise networking platform. This role will oversee...  ...in partnership with Engineering, Security, and Product teams... 
    Platform
    Senior
    Worldwide

    Jobleads-US

    Santa Clara, CA
    1 day ago
  • $200k - $250k

    DDN is seeking a highly experienced Senior Staff Engineer specializing in AI Data Path & Storage...  ...the Infinia Data Intelligence Platform to enable ultra-low-latency, high-throughput...  ..., including workloads involving KV cache management and vector database retrieval. The ideal... 
    Platform
    Senior

    DataDirect Networks

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineering Manager - KV Cache Platform. Be the first to apply!