Senior Software Engineering Manager - KV Cache Platform
$225k - $275kDataDirect Networks
DDN is seeking a Senior Software Engineering Manager to lead the engineering organization responsible for our KV Cache Platform—a distributed memory and storage platform that accelerates large-scale LLM inference across GPU clusters.In this role, you will lead geographically distributed engineering teams responsible for building highly scalable, low-latency distributed systems that power AI inference. You will define the technical vision and execution strategy for the platform while partnering closely with Product Management, Sales, Customer Engineering, NVIDIA, and executive leadership to deliver innovative AI infrastructure that meets customer needs and supports DDN's long-term product strategy.This is a highly visible leadership role with responsibility for engineering execution, customer success, roadmap delivery, and building a world-class engineering organization.ResponsibilitiesLead, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical excellence, innovation, ownership, and collaboration.Define and execute the technical strategy and roadmap for the KV Cache Platform, ensuring scalability, reliability, security, and operational excellence.Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, NVIDIA BlueField DPUs, and emerging AI infrastructure technologies.Partner closely with Product Management, Sales, Customer Engineering, NVIDIA, and strategic technology partners to prioritize customer requirements, drive proof-of-concepts (POCs), influence product direction, and successfully deliver customer deployments.Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure timely, high-quality software delivery.Establish engineering best practices for software quality, observability, automation, performance, testing, and production readiness.Collaborate across engineering, infrastructure, and hardware teams to deliver scalable, production-ready AI infrastructure while developing future engineering leaders and driving continuous improvement.QualificationsRequired15+ years of experience building distributed systems, cloud infrastructure, storage platforms, or AI infrastructure software.7+ years leading high-performing software engineering organizations, including geographically distributed teams.Proven experience delivering large-scale distributed infrastructure products from architecture through production deployment.Strong background in distributed systems, Linux, networking, performance engineering, and cloud-native architectures.Hands-on programming experience with Go and Python; experience with C/C++ is a plus.Demonstrated ability to lead cross-functional initiatives and influence technical direction across multiple organizations.Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions.Experience with technologies such as NVIDIA Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure.Background in HPC, distributed storage, networking, or enterprise infrastructure software.Experience working directly with strategic customers, technology partners, OEMs, or hyperscalers to deliver enterprise AI solutions.Compensation Range: $225K - $275KLocationSanta Clara ColocationEmployment TypeFull timeLocation TypeHybridDepartmentDepartmentEngineeringEngineeringInfinia EngineeringCompensation$225K – $275K
$237.6k - $401.7k
Role Number: 200682542Team: Software and ServicesLocation: CupertinoWeekly Hours: 40Posted: 2026-09-10SummaryApple... ...express their creativity and vision on Apple platforms. We are looking for a seasoned engineering leader to manage a high-performing team of domain expert...PlatformSeniorRelocation$192k - $278k
...spanning native Google Cloud Platform (GCP) and other multi-clouds... ...frictionless exception management workflows. Drive the product... ...footprint.Partner closely with engineering leads to translating the product... ...expanding ecosystem.As a Senior Product Manager for the Alphabet...PlatformSenior$207.4k - $372.7k
Role Number: 200595304Team: Software and ServicesLocation: Cupertino... ...by our ML researchers and engineers to build generative AI features... ...seeking experienced Product Managers to work closely with internal... ..., ML infrastructure and data platforms.DescriptionWe are building AI...PlatformSeniorRelocation$160k - $320k
...transforming the enterprise, and hardware-software synergy is the engine driving it. We are seeking a visionary Senior Product Manager to join our high-impact product... ...enterprise infrastructure software, hardware platforms, or hybrid cloud solutions.Deep Technical...PlatformSeniorWork at officeRemote workRelocation package3 days per week$136k - $218.5k
We are now looking for a Senior Logic Design Engineer!As a member of our CPU Logic Design Team, you will... ...coherency and last-level and system caches, focusing on such tasks as micro-architectural... ...is possible today and define the platform for the future of computing.What you'...PlatformSeniorFull time$136k - $218.5k
As a member of our CPU Cache Coherent Interconnects Design Team, you will be responsible... ...what is possible today and define the platform for the future of computing.What you'll... ...need to see:Master’s Degree in Electrical Engineering, Computer Engineering or Computer...PlatformSeniorFull time$176k - $276k
...leader in AI, is looking for a Sr Marketing Manager to join our Cloud Partner Marketing team... ...of NVIDIA accelerated computing platforms.Define joint co-marketing objectives, annual... ...building skills with the ability to influence senior leadership and external partners....PlatformSeniorFull timeFlexible hours$200k - $322k
NVIDIA is seeking a Senior Technical Program Manager to help develop the strategy and implementation model for DGX Cloud platform infrastructure. In this role, you will... ...across infrastructure, platform software, and multi-functional engineering teams to transform technical...PlatformSeniorFull time$192k - $278k
...Seek out and identify change management opportunities that increase program... ...in product development with engineers. The AI and Infrastructure... ..., and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping...PlatformSeniorWork experience placementWorldwide$152k - $241.5k
We are seeking an experienced Senior Cache Coherency Architect to join our ambitious team at... ...consumer graphics to automotive and AI platforms.What you’ll be doing:Define consistent... ...need to see:Master’s degree in electrical engineering, Computer Engineering, Computer Science...PlatformSeniorFull timeNight shift$200k - $322k
NVIDIA is seeking a Senior Technical Program Manager to drive infrastructure operations across DGX Cloud.... ...role, you will partner closely with engineering, operations, and reliability teams to... ...health, operational readiness, and platform reliability.Partner with engineering...PlatformSeniorFull time$184.5k - $249.6k
...Job Overview Arm is looking for a Senior Partner Manager (Cloud AI & Datacenter Silicon) to drive... ...infrastructure companies, digital platform leaders, storage and networking innovators... ...with Arm Field Applications Engineers, business units, product management, engineering...PlatformSeniorWork at officeLocal area$168k - $258.75k
NVIDIA's deep learning platforms are at the forefront of innovation... ...skilled Technical Program Manager (TPM) to join our NVIDIA DGX... ...emerging cloud providers and engineering teams internally to help build... ..., Infrastructure, Software teams and their leadership,...PlatformSeniorFull time- ...Apple Inc. is seeking an experienced Engineering Program Manager to drive programs focused on building Apple’s Cloud Observability and Storage Platforms. You will partner with engineers to build scalable, highly available cloud services that power Apple products globally...PlatformSenior
- ...Nile Global Inc. is seeking a Senior Director of Cloud Operations to lead the... ...infrastructure supporting our cloud-managed enterprise networking platform. The role covers Google Cloud... ...CI/CD practices in partnership with Engineering, Security, and Product teams. This...PlatformSenior
$200k - $322k
NVIDIA is looking for a Senior Technical Program Manager to partner with Production Engineering and drive execution across critical... ...high-priority infrastructure and platform programs.Define and drive... ...production engineering, infrastructure software, cloud platforms, or related...PlatformSeniorFull time- ...Google Cloud is seeking a Share Group Product Manager in Sunnyvale, CA to drive strategic product initiatives across cloud, SaaS, and... ...teams with the product vision. You will partner with engineering, UX, marketing, and legal to define roadmaps, GTM plans, and scalable...PlatformSenior
$192k - $278k
...Senior Product Manager, Generative AI, Google Cloud X Applicants in San Francisco... ...cross-functionally with engineering, UX/UI, sales finance, and... ...~3 years of experience in software development or engineering.... ...transform our Google Cloud Platform (GCP) products to provide...PlatformSenior$262k - $364k
...role.5 years of experience in a people management or team leadership role.Experience... ...Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering... ...for computer use and tool calling.The Platforms and Devices team encompasses Google's...PlatformSenior$188k - $274k
...Share Senior Program Manager I, Google Cloud This role may also be located in our Playa Vista, CA campus.... ...global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future...PlatformSeniorTemporary workWorldwide$240k - $265k
...About the role We are looking for a Senior Software Engineering Manager to lead the team responsible for building the platform that operates the flight and payload systems for on-orbit satellites. This team owns the core software, services, and tools that implement...PlatformSeniorPermanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week$170k - $225k
...California, United StatesProducts - Engineering /Fulltime /HybridOver 50,000... ...the Extreme team.Position: Senior Manager, QA Engineering - Cloud... ...for our Cloud Networking platform. In this role, you will build... ...practical experience).10+ years of software quality engineering...PlatformSeniorFull timeShift work$267.8k - $401.7k
Role Number: 200631982Team: Software and ServicesLocation: CupertinoWeekly... ...experiences across our platforms, including acceleration for... ...looking for a talented software manager with both deep rendering... ...graphics compositing and rendering engine that powers visual...PlatformSeniorRelocation- ...Job Summary As a Principal Product Manager for our SASE solution, you will shape the... ...deployment of a new public cloud security platform by enhancing and expanding Prisma Access... .... Work with legal, InfoSec, and engineering teams to ensure adherence to various privacy...PlatformSeniorFull timeWork at officeVisa sponsorshipWork visa
$168k - $258.75k
...NVIDIA's deep learning platforms are at the forefront of innovation... ...skilled Technical Program Manager (TPM) to join our NVIDIA DGX... ...well as key internal teams (Software Engineering, Production Engineering/SRE,... ...gather feedback, and align senior multi‑functional collaborators...PlatformSeniorRemote work$124.5k - $272k
...Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network... ....Positions are available at Senior Staff and above. Candidates are assessed... ...live here: quantization, KV-cache and memory management, sparsity, fine-tuning, and hardware...PlatformSenior$192k - $278k
...Senior Technical Program Manager I, Infrastructure, Google Cloud Share Senior Technical... ...product development with engineers. The AI and... ...and providing the essential platforms that enable developers to build the future. From software to hardware our teams are...PlatformSeniorWork experience placementWorldwide$240k - $265k
...About the role Muon seeks a Senior Software Engineering Manager to lead our Software Platform team. This team builds and operates the paved roads (CI/CD, Kubernetes, Terraform, Bazel, AWS, IAM, data infrastructure, and more) that underpin both our internal tooling and...PlatformSeniorPermanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week- ...Senior Director, Cloud Operations Onsite, Santa Clara... ...networking, cybersecurity, cloud software, and AI to disrupt a $100... ...supporting Nile’s cloud-managed enterprise networking platform. This role will oversee... ...in partnership with Engineering, Security, and Product teams...PlatformSeniorWorldwide
$200k - $250k
DDN is seeking a highly experienced Senior Staff Engineer specializing in AI Data Path & Storage... ...the Infinia Data Intelligence Platform to enable ultra-low-latency, high-throughput... ..., including workloads involving KV cache management and vector database retrieval. The ideal...PlatformSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineering Manager - KV Cache Platform. Be the first to apply!
- platform engineer Santa Clara, CA
- senior platform engineer Santa Clara, CA
- platform developer Santa Clara, CA
- data platform engineer Santa Clara, CA
- senior devops engineer remote Santa Clara, CA
- senior implementation engineer Santa Clara, CA
- senior partner marketing manager Santa Clara, CA
- senior hardware engineer Santa Clara, CA
- senior information technology manager Santa Clara, CA
- senior director engineering Santa Clara, CA


