Senior Software Engineering Manager - KV Cache Platform
DataDirect Networks
DDN is seeking a Senior Software Engineering Manager to lead the engineering organization responsible for our KV Cache Platform—a distributed memory and storage platform that accelerates large-scale LLM inference across GPU clusters.In this role, you will lead geographically distributed engineering teams responsible for building highly scalable, low-latency distributed systems that power AI inference. You will define the technical vision and execution strategy for the platform while partnering closely with Product Management, Sales, Customer Engineering, NVIDIA, and executive leadership to deliver innovative AI infrastructure that meets customer needs and supports DDN's long-term product strategy.This is a highly visible leadership role with responsibility for engineering execution, customer success, roadmap delivery, and building a world-class engineering organization.ResponsibilitiesLead, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical excellence, innovation, ownership, and collaboration.Define and execute the technical strategy and roadmap for the KV Cache Platform, ensuring scalability, reliability, security, and operational excellence.Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, NVIDIA BlueField DPUs, and emerging AI infrastructure technologies.Partner closely with Product Management, Sales, Customer Engineering, NVIDIA, and strategic technology partners to prioritize customer requirements, drive proof-of-concepts (POCs), influence product direction, and successfully deliver customer deployments.Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure timely, high-quality software delivery.Establish engineering best practices for software quality, observability, automation, performance, testing, and production readiness.Collaborate across engineering, infrastructure, and hardware teams to deliver scalable, production-ready AI infrastructure while developing future engineering leaders and driving continuous improvement.QualificationsRequired15+ years of experience building distributed systems, cloud infrastructure, storage platforms, or AI infrastructure software.7+ years leading high-performing software engineering organizations, including geographically distributed teams.Proven experience delivering large-scale distributed infrastructure products from architecture through production deployment.Strong background in distributed systems, Linux, networking, performance engineering, and cloud-native architectures.Hands-on programming experience with Go and Python; experience with C/C++ is a plus.Demonstrated ability to lead cross-functional initiatives and influence technical direction across multiple organizations.Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions.Experience with technologies such as NVIDIA Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure.Background in HPC, distributed storage, networking, or enterprise infrastructure software.Experience working directly with strategic customers, technology partners, OEMs, or hyperscalers to deliver enterprise AI solutions.LocationSanta ClaraEmployment TypeFull timeLocation TypeHybridDepartmentDepartmentEngineeringEngineeringInfinia Engineering
$192k - $279k
...partner teams (e.g., engineers, PgMs, UX) during product... ...the sum of its parts.Manage validation of market... ...management, or other software infrastructure areas.Preferred... ...presentations to senior leadership.3 years of... ...generation of Google platforms, we make Google's product...PlatformSeniorWorldwide$256k - $414k
...entertainment at scale.We are looking for a Senior Manager to lead the design, scaling, and... ...workloads, AI/ML training, and inference platforms by delivering ultra-low-latency, high-... ...in Computer Science or a related engineering field (or equivalent experience).Ability...PlatformSeniorFull timeLocal area$262k - $365k
...architectural roadmap for system software powering third-party... ..., ensuring accuracy and engineering best practices.Serve as a Senior TLM to guide complex... ...experience in a people management or team leadership role.... ...Embedded Processors, low-level platform bring-up, Computer...PlatformSeniorWorldwide$116k - $200.05k
Position Overview: As a Senior Enablement Manager, you will play a critical role in driving business success by developing and implementing enablement... ...AdobeAdobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and...PlatformSeniorFull timeTemporary workLocal areaWorldwide$272k - $431.25k
NVIDIA's Object Storage Platform team builds and... ...infrastructure that stores, manages, and serves exabytes... ...enabling researchers and engineers to reliably store... ...You will own the full software development and service... ...engineering organization to senior leadership, providing...PlatformSeniorFull time$156k - $310.8k
...transforming the enterprise, and hardware-software synergy is the engine driving it. We are seeking a visionary Senior Product Manager to join our high-impact product... ...enterprise infrastructure software, hardware platforms, or hybrid cloud solutions.Deep Technical...PlatformSeniorWork at officeRemote workRelocation package3 days per week$240k - $379.5k
...possible. We are seeking a Technical Program Management Manager to lead core infrastructure... ...operational workstreams.Partner with engineering, product, operations, security, and cloud... ..., distributed systems, or large-scale platform operations.Strong communication skills...PlatformSeniorFull time$192k - $278k
...developers build, secure, and manage modern applications,... ...Product Management, Software Development, UX/UI,... ...unified and powerful platform encompassing Cloud Load... ...creative and prolific engineers, designers, marketers,... .... As a Google Cloud Senior Product Manager, you will...PlatformSenior$200k - $322k
NVIDIA’s deep learning platforms have significantly... ...committed technical program manager for NVIDIA's DGX Cloud... ...providers and NVIDIA engineering teams, building... ...execution of large programs, software engineering projects... ...org alignment across senior and executive leaders....PlatformSeniorFull time$200k - $322k
NVIDIA’s deep learning platforms have significantly influenced many... ...skilled Technical Program Manager for NVIDIA's DGX Cloud Infrastructure... ...providers and NVIDIA engineering teams, delivering reliable... ...execution of large programs, software engineering projects in a matrixed...PlatformSeniorFull timeWorldwide$150k - $218k
...requirements from systems program managers into a product idea,... ...Vendors, and GCP Product and Engineering to bring new support experiences... ...solutions engineer, software engineer, or technical program... ...knowledge bases.The Google Cloud Platform team helps customers...PlatformSenior$136k - $218.5k
We are now looking for a Senior Logic Design Engineer!As a member of our CPU Logic Design Team, you will... ...coherency and last-level and system caches, focusing on such tasks as micro-architectural... ...is possible today and define the platform for the future of computing.What you'...PlatformSeniorFull time$152k - $241.5k
We are seeking an experienced Senior Cache Coherency Architect to join our ambitious team at... ...consumer graphics to automotive and AI platforms.What you’ll be doing:Define consistent... ...need to see:Master’s degree in electrical engineering, Computer Engineering, Computer Science...PlatformSeniorFull timeNight shift$192k - $279k
...Data Cloud products and solutions.Engage with engineering directors, product leaders and other Technical Program Manager (TPM) groups, to streamline processes, simplify... ...leading AI capabilities. Google Cloud Platform is changing the way the world uses cloud computing...PlatformSenior$164.5k - $235k
...power our cloud-native Zero Trust Exchange platform. This innovation protects our customers... ...are looking for a Sr. Product Marketing Manager to join our team. This is a on-site in... ...buyer personas including Network Security Engineers, Cloud Architects, Security Architects,...PlatformSeniorFull timeWork at officeLocal area$200k - $322k
NVIDIA is seeking a Senior Technical Program Manager to lead Trust Services programs... ...across firmware, platform, and runtime environments... ...product security, compliance, engineering execution, and partner readiness... ...firmware, platform, and software teams.Establish program...PlatformSeniorFull time$200k - $322k
...product workloads. The company seeks a Senior Technical Program Manager (TPM) to lead complex, cross-... ...powering NVIDIA’s next-generation AI software platforms. In this role, you will drive... ...responsible for managing high-impact engineering programs within a dynamic, fast-...PlatformSeniorFull time$262k - $365k
Inspire, manage, and grow a talented team of software engineers, fostering an open environment while actively guiding their career development.Provide end-to... ...Access Management policies across all of Google Cloud Platform (GCP).In this role, you will provide thought...PlatformSenior$140k - $205k
...journey. Provide technical guidance and manage timelines, milestones, migration goal and... ...and launches, partnering with Support, Engineers, and Site Reliability Engineers to ensure... ...management skills.The Google Cloud Platform team helps customers transform and build...PlatformSenior$175k - $210k
...Senior Cloud Operations Manager Hybrid – San Ramon, CA What We Do ServiceMax is the... ...Management, offering cloud-based software that improves the... ...ServiceMax’s cloud‑based software platform to keep their machines and... ...Will Do Lead a team of engineers responsible for designing,...PlatformSeniorWork at officeLocal areaFlexible hours2 days per week3 days per week$210.6k - $305.1k
...building next-generation infrastructure software for enterprise AI factories,... ...modern data center fabrics. These platforms must turn complex GPU, server, network... ...and scale.We are seeking a hands-on Senior Software Engineering Manager to lead a team working at the...PlatformSeniorFull timeTemporary workWork at officeLocal areaFlexible hours3 days per week$185k - $304k
...team.This role will be based in Mountain View, CA.As a Senior Software Engineering Manager of the Infrastructure Reliability team at LinkedIn, you... ...role leading the development of horizontal reliability platforms and solutions to improve reliability of Infra services at...PlatformSeniorFor contractorsWork at officeFlexible hours- ...GPU and CPU pathwaysWork on KV cache, memory, storage, and throughput... ...affect AI performanceSolve engineering problems at the intersection... ...systems, storage platforms, or adjacent distributed systems... ...production ownershipGeneric software engineers without clear AI systems...PlatformSenior
$182.5k - $260.5k
...Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network... ....Positions are available at Senior Staff and above. Candidates are assessed... ...live here: quantization, KV-cache and memory management, sparsity, fine-tuning, and hardware...PlatformSenior$152k - $241.5k
...and robotics. We build the software stack that enables Large Language... ...on embedded and edge platforms — delivering cutting-edge generative... ...decoding, LoRA, MoE, and KV cache management.Design and implement... ...Science, Electrical/Computer Engineering, or a closely related field...PlatformSeniorFull time- ...RoleWe are hiring a Senior Performance Engineer to join our Product... ..., and inference API platforms. You will work directly... ..., quantization, KV-cache strategies—interact... ..., MHA) and KV-cache management, and how each affects... ...who are serious about software make their own hardware...PlatformSeniorContract workShift work
$224k - $356.5k
...on the world.As an AI Storage Platform Architect at NVIDIA, this... ...AI infrastructure, including KV Cache tiering strategies, checkpoint... ...Solutions Architect, Principal Engineer, or equivalent.Bachelors in Computer... ...understanding of KV Cache management strategies, including tiered...PlatformSeniorFull time$208k - $327.75k
...compute, and scalable software-defined architectures.We are looking for a Senior AI Architect to help define... ...architects, and AV platform teams to identify the... ...Science, Electrical Engineering, Machine Learning, Robotics... ...attention and KV-cache optimization)Strong understanding...PlatformSeniorFull timeWorldwide$152k - $241.5k
NVIDIA is seeking a Senior Deep Learning Algorithms Engineer to advance Dynamo, our open-source... ...distributed inference platform for large-scale, low-... ...collaborate across research, software, systems, and hardware... ...scheduling, disaggregation, KV caching, and autoscaling.What we...PlatformSeniorFull time$224k - $356.5k
...Local AI team is building the software stack that makes large... ...best experience. We own the platform — performance, CI/CD pipelines... ...Computer Science, Computer Engineering, Electrical Engineering, or... ...: attention mechanisms, KV-cache management, continuous batching, quantization...PlatformSeniorFull timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineering Manager - KV Cache Platform. Be the first to apply!
- platform engineer Santa Clara, CA
- platform engineering manager Santa Clara, CA
- senior platform engineer Santa Clara, CA
- platform developer Santa Clara, CA
- senior manager tax Santa Clara, CA
- senior devops Santa Clara, CA
- senior associate vice president Santa Clara, CA
- senior director digital marketing Santa Clara, CA
- senior director global marketing Santa Clara, CA
- senior international accountant Santa Clara, CA

