Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineering Manager - KV Cache Platform

DataDirect Networks

DDN is seeking a Senior Software Engineering Manager to lead the engineering organization responsible for our KV Cache Platform—a distributed memory and storage platform that accelerates large-scale LLM inference across GPU clusters.In this role, you will lead geographically distributed engineering teams responsible for building highly scalable, low-latency distributed systems that power AI inference. You will define the technical vision and execution strategy for the platform while partnering closely with Product Management, Sales, Customer Engineering, NVIDIA, and executive leadership to deliver innovative AI infrastructure that meets customer needs and supports DDN's long-term product strategy.This is a highly visible leadership role with responsibility for engineering execution, customer success, roadmap delivery, and building a world-class engineering organization.ResponsibilitiesLead, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical excellence, innovation, ownership, and collaboration.Define and execute the technical strategy and roadmap for the KV Cache Platform, ensuring scalability, reliability, security, and operational excellence.Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, NVIDIA BlueField DPUs, and emerging AI infrastructure technologies.Partner closely with Product Management, Sales, Customer Engineering, NVIDIA, and strategic technology partners to prioritize customer requirements, drive proof-of-concepts (POCs), influence product direction, and successfully deliver customer deployments.Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure timely, high-quality software delivery.Establish engineering best practices for software quality, observability, automation, performance, testing, and production readiness.Collaborate across engineering, infrastructure, and hardware teams to deliver scalable, production-ready AI infrastructure while developing future engineering leaders and driving continuous improvement.QualificationsRequired15+ years of experience building distributed systems, cloud infrastructure, storage platforms, or AI infrastructure software.7+ years leading high-performing software engineering organizations, including geographically distributed teams.Proven experience delivering large-scale distributed infrastructure products from architecture through production deployment.Strong background in distributed systems, Linux, networking, performance engineering, and cloud-native architectures.Hands-on programming experience with Go and Python; experience with C/C++ is a plus.Demonstrated ability to lead cross-functional initiatives and influence technical direction across multiple organizations.Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions.Experience with technologies such as NVIDIA Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure.Background in HPC, distributed storage, networking, or enterprise infrastructure software.Experience working directly with strategic customers, technology partners, OEMs, or hyperscalers to deliver enterprise AI solutions.LocationSanta ClaraEmployment TypeFull timeLocation TypeHybridDepartmentDepartmentEngineeringEngineeringInfinia Engineering

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineering Manager - KV Cache Platform in Santa Clara, CA vacancy
  • $192k - $279k

     ...partner teams (e.g., engineers, PgMs, UX) during product...  ...the sum of its parts.Manage validation of market...  ...management, or other software infrastructure areas.Preferred...  ...presentations to senior leadership.3 years of...  ...generation of Google platforms, we make Google's product... 
    Platform
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $256k - $414k

     ...entertainment at scale.We are looking for a Senior Manager to lead the design, scaling, and...  ...workloads, AI/ML training, and inference platforms by delivering ultra-low-latency, high-...  ...in Computer Science or a related engineering field (or equivalent experience).Ability... 
    Platform
    Senior
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    3 days ago
  • $262k - $365k

     ...architectural roadmap for system software powering third-party...  ..., ensuring accuracy and engineering best practices.Serve as a Senior TLM to guide complex...  ...experience in a people management or team leadership role....  ...Embedded Processors, low-level platform bring-up, Computer... 
    Platform
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • $116k - $200.05k

    Position Overview: As a Senior Enablement Manager, you will play a critical role in driving business success by developing and implementing enablement...  ...AdobeAdobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and... 
    Platform
    Senior
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    2 days ago
  • $272k - $431.25k

    NVIDIA's Object Storage Platform team builds and...  ...infrastructure that stores, manages, and serves exabytes...  ...enabling researchers and engineers to reliably store...  ...You will own the full software development and service...  ...engineering organization to senior leadership, providing... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $156k - $310.8k

     ...transforming the enterprise, and hardware-software synergy is the engine driving it. We are seeking a visionary Senior Product Manager to join our high-impact product...  ...enterprise infrastructure software, hardware platforms, or hybrid cloud solutions.Deep Technical... 
    Platform
    Senior
    Work at office
    Remote work
    Relocation package
    3 days per week

    Nutanix

    San Jose, CA
    4 days ago
  • $240k - $379.5k

     ...possible. We are seeking a Technical Program Management Manager to lead core infrastructure...  ...operational workstreams.Partner with engineering, product, operations, security, and cloud...  ..., distributed systems, or large-scale platform operations.Strong communication skills... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $192k - $278k

     ...developers build, secure, and manage modern applications,...  ...Product Management, Software Development, UX/UI,...  ...unified and powerful platform encompassing Cloud Load...  ...creative and prolific engineers, designers, marketers,...  .... As a Google Cloud Senior Product Manager, you will... 
    Platform
    Senior

    Google

    Sunnyvale, CA
    5 days ago
  • $200k - $322k

    NVIDIA’s deep learning platforms have significantly...  ...committed technical program manager for NVIDIA's DGX Cloud...  ...providers and NVIDIA engineering teams, building...  ...execution of large programs, software engineering projects...  ...org alignment across senior and executive leaders.... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    11 hours ago
  • $200k - $322k

    NVIDIA’s deep learning platforms have significantly influenced many...  ...skilled Technical Program Manager for NVIDIA's DGX Cloud Infrastructure...  ...providers and NVIDIA engineering teams, delivering reliable...  ...execution of large programs, software engineering projects in a matrixed... 
    Platform
    Senior
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    4 days ago
  • $150k - $218k

     ...requirements from systems program managers into a product idea,...  ...Vendors, and GCP Product and Engineering to bring new support experiences...  ...solutions engineer, software engineer, or technical program...  ...knowledge bases.The Google Cloud Platform team helps customers... 
    Platform
    Senior

    Google

    Sunnyvale, CA
    2 days ago
  • $136k - $218.5k

    We are now looking for a Senior Logic Design Engineer!As a member of our CPU Logic Design Team, you will...  ...coherency and last-level and system caches, focusing on such tasks as micro-architectural...  ...is possible today and define the platform for the future of computing.What you'... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

    We are seeking an experienced Senior Cache Coherency Architect to join our ambitious team at...  ...consumer graphics to automotive and AI platforms.What you’ll be doing:Define consistent...  ...need to see:Master’s degree in electrical engineering, Computer Engineering, Computer Science... 
    Platform
    Senior
    Full time
    Night shift

    Nvidia

    Santa Clara, CA
    5 days ago
  • $192k - $279k

     ...Data Cloud products and solutions.Engage with engineering directors, product leaders and other Technical Program Manager (TPM) groups, to streamline processes, simplify...  ...leading AI capabilities. Google Cloud Platform is changing the way the world uses cloud computing... 
    Platform
    Senior

    Google

    Sunnyvale, CA
    7 hours ago
  • $164.5k - $235k

     ...power our cloud-native Zero Trust Exchange platform. This innovation protects our customers...  ...are looking for a Sr. Product Marketing Manager to join our team. This is a on-site in...  ...buyer personas including Network Security Engineers, Cloud Architects, Security Architects,... 
    Platform
    Senior
    Full time
    Work at office
    Local area

    Zscaler

    San Jose, CA
    5 days ago
  • $200k - $322k

    NVIDIA is seeking a Senior Technical Program Manager to lead Trust Services programs...  ...across firmware, platform, and runtime environments...  ...product security, compliance, engineering execution, and partner readiness...  ...firmware, platform, and software teams.Establish program... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $200k - $322k

     ...product workloads. The company seeks a Senior Technical Program Manager (TPM) to lead complex, cross-...  ...powering NVIDIA’s next-generation AI software platforms. In this role, you will drive...  ...responsible for managing high-impact engineering programs within a dynamic, fast-... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $262k - $365k

    Inspire, manage, and grow a talented team of software engineers, fostering an open environment while actively guiding their career development.Provide end-to...  ...Access Management policies across all of Google Cloud Platform (GCP).In this role, you will provide thought... 
    Platform
    Senior

    Google

    Sunnyvale, CA
    3 days ago
  • $140k - $205k

     ...journey. Provide technical guidance and manage timelines, milestones, migration goal and...  ...and launches, partnering with Support, Engineers, and Site Reliability Engineers to ensure...  ...management skills.The Google Cloud Platform team helps customers transform and build... 
    Platform
    Senior

    Google

    Sunnyvale, CA
    4 days ago
  • $175k - $210k

     ...Senior Cloud Operations Manager Hybrid – San Ramon, CA What We Do ServiceMax is the...  ...Management, offering cloud-based software that improves the...  ...ServiceMax’s cloud‑based software platform to keep their machines and...  ...Will Do Lead a team of engineers responsible for designing,... 
    Platform
    Senior
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    PTC

    San Jose, CA
    4 days ago
  • $210.6k - $305.1k

     ...building next-generation infrastructure software for enterprise AI factories,...  ...modern data center fabrics. These platforms must turn complex GPU, server, network...  ...and scale.We are seeking a hands-on Senior Software Engineering Manager to lead a team working at the... 
    Platform
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    3 days per week

    CISCO Systems

    San Jose, CA
    3 days ago
  • $185k - $304k

     ...team.This role will be based in Mountain View, CA.As a Senior Software Engineering Manager of the Infrastructure Reliability team at LinkedIn, you...  ...role leading the development of horizontal reliability platforms and solutions to improve reliability of Infra services at... 
    Platform
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    1 day ago
  •  ...GPU and CPU pathwaysWork on KV cache, memory, storage, and throughput...  ...affect AI performanceSolve engineering problems at the intersection...  ...systems, storage platforms, or adjacent distributed systems...  ...production ownershipGeneric software engineers without clear AI systems... 
    Platform
    Senior

    DataDirect Networks

    Santa Clara, CA
    2 days ago
  • $182.5k - $260.5k

     ...Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network...  ....Positions are available at Senior Staff and above. Candidates are assessed...  ...live here: quantization, KV-cache and memory management, sparsity, fine-tuning, and hardware... 
    Platform
    Senior

    Netskope

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...and robotics. We build the software stack that enables Large Language...  ...on embedded and edge platforms — delivering cutting-edge generative...  ...decoding, LoRA, MoE, and KV cache management.Design and implement...  ...Science, Electrical/Computer Engineering, or a closely related field... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    11 hours ago
  •  ...RoleWe are hiring a Senior Performance Engineer to join our Product...  ..., and inference API platforms. You will work directly...  ..., quantization, KV-cache strategies—interact...  ..., MHA) and KV-cache management, and how each affects...  ...who are serious about software make their own hardware... 
    Platform
    Senior
    Contract work
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    5 days ago
  • $224k - $356.5k

     ...on the world.As an AI Storage Platform Architect at NVIDIA, this...  ...AI infrastructure, including KV Cache tiering strategies, checkpoint...  ...Solutions Architect, Principal Engineer, or equivalent.Bachelors in Computer...  ...understanding of KV Cache management strategies, including tiered... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $208k - $327.75k

     ...compute, and scalable software-defined architectures.We are looking for a Senior AI Architect to help define...  ...architects, and AV platform teams to identify the...  ...Science, Electrical Engineering, Machine Learning, Robotics...  ...attention and KV-cache optimization)Strong understanding... 
    Platform
    Senior
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

    NVIDIA is seeking a Senior Deep Learning Algorithms Engineer to advance Dynamo, our open-source...  ...distributed inference platform for large-scale, low-...  ...collaborate across research, software, systems, and hardware...  ...scheduling, disaggregation, KV caching, and autoscaling.What we... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

     ...Local AI team is building the software stack that makes large...  ...best experience. We own the platform — performance, CI/CD pipelines...  ...Computer Science, Computer Engineering, Electrical Engineering, or...  ...: attention mechanisms, KV-cache management, continuous batching, quantization... 
    Platform
    Senior
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    7 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineering Manager - KV Cache Platform. Be the first to apply!