Principal Engineer, LLM Memory and Storage — Remote
$272k - $425.5kNVIDIA
Santa Clara, CA
- Remote job
A leading technology firm in Santa Clara seeks a Principal Software Engineer for Large-Scale LLM Memory and Storage Systems. The role involves designing a unified memory layer for large-scale inference, integrating with LLM serving engines, and mentoring engineers. Candidates should have over 15 years of experience in distributed systems and a Master's or PhD. Competitive salaries range from $272,000 to $425,500, with equity opportunities. Applications accepted until December 26, 2025. #J-18808-Ljbffr NVIDIA Corporation
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal Engineer, LLM Memory and Storage — Remote in Santa Clara, CA vacancy
$272k - $431.25k
...models rapidly outgrow the memory and compute budget of... ...of cutting-edge LLM workloads. We are seeking a Principal Systems Engineer to define the vision and... ...of large-scale LLM and storage systems. What you'll... ...memory, SSD tiers, and remote file/object/cloud storage...Remote workLocal areaNVIDIA
Santa Clara, CA2 days ago$250k - $315k
...Principal Engineer – Security Architecture DDN is seeking a highly accomplished Principal Engineer... ...for next-generation distributed storage platforms spanning S3-compatible object... ...infrastructure security, KV cache architectures, memory tiering systems, and GPU-centric...Remote workDDN Storage
United States1 day ago- ## PRINCIPAL ENGINEER - CMP PROCESS DEVSingapore, Singapore**Our vision is... ...deposition and CMP within NAND/Memory processes.* **Strong... ...communication across local and remote environments. + Capability to... ...leader in innovative memory and storage solutions transforming how...Remote workLocal areaImmediate start
- ...innovations in Flash and advanced memory technologies, our... ...Responsibilities: We are seeking a Principal System Design Engineer to join our team in... ..., driving innovation in storage technology. The role... ...California, Colorado, New York or remote jobs that can be performed...Remote workTemporary workFlexible hoursShift work
SanDisk
Milpitas, CA3 days ago $292k - $365k
...models, ML services and tools including LLM fine-tuning, alignment and... ...in Airbnb. What you will do: As a principal machine learning engineer, you will be responsible for fine-tuning... ...Your Location: This position is US - Remote Eligible. The role may include occasional...Remote workFull timeWork experience placementCasual workLive inWork at office$15k
...democratizes access to generative AI across the company. As a Principal Engineer - GenAI/LLM, you will provide technical leadership across multiple... ...location: This role is available in the following locations: Remote USA/Canada with quarterly travel. Time zone requirements:...Remote workTemporary workSummer workWork from home- Upstart is seeking a Principal Engineer - GenAI/LLM to lead technical initiatives within the Core GenAI Platform team in Columbus, Ohio. This role... ...architecture, and automation processes. The position allows for remote work within the USA with an emphasis on in-person...Remote work
- ...for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information... ...concept and detailed design phases, work with site groups, other engineering teams, local municipalities/utilities, trade contractors,...Remote workPart timeFor contractorsLocal areaImmediate start
$176k - $220k
...assurance for the distributed solar and energy storage industries. Omnidian is building a more... ...in Seattle, WA. The Job As a Principal Engineer, you will serve as a key technical advisor... ..., certifications, or conferences. #LI-REMOTE Privacy California‑based candidates:...Remote workWork at office$206k - $333k
...We're looking for a Principal Engineer to be the technical lead... ...Megatron-LM, TensorRT-LLM & DGX cloud) and the... ...NCCL, RDMA, NVLink/PCIe, memory bandwidth), model-... ...trees (LSM), or custom storage engine development.... ...hybrid work environment, remote work may be considered...Remote workPermanent employmentTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA7 days ago- ...Technology is a world leader in innovating memory and storage solutions that accelerate the... ...looking for an ambitious Machine Learning Engineer (Principal Engineer).Our mission is to provide... ..., LangGraph, CrewAI) to orchestrate LLM interactions with internal APIs, databases...Local areaImmediate start
$204.4k - $326.6k
...scale. We are looking for a Principal engineer with strong, senior-level leadership... ...Context engineering, Agentic memory, and AI workflows) that power... ...has been categorized as a Remote position. "Remote" employees... ...shipping agent-based or LLM-powered systems to production...Remote workPermanent employmentLive inWork at officeLocal areaZillow
United States4 days ago$220.8k - $276k
...partner requests for information and proposals. Manage the secondary storage technology strategy for our largest customers and partners,... .... Self‑motivated and a self‑starter, capable of working remotely and autonomously to achieve targets. Demonstrated ability to leverage...Remote workHourly payFull timeContract workWork at officeFlexible hours2 days per week3 days per weekCohesity
New York, NY1 day ago$189.6k - $312.73k
...maintainers of the vLLM and LLM-D projects, and inventors... ...scale LLM deployments. As a Principal Machine Learning Engineer focused on distributed vLLM... ...algorithms to optimize memory utilization and request distribution... ...equity. For positions with Remote-US locations, the actual...Remote workPermanent employmentFull timeContract workWork experience placementWork at officeFlexible hoursRed Hat
Boston, MA2 days ago$189.6k - $312.73k
...enterprises to build, optimize, and scale LLM deployments. As a Machine Learning Engineer focused on model optimization... ...to-end LLM performance, including memory usage, latency, and throughput... ...and/or equity. For positions with Remote-US locations, the actual salary range...Remote workPermanent employmentFull timeContract workWork experience placementWork at officeFlexible hoursRed Hat
Boston, MA2 days ago$169.3k - $304.7k
...Responsibilities As an ML Performance Engineer Principal Lead, you will be responsible... ...such as vLLM, TensorRT‑LLM, Triton, or similar systems... .../accelerator scheduling and memory management trade‑offs Benefits... ..., Cambridge, MA, 02142, US (Remote) #J-18808-Ljbffr Akamai...Remote workWork experience placement- airbnb, Inc. seeks a Senior Staff Machine Learning Engineer to fine-tune state-of-the-art LLMs and develop AI products. The role involves... ...model development. This position offers the flexibility of remote work while being based in San Francisco, California. #J-18808-Ljbffr...Remote job
$176.17k - $251.67k
...Machine Learning Engineering Manager - LLM Serving (Remote - US) We are currently looking for a Machine Learning Engineering Manager - LLM Serving & Infrastructure in the United States. This role offers the opportunity to lead and shape the development of high‑scale, low...Remote workFlexible hoursJobgether
New York, NY3 days ago- ...Principal AI Engineer In this role, you will define and build the core intelligence... ...will shape how reasoning, memory, and evaluation are... ...experiment tracking. Integrate LLM systems with production-... ...package (US-based). ~ Fully remote or hybrid flexibility...Remote work
Jobgether
Washington DC3 days ago - ...We serve customers across solar, battery storage, EV charging, and industrial power... ...increasingly split. We're looking for an engineer who can work shoulder-to-shoulder with them... ...technical and commercial), utilities, and OEMs Remotely support commissioning and...Remote workWork at office3 days per week
- ...Engineering Manager, MAASJoin to apply for the Engineering Manager, MAAS role at CanonicalCanonical... ...more than 80 countries and a primarily remote workforce. Teams meet in person two to... ..., network configuration, and storage. The MAAS team delivers a highly scalable...Remote workWork from home
Canonical
Tucson, AZ9 hours ago - ...Head of Engineering role What is Irys? Irys is the first L1 programmable datachain, designed to optimize data storage and execution. By combining storage and execution, it significantly increases the usefulness of blockspace, enabling a wider range of web services...Remote work
WorksHub
New York, NY9 hours ago $100k - $150k
...Principal Performance & Kernel Engineer Remote Engineering / Full-Time / Remote Responsibilities Architect and automate bare‑metal, zero‑latency environments... .../IP stack, NUMA balancing, context switch reduction, memory allocators, BIOS configs Design, deploy, and manage...Remote workFull timeFramework Ventures
New York, NY3 days ago$112k - $189.53k
...Yost is a water resource management and engineering firm focused exclusively on water.... ...with 3 days in the office and 2 days remote. Position Description: Senior - Principal Engineer - Municipal Water Conveyance & Storage (Northern California) West Yost is...Remote workFull timeContract workTemporary workWork experience placementWork at officeLocal areaFlexible hoursNight shiftAfternoon shiftWest Yost
Concord, CA5 days ago- ...Flex Moving & Storage is transforming the traditional, often fragmented $90B+ moving, storage... ...technology leader for a team of 7-10 engineers including platform, mobile and web. The... ...analytical skills. This role is 100% remote within the United States with need-based...Remote workTemporary workWork experience placementFlexible hours
Blumberg Capital
New York, NY3 days ago - ...Engineering Manager – Metal as a Service (MAAS)Canonical is a global open-source leader, publishing... ...bare-metal provisioning, networking and storage, running on a Python and Go stack that... ...– twice-yearly in-person team sprints; remote work since 2004.Personal learning and...Remote work
Canonical
Oklahoma City, OK9 hours ago $161k - $275k
...Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information... ...than ever. Micron's SSD Firmware team is seeking a Principal Firmware Engineer to drive the architectural direction of next-generation...Full timeLocal areaImmediate startMicron Technology
Longmont, CO11 days ago- ...meeting the massive and ever-growing data storage needs of the AI era, WD is fueling a... ...We are looking for a Principal Test Automation Engineer who combines deep storage domain expertise... ...in California, Colorado, New York or remote jobs that can be performed in California...Remote workTemporary workImmediate startFlexible hoursShift work
Western Digital
Colorado Springs, CO11 days ago - ...Principal Rust Engineer - ML Infrastructure (AI Training) About the Role What if your deep... ...production scale. This is a fully remote, flexible contract role for engineers... ...Improve reliability, performance, and memory safety across existing Rust codebases...Remote workHourly payOngoing contractContract workFreelanceFlexible hours
Alignerr
New York, NY2 days ago $225k - $260k
...Principal Enterprise Ontology Architect / Engineer Job Location(s) US-CA-Los Angeles Job ID 2... .... * Embed semantics into AI/ML, LLM, and Fabric IQ pipelines to enable... ...four days a week. Flexibility for remote work is offered on one day, depending...Remote workFull timeWork at officeThe TCW Group
Los Angeles, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Engineer, LLM Memory and Storage — Remote. Be the first to apply!
Related searches
- director data engineering Santa Clara, CA
- senior civil engineer project manager Santa Clara, CA
- principal cloud engineer Santa Clara, CA
- director of product engineering Santa Clara, CA
- director systems engineering Santa Clara, CA
- engineering director Santa Clara, CA
- principal infrastructure engineer Santa Clara, CA
- principal network engineer Santa Clara, CA
- chief engineer Santa Clara, CA
- data center chief engineer Santa Clara, CA