Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Fleet Software Lead - Scale Inference Deployments

Jobleads-US

Etched, based in San Jose, seeks a Fleet Systems Lead to guide the Supercomputing organization and scale inference deployments across gigawatt-scale systems. You will own provisioning, configuration, updates and recovery, and drive safe rollout practices with telemetry and monitoring to ensure reliability.

You will mentor engineers, shape architecture roadmaps, collaborate with Node Systems, and tackle hard production problems across customer environments.

#J-18808-Ljbffr Jobleads-US
Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the Fleet Software Lead - Scale Inference Deployments in San Jose, CA vacancy
  • $2,500 per month

     ...design chips, racks, software, and manufacturing...  ...heavily focused on inference. Backed by hundreds...  ...and staffed by leading engineers, Etched is...  ...We’re hiring a Fleet Systems Lead to join...  ...enables Etched to deploy inference clusters at gigawatt-scale. This role presents... 
    Fleet
    Work at office
    Local area
    Relocation package

    Jobleads-US

    San Jose, CA
    20 hours ago
  • $219k - $351k

     ...business. As models scale past what any...  ...core product of AI inference, not an afterthought...  ...Cognos, AI memory software that moves model state...  ...for inference at fleet scale: HBM as L1,...  ...where strategic.Lead architecture reviews...  ...— with production deployments.Ability to write... 
    Fleet
    Work at office
    Remote work
    Flexible hours

    Samsung Semiconductor

    San Jose, CA
    1 day ago
  •  ...ROLE:This role owns the framework-layer inference product strategy for ROCm, translating customer...  ...AI, you will help shape how AMD’s software ecosystem enables efficient, reliable, and competitive large-scale model deployment. You will work with engineering, strategic... 
    Suggested
    Remote work
    Shift work

    AMD

    Santa Clara, CA
    1 day ago
  •  ...Cerebras to deliver industry-leading training and inference speeds; over 10 times...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads...  ...for scaling our inference fleet through self-service...  ...delivering and running software reliably and at scale across... 
    Fleet
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $160.36k - $240.54k

     ...the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles.With years...  ..., T. Rowe Price, and other leading investors.About the RoleThe ML...  ...validation.Maintain an in-house ML inference platform to serve large... 
    Fleet
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    5 days ago
  • $272k - $431.25k

     ...'re looking for a Principal Software Engineer to join our CSP Engagements...  ...technical focal point for fleet-scale reliability, working...  ...integration work (health monitoring deployment, telemetry pipeline,...  ...health, fleet reliability at leading CSP/Hyperscaler)Familiarity... 
    Fleet
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...breakthroughs, or bringing leading edge products to...  ...on customer AMD deployments — the reference...  ...they move from inference to agents. Internally...  ...memory databases, fleet and telemetry data...  ...:5+ years of software engineering with significant...  ...data quality at scale (level flexible... 
    Fleet
    Flexible hours

    AMD

    San Jose, CA
    4 days ago
  •  ...Cerebras to deliver industry-leading training and inference speeds; over 10 times...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads...  ...Engine.We are hiring a Software Engineer to productionize...  ...practices for a new accelerator fleet, and drive improvements... 
    Fleet

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $272k - $431.25k

     ..., as a Principal Rack Scale Systems Infrastructure...  ...guide the development of software systems. These systems...  ...NVIDIA, partners, and leading cloud and enterprise...  ...safely at rack and fleet scale. Build open source...  ...integration APIs for internal deployments and CSP environments.... 
    Fleet
    Full time
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...Cerebras to deliver industry-leading training and inference speeds; over 10 times...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads...  ...lead capacity planning and fleet strategy for our...  ...People who are serious about software make their own hardware.... 
    Fleet

    Jobleads-US

    Sunnyvale, CA
    3 days ago
  • $320k

     ...fully optimized NVIDIA AI and HPC software stack. We're searching for a...  ...technical, motivated manager to lead & manage the team responsible for rack-scale system software architecture. From...  ...large-scale cloud and cluster level deployment and management systems. Experience... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...for the Robotaxi program in Sunnyvale. You will lead the engineering organization responsible for...  ...the Robotaxi product from development through deployment and scale, coordinating AI, software, hardware, validation, and fleet operations to ensure safety and reliability.... 
    Fleet

    Jobleads-US

    Sunnyvale, CA
    1 day ago
  • $212.7k - $287.7k

     ...healthy, and always available at massive scale. HyperPlane is looking for a Software Development Manager (SDM III) to...  ...— balancing load across the BigMac fleet, tracking hosts, and mitigating...  ...their careers.In this role, you will:- Lead and grow a team of 14 engineers... 
    Fleet
    Local area
    Flexible hours
    Shift work

    Amazon

    Santa Clara, CA
    5 days ago
  • $119.25k - $150.85k

     ...drivers at unprecedented scale. Within GM AV, the Model Deployment & Inference Solutions team deploys...  ...ship to GM’s Super Cruise fleet at large scale, with...  ...vehicle autonomous driving software.  Your Skills &...  ...embrace the responsibility to lead the change that will... 
    Fleet
    Full time
    Internship
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    5 days ago
  •  ...tick to full rack scale. At the heart of it...  ...replaces reactive, software-bound management with local inference and hardware-enforced...  ...Product Manager to lead product definition...  ...each node scales into fleet-level awareness and...  ...hardware, ML model deployment in firmware... 
    Fleet
    Local area

    Axiado Corporation

    San Jose, CA
    1 day ago
  •  ...Architect to define and scale next-generation...  ...from real-world deployments and translate them...  ...compute-software co-design across CPU...  ...as architectural lead for strategic/lighthouse...  ...training, simulation, fleet learning)Provide...  ...understanding of:AI inference runtimes and... 
    Fleet

    AMD

    San Jose, CA
    4 days ago
  • $320k

     ...searching for a highly technical, motivated manager to lead and manage the team responsible for rack‑scale system software architecture. The role will drive the software...  ...of large‑scale cloud and cluster‑level deployment and management systems; experience designing robust... 

    Jobleads-US

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...Engineer to build software and automation that...  ...works on large-scale distributed systems...  ...infrastructure where inference and agentic...  ..., and on-premises deployments.What you’ll be doing...  ...orchestration services, fleet management systems...  ....NVIDIA is leading the way in groundbreaking... 
    Fleet
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...groundbreaking AI training and inference possible.The Lambda...  ...Staff Storage Software Engineer with deep...  ...designing and deploying storage protocol solutions at scale across object,...  ...observability, compute, and fleet engineering teams...  ...in a technical lead or Staff+ IC role.... 
    Fleet
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Labs

    San Jose, CA
    1 day ago
  •  ...a Senior or Staff Software Engineer in Lambda...  ...You will turn large-scale GPU infrastructure...  ...through design, deployment, on-call, incident...  ...Senior engineers lead complex work within...  ...billing, databases, or fleet management....  ...AI/ML training and inference workloads.Salary Range... 
    Fleet
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Labs

    San Jose, CA
    2 days ago
  • $130k - $220k

     ...models. Among petabytes of fleet data, you will develop...  ...retrieval, large-scale data processing, and product...  ...at either the Software Engineer or Senior Software...  ...distributed mining, inference, and indexing...  ...and review experiences, deployment, access control, testing... 
    Fleet
    Full time

    Plus.ai

    Santa Clara, CA
    3 days ago
  •  ...breakthroughs, or bringing leading edge products to...  ...for an experienced software engineer to help build Fleet Manager, a secure...  ...operating large-scale AMD GPU infrastructure...  ..., GPU scheduling, inference infrastructure, and...  ...through production deployment.You care deeply... 
    Fleet

    AMD

    San Jose, CA
    5 days ago
  • $130k - $220k

     ...based virtual driver software for factory-built...  ...to accelerate the deployment of next-generation...  ...trucking fleet.Responsibilities Develop...  ...Runtime, CUDA, or ML inference optimization.Experience with large-scale distributed...  ...applications.Experience leading technical... 
    Fleet
    Full time

    Plus.ai

    Santa Clara, CA
    4 days ago
  • $195k - $285k

     ...the forefront of software and hardware innovation...  ...purpose-built AI inference silicon, and the...  ...role builds and leads d-Matrix's Site Reliability...  ...customer-facing deployments run on — spanning...  ...automation, fleet auto-remediation,...  ...NAS/SAN, NFS/SMB at scale, snapshot and replication... 
    Fleet
    Remote work

    d-Matrix

    Santa Clara, CA
    2 days ago
  •  ...allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than...  ...partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with...  ...decisions, mentor engineers, and write software and automation alongside the team... 
    Work at office
    Remote work
    3 days per week

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $189k - $300k

     ...intuitive design, intelligent software, and next-generation...  ...on a global scale. The Data Scaling team...  ...driving by GM and retail fleets, but also synthetic sim...  ...cross-functional teams to deploy models and algorithms into...  ...the responsibility to lead the change that will make... 
    Fleet
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $159.3k - $230.7k

     ...through L4, on real roads, at real scale. Making self-driving safe at...  ...- real-world miles from GM's fleets, plus synthetic sim data -...  ...Familiarity with production ML deployment workflows.Remote/Hybrid: This...  ...embrace the responsibility to lead the change that will make our... 
    Fleet
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    5 days ago
  • $207k - $300k

    Lead the software architecture, design, development and testing of Arm/X86...  ...designing, developing, and deploying server solutions.Deep understanding...  ...information at massive scale, and extend well beyond web...  ...Servers that's in the Google fleet. This is our compute servers... 
    Fleet

    Google

    Sunnyvale, CA
    2 days ago
  • $180k - $240k

     ...trucks are commercially deployed across major markets, including...  ...that integrates advanced software and hardware powering the fleet, facilitating effortless...  ...to design, build, and scale the high-performance AI...  ...Operator, KubeFlow). Inference Performance Engineering:... 
    Fleet
    Odd job
    Work at office

    Gatik AI

    Santa Clara, CA
    5 days ago
  • $2,500 per month

     ...design chips, racks, software, and manufacturing...  ...heavily focused on inference. Backed by hundreds...  ...and staffed by leading engineers, Etched is...  ...enables Etched to deploy inference clusters at gigawatt-scale. This role presents...  ...products Align with Fleet Software on the... 
    Fleet
    Work at office
    Relocation package

    Jobleads-US

    San Jose, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Fleet Software Lead - Scale Inference Deployments. Be the first to apply!