Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

Gridmatic

The RoleWe're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by the nature of energy markets: forecasts and trading decisions run on tight schedules, battery dispatch commands must execute reliably in real time, and ML models need to train and deploy continuously as new data arrives.What You'll DoDesign and build the compute platform that runs Gridmatic's production services, batch jobs, and ML training workloadsHelp own our production workflow orchestration end to end, from the cluster and node pools it runs on to the abstractions our teams build on top of itMake our ML iteration cycle faster and cheaper by profiling workflows, cutting latency, and improving how we use computeBuild the observability and developer tooling that lets engineers understand and troubleshoot their own workloads, from post-run cost reporting to monitoring and alertingImprove the reliability and resiliency of production workloads, including how we handle capacity constraints and multi-region routingManage GPU and accelerator capacity: node pools, drivers, spot vs. on-demand tradeoffs, and scheduling and quota so training and batch jobs get the compute they need without overspendingOwn autoscaling and quota management so the platform scales up under load and down to zero when idleWork closely with the ML team to find pain points and quickly ship solutionsMake architectural decisions that shape how we build software as we growWhat We're Looking ForSignificant experience building and operating production infrastructure on a public cloud platform (we run on GCP, but AWS or Azure experience translates well)Strong distributed systems and infrastructure skills: standing up services, scaling and debugging Kubernetes (we run on GKE and it's foundational to our platform), writing Terraform, and comfort with cloud networking, IAM, and secrets managementHands-on experience with workflow orchestration tools like Flyte, Temporal, or AirflowProficiency in Python, and either already know Go or have experience with a similar systems language (C++, Java, Rust) and are excited to work in Python and Go day-to-dayExperience working closely with ML engineers or data scientists as your customers, and genuine excitement to keep doing itClear communication, whether writing a design doc, reviewing code, or explaining a complex system to someone new to itNice to HaveExperience running GPU or accelerator workloads on Kubernetes (node pools, drivers, scheduling, quota) is strongly preferred for this roleFamiliarity with observability tooling (we use Grafana + Google Cloud Monitoring)Experience building internal developer platforms or tooling that other engineers rely onPrior work in domains where latency and reliability have direct business consequencesTaking care of you today:- Continuing Education Opportunities- Flexible PTO- Medical, Dental and Vision plans with competitive employer contributions- Pre-Tax commuter benefits- $1500/year non profit donation matching program through Millie- Home Office StipendProtecting your future for you and your family:- 401K contribution match up to 4%- Company-paid parental leave- Company Paid Life Insurance- Stock Option Loan ProgramPay range $209,000—$270,000 USD

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in Cupertino, CA vacancy
  • $209k - $270k

     ...Senior Software Engineer, ML Infrastructure Cupertino, San Franciso The Role We're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by... 
    Senior
    Home office
    Flexible hours

    Gridmatic

    Cupertino, CA
    1 day ago
  • $168k - $264.5k

     ...the world.Join NVIDIA’s CAD Infrastructure team and be part of something...  ...are building a next-generation software platform for semiconductor...  ...ambitious endeavor, and we need engineers who thrive in a hands-on...  ...GNN-based systems.Exposure to ML or agentic tooling, particularly... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    a month ago
  • $182k - $242k

     ...enterprises, CoreWeave combines superior infrastructure performance with deep technical...  ...About this role We're looking for a Senior Engineer to be a driving force on CoreWeave's Benchmarking...  ...tooling, ideally for infrastructure or ML systems rather than general-purpose BI.... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  •  ...we work. The Role We're looking for a Senior Software Engineer to join our Platform team and build the foundational infrastructure that powers Gridmatic. Our platform...  ...commands must execute reliably in real time, and ML models need to train and deploy continuously... 
    Senior
    Full time

    Gridmatic

    Cupertino, CA
    8 hours ago
  • $193.93k - $291.15k

     ...Senior Software Engineer, ML Infrastructure Mountain View, California (HQ) Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  •  ...easy to build and deploy as software. Today, robotics is fragmented...  ...We are looking for a Senior AI Engineer to design, build, and ship AI...  ...full stack — from the agentic infrastructure that powers our robot operations...  ...and webhooks; Python for AI/ML integration and scripting... 
    Senior
    Full time

    Dexmate

    Santa Clara, CA
    8 hours ago
  • $183k - $275k

     ...different aspects of the software and hardware...  ...autonomy code change, from ML model updates to radius...  ...road. You will own the infrastructure that makes this possible...  ...much much more. Engineers across the company rely...  ...deliver, and you've briefed senior engineering leadership... 
    Senior
    Temporary work
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $170k - $205k

     ...Senior Software Engineer The Crusoe Cloud Managed AI team seeks an ambitious and experienced Senior...  ...to build and scale critical infrastructure capable of handling millions of API requests...  ...early-stage projects quickly. ~ AI/ML Expertise: Experience with... 
    Senior
    Temporary work
    Work at office

    Crusoe

    Sunnyvale, CA
    3 days ago
  • $152k - $241.5k

    We're now looking for a Senior Software Engineer, Cosmos Infrastructure and End to End Performance! NVIDIA Cosmos is an open omni-model platform of generative...  ...of DNNs and their use in emerging AI/ML applications and servicesExpertise with at least one of... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    8 hours ago
  • $198k - $326k

     ...frameworks that empower engineers and researchers to...  ...robust, highly scalable infrastructure that delivers continuous...  ...scale.As a Sr. Staff Software Engineer, you will...  ...distributed systems and ML platform problems while...  ...SalesExperience level: Mid-Senior LevelIndustry:... 
    Senior
    For contractors
    Work at office
    Flexible hours
    Shift work

    Linkedin

    Sunnyvale, CA
    17 days ago
  • $174k - $252k

     ...design, development, and optimization of software components critical for Large...  ...orchestration (Kubernetes, Google Kubernetes Engine (GKE)), networking infrastructure, and hardware acceleration to build...  ...software development, including AI/ML applications.Preferred... 
    Senior

    Google

    Sunnyvale, CA
    2 days ago
  • $140k - $224.25k

    NVIDIA DGX Cloud provides the infrastructure and software platform that enables enterprises to build...  ....We are looking for a Senior Software Engineer to design and build the systems that...  ...Experience with GPU infrastructure, AI/ML platforms, schedulers, cluster management... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  • $168k - $270.25k

     ...The NVIDIA Operations organization is seeking an experienced software engineering professional for the position of System Data Architect. As a...  ...ownership of data platform and transformation tools used in AI&ML What we need to see: ~ Bachelor’s or Master’s... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $193.93k - $291.15k

     ...team of high-output generalists where ML and systems engineering converge to push autonomy performance forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical...  ...~ BS/MS in Computer Science , Software Engineering, Robotics, or a related... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $184k - $287.5k

    We are seeking a Senior DevOps / Cloud Simulation Infrastructure Engineer to own the complete end-to-end cloud execution pipeline for SimReady assets! This role...  ...automated testing frameworks, preferably involving AI/ML inference, computer vision, or rule-based validation... 
    Senior
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    13 days ago
  • $224k - $356.5k

    NVIDIA is hiring engineers to scale up the introduction of next generation...  ...architecture into its EDA Infrastructure. We expect you to have a deep...  ...systems, familiarity with software testing and deployment, and excellent...  ...from the crowd:Developing ML/AI infrastructure. Developing... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $193.3k - $261.5k

     ...of these custom SoCs — that let software teams start development months before...  .... We're looking for a software engineer to build and own the models and infrastructure that make this possible.What you'...  ...pieces of the stackNo ML background needed. You'll learn the... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    a month ago
  • $200k - $220k

     ...only vertically integrated AI infrastructure company built from the...  ...Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire...  ...Engineering Teams: Partner with software engineers, data scientists,...  ...building infrastructure for AI/ML workloads or cloud... 
    Senior
    Full time
    Temporary work
    Work at office
    Remote work

    G2 Venture Partners

    Sunnyvale, CA
    3 days ago
  • $120.5k - $243k

    Senior Platform Software Engineer This role has been designed as 'Hybrid' with an expectation that you will work on average 2 days per week from an HPE...  ...) and intelligent debugging. • Preferred: Knowledge of AI/ML techniques for predicting potential software or hardware... 
    Senior
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    Sunnyvale, CA
    5 days ago
  • $152k - $241.5k

     ...across hybrid and multi-cloud infrastructure. We are building the next-...  ...platform teams, and partner engineering teams to understand requirements...  ...scale.Use modern software engineering practices, including...  ...large-scale data, storage, or ML infrastructure services.Experience... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    a month ago
  • $159k - $230k

     ...functionally with Hardware, Software, Mechanical, Thermal,...  ...degree in Electrical Engineering, Computer Engineering,...  ...and integration.As a Senior Hardware Engineer in...  ..., you will work on ML/AI hardware systems projects...  ...center.Our Platforms Infrastructure Engineering team... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $143.5k - $212.85k

     ...spanning all phases of the Software Development Lifecycle...  ..., guiding junior engineers, operating with little...  ...velocity of Venmo's Cloud Infrastructure and DevOps engineering...  ...tests. As a Senior Engineer on the AI Tooling...  ...teams to leverage LLM and ML capabilities in their... 
    Senior
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    Paypal

    San Jose, CA
    8 hours ago
  •  ...tht power or pplictions n or moels. They work closely with the I/ML tem n the proct tem to ensre tht or procts re highly vilble,...  ...power or procts, enbling relibility n secrity t scle ccelerte engineering proctivity by empowering yor fellow engineers with excellent... 

    CurieTech AI

    Sunnyvale, CA
    4 days ago
  • $143k - $191k

     ...talent decisions. We’re looking for a Software Engineer to design and build highly scalable, user...  ...product managers, designers, and AI/ML engineers to bring intelligent agents to...  ...Typescript, Webpack, NextJS. Data & Infrastructure: MySQL, Solr, Apache Airflow, Apache Spark... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Eightfold

    Santa Clara, CA
    8 hours ago
  •  ...leadership team: Our Heads of AI, Engineering, and Product bring extensive...  ...Now we need an experienced software engineer to make these...  ...applied AI scientists and an AI infrastructure engineer to transform code...  ...services. This is not an ML research role. This is a... 
    Senior

    Kai Cyber, Inc.

    San Jose, CA
    1 day ago
  • $168k - $270.25k

     ...next-generation architecture and software for managing storage services to support our engineers, architects with NVIDIA GPU design, VLSI, Corporate, and AI/ML teams. You will build the self-...  ...backbone of NVIDIA engineering infrastructure services and various business applications... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  • $174k - $252k

     ...test, deploy, maintain and improve switch software.Manage individual project priorities,...  ...experience with developing large-scale infrastructure, distributed systems or networks, or...  ...threading development.Google's software engineers develop the next-generation technologies... 
    Senior

    Google

    Sunnyvale, CA
    6 days ago
  •  ...RoCE, InfiniBand, and TCP/IP infrastructure. Build backend telemetry...  ...cross-functionally, improve engineering practices, automate operational...  ...debugging skills across software, operating system, server, and...  ...experience includes AI/ML, HPC, storage, GPU cluster,... 
    Senior
    Full time

    Clockwork.io

    Palo Alto, CA
    9 days ago
  •  ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of...  ....The Lambda Infrastructure Engineering organization forges the...  ...looking for an experienced Senior Software Engineer to join our storage...  ...Nice to HaveExperience with AI/ML workloads and the unique storage... 
    Senior
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Labs

    San Jose, CA
    1 day ago
  • $143.2k - $243k

     ...started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast...  ...search, product, data, and frontend teams, understand their infrastructure needs, influence infrastructure roadmap, and lead as well as... 
    Senior
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!