Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

Gridmatic

The RoleWe're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by the nature of energy markets: forecasts and trading decisions run on tight schedules, battery dispatch commands must execute reliably in real time, and ML models need to train and deploy continuously as new data arrives.What You'll DoDesign and build the compute platform that runs Gridmatic's production services, batch jobs, and ML training workloadsHelp own our production workflow orchestration end to end, from the cluster and node pools it runs on to the abstractions our teams build on top of itMake our ML iteration cycle faster and cheaper by profiling workflows, cutting latency, and improving how we use computeBuild the observability and developer tooling that lets engineers understand and troubleshoot their own workloads, from post-run cost reporting to monitoring and alertingImprove the reliability and resiliency of production workloads, including how we handle capacity constraints and multi-region routingManage GPU and accelerator capacity: node pools, drivers, spot vs. on-demand tradeoffs, and scheduling and quota so training and batch jobs get the compute they need without overspendingOwn autoscaling and quota management so the platform scales up under load and down to zero when idleWork closely with the ML team to find pain points and quickly ship solutionsMake architectural decisions that shape how we build software as we growWhat We're Looking ForSignificant experience building and operating production infrastructure on a public cloud platform (we run on GCP, but AWS or Azure experience translates well)Strong distributed systems and infrastructure skills: standing up services, scaling and debugging Kubernetes (we run on GKE and it's foundational to our platform), writing Terraform, and comfort with cloud networking, IAM, and secrets managementHands-on experience with workflow orchestration tools like Flyte, Temporal, or AirflowProficiency in Python, and either already know Go or have experience with a similar systems language (C++, Java, Rust) and are excited to work in Python and Go day-to-dayExperience working closely with ML engineers or data scientists as your customers, and genuine excitement to keep doing itClear communication, whether writing a design doc, reviewing code, or explaining a complex system to someone new to itNice to HaveExperience running GPU or accelerator workloads on Kubernetes (node pools, drivers, scheduling, quota) is strongly preferred for this roleFamiliarity with observability tooling (we use Grafana + Google Cloud Monitoring)Experience building internal developer platforms or tooling that other engineers rely onPrior work in domains where latency and reliability have direct business consequencesTaking care of you today:- Continuing Education Opportunities- Flexible PTO- Medical, Dental and Vision plans with competitive employer contributions- Pre-Tax commuter benefits- $1500/year non profit donation matching program through Millie- Home Office StipendProtecting your future for you and your family:- 401K contribution match up to 4%- Company-paid parental leave- Company Paid Life Insurance- Stock Option Loan ProgramPay range $209,000—$270,000 USD

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in Cupertino, CA vacancy
  • $168k - $264.5k

     ...the world.Join NVIDIA’s CAD Infrastructure team and be part of something...  ...are building a next-generation software platform for semiconductor...  ...ambitious endeavor, and we need engineers who thrive in a hands-on...  ...GNN-based systems.Exposure to ML or agentic tooling, particularly... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $174k - $252k

     ...experience.5 years of experience with software development in one or more...  ...and developing large-scale infrastructure or distributed systems.1 year...  ...Rust, or Java.Experience in ML model coding languages (e.g., Python).Google's software engineers develop the next-generation... 
    Senior

    Google

    Sunnyvale, CA
    2 days ago
  • $204k - $259k

     ...U.S. states. The Onboard Software Performance team ensures that...  ...of experience as a software engineer or similar roles ~5 years of...  ...We prefer: 2 years in infrastructure/systems/performance domain optimizing...  ..., frameworks (SIMD/CUDA) and ML performance/frameworks... 
    Senior
    Full time
    Work at office
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  •  ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of...  ....The Lambda Infrastructure Engineering organization forges the...  ...looking for an experienced Senior Software Engineer to join our storage...  ...Nice to HaveExperience with AI/ML workloads and the unique storage... 
    Senior
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Labs

    San Jose, CA
    5 hours ago
  • $193.93k - $291.15k

     .... Rowe Price, and other leading investorsAbout the RoleNuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration, and data processing to join our ML Infrastructure team. In this role, you will focus on building and evolving... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $183k - $275k

     ...different aspects of the software and hardware...  ...autonomy code change, from ML model updates to radius...  ...road. You will own the infrastructure that makes this possible...  ..., and much much more.Engineers across the company...  ...deliver, and you've briefed senior engineering leadership... 
    Senior
    Temporary work
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $198k - $326k

     ...frameworks that empower engineers and researchers to...  ...robust, highly scalable infrastructure that delivers continuous...  ...scale.As a Sr. Staff Software Engineer, you will...  ...distributed systems and ML platform problems while...  ...SalesExperience level: Mid-Senior LevelIndustry:... 
    Senior
    For contractors
    Work at office
    Flexible hours
    Shift work

    Linkedin

    Sunnyvale, CA
    5 hours ago
  • $184k - $287.5k

     ...developing advanced multi-rack, multi-tenant AI/ML datacenters with NVIDIA GB200, and upcoming GB300 GPUs. NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider)...  ...(Prometheus, OpenTelemetry), and infrastructure-as-code.Excellent communication-able to... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...want to help build the best platform for ML/AI infrastructure? Do you thrive when your work directly...  ...collaborative group of cloud platform engineers, architects, and SREs who are...  ...upgrades and decommissioning. We build software in the open, with a goal of enabling new... 
    Senior
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    1 day ago
  • $174k - $252k

     ...design, development, and optimization of software components critical for Large...  ...orchestration (Kubernetes, Google Kubernetes Engine (GKE)), networking infrastructure, and hardware acceleration to build...  ...software development, including AI/ML applications.Preferred... 
    Senior

    Google

    Sunnyvale, CA
    3 days ago
  • $163k - $237k

     ...Bachelor's degree in Electrical Engineering, Computer Engineering,...  ...work to shape the future of AI/ML hardware acceleration. You...  ...usage scenarios.The AI and Infrastructure team is redefining what’s possible...  ...to build the future. From software to hardware our teams are... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  •  ...easy to build and deploy as software. Today, robotics is fragmented...  ...We are looking for a Senior AI Engineer to design, build, and ship AI...  ...full stack — from the agentic infrastructure that powers our robot operations...  ...and webhooks; Python for AI/ML integration and scripting... 
    Senior
    Full time

    Dexmate

    Santa Clara, CA
    1 day ago
  • $174k - $252k

     ...networking features to enable AI/ML workloads in GDC platforms....  ....5 years of experience with software development in Go, C or...  ...with developing large-scale infrastructure, distributed systems or networks...  ...Linux OSs.Google's software engineers develop the next-generation technologies... 
    Senior

    Google

    Sunnyvale, CA
    5 hours ago
  • $174k - $253k

     ...solutions in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise in a...  ...testing, maintaining, or launching software products, and 1 year of experience...  ...accessible technologies.Google's software engineers develop the next-generation... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $224k - $356.5k

     ...Local AI team is building the software stack that makes large...  ...recipes, and model bring-up infrastructure — that lets developers run groundbreaking...  ...Computer Science, Computer Engineering, Electrical Engineering, or...  ...depth in GPU computing, ML systems, or high-performance... 
    Senior
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    1 day ago
  • $200k - $322k

     ...creative, and hands-on Senior full-stack developer...  ...and productivity. This engineer is expected to be familiar...  ..., and scaling of our software systems. This role...  ...collaborate with Cloud, AI/ML & Generative AI...  ...reasoning. Build reusable infrastructure for agent... 
    Senior
    Full time
    Immediate start

    Nvidia

    Santa Clara, CA
    1 day ago
  • $193.3k - $261.5k

     ...of these custom SoCs — that let software teams start development months before...  .... We're looking for a software engineer to build and own the models and infrastructure that make this possible.What you'...  ...pieces of the stackNo ML background needed. You'll learn the... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $193.93k - $291.15k

     ...team of high-output generalists where ML and systems engineering converge to push autonomy performance forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical...  ...YouBS/MS in Computer Science, Software Engineering, Robotics, or a related... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    5 hours ago
  • $198k - $326k

     ....As part of our world-class software engineering team, you will take the lead...  ...building the next-generation infrastructure and platforms for LinkedIn,...  ...platform, best-in-class AI/ML infrastructure, Kubernetes compute...  ...EngineeringExperience level: Mid-Senior LevelIndustry: Internet
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Sunnyvale, CA
    5 hours ago
  • $184k - $287.5k

     ...We focus on building the AI/ML platform for improving productivity...  ...as developing scalable AI infrastructure services globally. We are seeking an AI infrastructure software engineer to join our team. You'll be...  ...AI in production.As a senior DGX Cloud AI Infrastructure... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $159k - $231k

     ...Bachelor’s degree in Electrical Engineering, Computer Engineering,...  ...Integrity Engineer within Platforms Infrastructure Engineering, you will play a...  ...AI hardware for AL/ML, server, networking, and storage...  ...to build the future. From software to hardware our teams are shaping... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates... 
    Senior
    Full time

    Jobleads-US

    Sunnyvale, CA
    2 days ago
  • $152k - $241.5k

     ...across hybrid and multi-cloud infrastructure. We are building the next-...  ...platform teams, and partner engineering teams to understand requirements...  ...scale.Use modern software engineering practices, including...  ...large-scale data, storage, or ML infrastructure services.Experience... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 hours ago
  •  ...Senior Platform Software EngineerThis role has been designed as 'Hybrid' with an expectation that you...  ...operating systems, network subsystems, routing engines, security modules, utilities, embedded...  ...debugging.• Preferred: Knowledge of AI/ML techniques for predicting potential... 
    Senior
    Work at office
    2 days per week

    Hewlett Packard Enterprise Development LP

    Sunnyvale, CA
    2 days ago
  • $159k - $230k

     ...network, power and cooling infrastructure for end-to-end system...  ...development of test software and infrastructure...  ...software designers, test engineers, on project planning...  ...multiple lab users.As a Senior Hardware Performance...  ...to-end highly complex ML system design involving... 
    Senior

    Google

    Sunnyvale, CA
    5 hours ago
  •  ..., Secure Cloud and AI infrastructure is the foundation of our...  ...world‑class Principal Engineer (Sr Manager‑equivalent...  ...our standards for software quality, and unlock new...  ...platforms, mentoring senior engineers and infusing...  ...experience applying AI/ML/GenAI to solve complex... 
    Senior
    Full time
    Work at office
    3 days per week

    Jobleads-US

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

    NVIDIA's Deep Learning Libraries Group is seeking excellent software engineers to enable the next wave of NVIDIA’s highest performing deep...  .... The mission is to design and develop scalable, modular infrastructure that streamlines development, build, and test across NVIDIA... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $174k - $252k

     ...implementation of GGN’s virtualization infrastructure using Kubernetes to accelerate testing...  ...level technical leadership to emulation engineers by defining design and implementation strategies...  ...experience.5 years of experience with software development in one or more programming... 
    Senior

    Google

    Sunnyvale, CA
    2 days ago
  • $139k - $204k

     ...CoreWeave’s industry‑leading cloud infrastructure with the best‑in‑class tools...  ...at the intersection of software, hardware, and AI, there’s never...  ...the world’s leading AI and ML teams. The team focuses on data...  ...About The Role As a Software Engineer, you’ll lead efforts to scale... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Weights & Biases

    Sunnyvale, CA
    1 day ago
  • $174k - $253k

     ...experience testing, maintaining, or launching software products, and 1 year of experience with...  ...of experience developing large-scale infrastructure, distributed systems or networks, or...  ...technologies. Google's software engineers develop the next-generation technologies... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!