Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

$209k - $235k
Full-time

Gridmatic Inc

The Role We're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by the nature of energy markets: forecasts and trading decisions run on tight schedules, battery dispatch commands must execute reliably in real time, and ML models need to train and deploy continuously as new data arrives. What You'll Do Design and build the compute platform that runs Gridmatic's production services, batch jobs, and ML training workloads Help own our production workflow orchestration end to end, from the cluster and node pools it runs on to the abstractions our teams build on top of it Make our ML iteration cycle faster and cheaper by profiling workflows, cutting latency, and improving how we use compute Build the observability and developer tooling that lets engineers understand and troubleshoot their own workloads, from post-run cost reporting to monitoring and alerting Improve the reliability and resiliency of production workloads, including how we handle capacity constraints and multi-region routing Manage GPU and accelerator capacity: node pools, drivers, spot vs. on-demand tradeoffs, and scheduling and quota so training and batch jobs get the compute they need without overspending Own autoscaling and quota management so the platform scales up under load and down to zero when idle Work closely with the ML team to find pain points and quickly ship solutions Make architectural decisions that shape how we build software as we grow What We're Looking For Significant experience building and operating production infrastructure on a public cloud platform (we run on GCP, but AWS or Azure experience translates well) Strong distributed systems and infrastructure skills: standing up services, scaling and debugging Kubernetes (we run on GKE and it's foundational to our platform), writing Terraform, and comfort with cloud networking, IAM, and secrets management Hands-on experience with workflow orchestration tools like Flyte, Temporal, or Airflow Proficiency in Python, and either already know Go or have experience with a similar systems language (C++, Java, Rust) and are excited to work in Python and Go day-to-day Experience working closely with ML engineers or data scientists as your customers, and genuine excitement to keep doing it Clear communication, whether writing a design doc, reviewing code, or explaining a complex system to someone new to it Nice to Have Experience running GPU or accelerator workloads on Kubernetes (node pools, drivers, scheduling, quota) is strongly preferred for this role Familiarity with observability tooling (we use Grafana + Google Cloud Monitoring) Experience building internal developer platforms or tooling that other engineers rely on Prior work in domains where latency and reliability have direct business consequences Taking care of you today:

  • Continuing Education Opportunities
  • Flexible PTO
  • Medical, Dental and Vision plans with competitive employer contributions
  • Pre-Tax commuter benefits
  • $1500/year non profit donation matching program through Millie
  • Home Office Stipend
Protecting your future for you and your family:
  • 401K contribution match up to 4%
  • Company-paid parental leave
  • Company Paid Life Insurance
  • Stock Option Loan Program
Pay range

$209,000—$235,000 USD

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  • $140k - $225k

     ...assembling a diverse, world-class team—engineers, designers, researchers, and...  .... About The Role As the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role...  ...a plus Familiarity with ML Usage. Some familiarity with how... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    13 hours ago
  • $213k - $263k

     ...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the...  ...set of sensors, enabling software engineers like you to develop multi-modal models and...  ...building, integrating, debugging and evaluating ML-based systems We prefer: MS or... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    13 hours ago
  • $230k - $265k

     ...business has the financial tools they need. About The Position We’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly... 
    Senior
    Full time
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    13 hours ago
  •  ...decarbonize their business. We’re looking for software engineers to help build the AI platform that...  ...you will: Design and build the agent infrastructure that powers Watershed's products...  ...experience in backend, platform, or AI/ML engineering Experience building products... 
    Senior
    Work at office
    Remote work

    WaterSHED

    San Francisco, CA
    3 days ago
  • $176k - $220k

     ...institutions Work together with engineers, scientists, operators, and more...  ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI...  ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team.... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    26 days ago
  • $127k - $223k

     ...realistic closed-loop simulation engine built with the latest in...  ...will… - Develop the tooling, infrastructure, and pipelines to support complex...  ...programming and strong software engineering fundamentals with...  ...Experience in evaluating complex ML models or self-driving... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    12 days ago
  • $180k - $250k

     ...obsessed team of the world’s best engineers and operators. If you are...  ...We are looking for a Senior Software Engineer to join our Robotics...  ...Collaborate with robotics, ML, and product teams to define...  ...multi-agent systems, cloud infrastructures, internal tooling, and robot... 
    Senior
    Full time
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    13 hours ago
  •  ...systems that power our products, enable our engineers, and keep our platform infrastructure reliable as we grow. As a Senior Software Engineer on the Platform Team, you will own...  ...projects across Compa's products, systems, AI/ML, and data warehouse. Join us and help design... 
    Senior

    COMPA

    San Francisco, CA
    4 days ago
  •  ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team...  ..., and build the platform and infrastructure that makes state‑of‑the‑art document...  ...You'll work closely with our ML engineers to serve in‑house... 
    Senior
    Work at office
    Local area

    SupportFinity

    San Francisco, CA
    5 days ago
  • $220k - $300k

     ...the best product managers, software, and hardware talent at innovative...  ...to help them hire. Senior Software Engineer, Platform Location: San...  ...of Funding: Series A/B AI Infrastructure + Document Intelligence...  ...infrastructure and production ML systems The company... 
    Senior
    Work at office
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    San Francisco, CA
    3 days ago
  •  ...Discord safe for all users. We provide the infrastructure and services that enable scalable and...  ...on Discord. We're looking for a Senior Software Engineer who is capable of handling ambiguous,...  ...Collaborate with Trust & Safety, ML, and product teams to understand requirements... 
    Senior
    Work at office
    Relocation package
    2 days per week

    EngineersOfAI

    San Francisco, CA
    5 days ago
  • $220k - $300k

     ...close to our customers — from leadership to engineers — and work together to solve real...  ...AI foundation: the model layer and agent infrastructure that determine the quality of work our agents...  ..., with at least 1+ year focused on AI/ML engineering. Staff candidates will... 
    Senior

    Harvey

    San Francisco, CA
    3 days ago
  • $250k - $350k

     ...people (Series A) · Industry: AI / Data The Role As a Senior Software Engineer, Infrastructure and Platform, you'll design and build the core...  ...Experience with AI infrastructure, LLM evaluation systems, or ML pipelines Experience at high-growth startups or scaling... 
    Senior
    Full time
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    25 days ago
  • $180k - $250k

    About the Role We are looking for a Senior Software Engineer to join our Robotics organization, focused...  ...Collaborate with robotics, ML, and product teams to define requirements...  ...between our multi‑agent systems, cloud infrastructures, internal tooling, and robot‑facing interfaces... 
    Senior
    Local area
    Flexible hours

    Nimblerobotics

    San Francisco, CA
    3 days ago
  •  ...team. About the role We are hiring a Senior Software Engineer to own the data platform that powers...  ...experience building backend or data infrastructure in production Deep expertise in relational...  ...consume structured data, not pure ML research Comfort in customer‑facing technical... 
    Senior
    Work at office
    Flexible hours
    2 days per week

    Plenful

    San Francisco, CA
    5 days ago
  •  ...expanded into a horizontal automation engine adopted by HR, Finance, Legal, Security...  ...automate employee onboarding/offboarding, software access management, and the long tail of...  ...enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational... 
    Senior
    Full time

    Serval

    San Francisco, CA
    13 hours ago
  • $230k - $265k

     ...where every small business has the financial tools they need. About the Position We're seeking an experienced software engineer to join our Infrastructure team and help build the foundation for our rapidly growing financial technology platform. The Infrastructure... 
    Senior
    Full time
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    13 hours ago
  • $130k - $175k

     ...enable and empower Kiddom’s engineering by building a scalable and sustainable...  ...services. Practicing Infrastructure as Code (IaC) wherever...  ...field ~5+ years professional software engineering experience ~...  ...geography, past experience, seniority, and demonstrated role... 
    Senior
    Permanent employment
    Full time
    Work at office
    Local area
    Remote work

    Kiddom

    San Francisco, CA
    13 hours ago
  • $170k - $220k

     ...tested, and operated. Our platform gives engineers real-time observability over high-...  ...ensuring mission reliability demanded new infrastructure. Founded by a team from SpaceX, Google,...  ...and customer base. Collaborate with software engineers to optimize application performance... 
    Senior
    Full time
    Relocation

    Sift Stack

    San Francisco, CA
    13 hours ago
  •  ...team that ships hardware‑software systems into customer facilities...  ...‑backed team of robotics, ML, and operations engineers building the foundation...  ...to be rock‑solid. As a Senior Software Engineer on the Robotics...  ...Full‑stack or cloud infrastructure experience (monitoring, logging... 
    Senior
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    3 days ago
  • $215k - $265k

     ...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of...  .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,...  ...or building platforms that support AI/ML workflows Familiarity with GPU workloads... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    Apollo Research

    San Francisco, CA
    13 hours ago
  • $145.4k - $188.1k

     ...the Machine Learning Infrastructure Team At Thumbtack,...  ...detection, and more. The ML Infrastructure team is...  .... We empower product engineering teams by providing scalable...  ...The challenge As a Software Engineer on the ML...  .... Partner with senior engineers to evaluate... 
    Full time
    Seasonal work
    Local area

    Thumbtack

    San Francisco, CA
    13 hours ago
  •  ...This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running...  ...Much more! About the Role As an engineer within Fleet infrastructure, you will design...  ...As a bonus, have an understanding of AI/ML workloads About OpenAI OpenAI is... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    13 hours ago
  •  ...Background Specter is creating a software-defined "control plane" for the physical...  ...will ultimately become the perception engine for a company's physical footprint, enabling...  ...Specter is hiring an ML infrastructure engineer to build and scale the machine... 
    Full time

    S.e. Specter

    San Francisco, CA
    13 hours ago
  • $196k - $339.9k

     ...to transform how work gets done. Airtable’s infrastructure is evolving to meet the needs of our fast growing engineering org. We are looking for backend engineers to join...  ...data governance, and delivering cost efficient ML-ready datasets to power Airtable’s native AI... 
    Remote job
    Full time
    For contractors
    Work at office
    Relocation
    Flexible hours

    Airtable

    San Francisco, CA
    13 hours ago
  •  ...Why Join Us The Platform Engineering organization at Rad AI builds...  ...scale. Within Platform, the Infrastructure team owns our core cloud infrastructure...  ...headcount, spanning from Senior to Principal level. What...  ...engineering, data, and ML teams to design systems that... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Rad Ai

    San Francisco, CA
    13 hours ago
  •  ...-functional group working across engineering, product, research, and design to...  ...We’re looking for an experienced Software Engineer to help build the core infrastructure behind OpenAI’s monetization and...  ...in ads systems, marketplaces, AI/ML infra, or other monetization-intensive... 
    Full time
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    13 hours ago
  • $170k - $216k

     ...S. states. The Simulation Infrastructure team creates reliable, scalable...  ...evaluate the Waymo Driver's software stack at a massive scale. We...  ...range of customers Software Engineers, Product, Data Science, System...  ...will: Build and evolve ML inference infrastructure for... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    13 hours ago
  •  ...applied AI research, flexible infrastructure, and seamless developer tooling...  ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Software Engineer at on the Training Infrastructure...  ...systems for our ML training platform (e.g. scheduling... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    13 hours ago
  •  ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning...  ...of AI. The Role As a Software Engineer on our...  ...Points Experience with AI/ML workloads and infrastructure.... 
    Full time
    Work at office
    Work from home
    1 day per week

    Runloop

    San Francisco, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!