Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

LMArena

Senior Software Engineer, ML Infrastructure Posted 2 days ago. Be among the first 25 applicants. Get AI‑powered advice on this job and more exclusive features. About LMArena: LMArena is the open platform for evaluating how AI models perform in the real world. Created by researchers from UC Berkeley’s SkyLab, our mission is to measure and advance the frontier of AI for real‑world use. Millions of people use LMArena each month to explore how frontier systems perform — and we use our community’s feedback to build transparent, rigorous, and human‑centered model evaluations. Leading enterprises and AI labs rely on our evaluations to understand real‑world reliability, alignment, and impact. Our leaderboards are the gold standard for AI performance — trusted by leaders across the AI community and shaping the global conversation on model reliability and progress. We’re a team of researchers, engineers, academics, and builders from places like UC Berkeley, Google, Stanford, DeepMind, and Discord. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We’re building a company where thoughtful, curious people from all backgrounds can do their best work. Everyone on our team is a deep expert in their field — our office radiates excellence, energy, and focus. About the Role: LMArena is seeking a Senior Software Engineer (Infrastructure) to lead the design and development of scalable, high‑performance real‑time data and API infrastructure. In this role, you’ll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world’s most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast‑moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real‑world use cases. Responsibilities Architect and scale high‑performance, real‑time API and data systems Design and implement low‑latency pipelines to process and analyze large‑scale event streams Ensure reliability through robust data integrity, availability, and consistency mechanisms Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning Collaborate cross‑functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems Qualifications 5+ years of experience in software engineering, with a focus on infrastructure or large‑scale data and ML systems Deep expertise in distributed systems, stream processing, and scalable backend architecture Proven ability to design and operate low‑latency, high‑throughput, and fault‑tolerant systems Strong foundation in systems design, performance tuning, and building reliable, fault‑tolerant services Comfortable in a dynamic, high‑ownership, fast‑growth environment What We Offer Competitive compensation and equity aligned to the markets where our team members are based. Base salary depends on candidate’s permanent work location. Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs. The opportunity to work on cutting‑edge AI with a small, mission‑driven team. A culture that values transparency, trust, and community impact. Come help build the space where anyone can explore and help shape the future of AI. LMArena provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities. Seniority level Mid‑Senior level Employment type Full‑time Job function Engineering and Information Technology Industries Research Services #J-18808-Ljbffr LMArena

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  • $204k - $259k

     ....S. states. The Simulation ML Infrastructure team builds scalable AI/ML infrastructure...  .... We seek an experienced senior IC to lead the development...  .... This role reports to an Engineering Manager. You will: Be part...  ...: 5+ years of professional software engineering experience, with... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  •  ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of...  ...The Lambda Infrastructure Engineering organization forges the...  ...looking for an experienced Senior Software Engineer to join our storage...  ...to Have Experience with AI/ML workloads and the unique storage... 
    Senior
    Work at office
    Local area
    Work from home

    Lambda

    San Francisco, CA
    1 day ago
  • Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform...  ...non-engineers to build and manage data and ML pipelines. Establish monitoring,... 
    Senior
    Work at office
    3 days per week

    Claryo

    San Francisco, CA
    4 days ago
  • $200k - $240k

     ...workflow compliance, process efficiency. Every new use case runs through the perception team. We’re hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You’ll build systems that let our applied ML team train... 
    Senior
    Work at office
    Flexible hours

    Voxel

    San Francisco, CA
    1 day ago
  • Senior Software Engineer, Tooling and Development Infrastructure Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we...  ...consumer electronics is a plus. Familiarity with ML usage - leveraging machine learning models in a... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    Hp Iq

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...founding member of our engineering team, you will have a...  ...just “models.” It’s the software layer that turns:...  ...engineering. It is for senior software engineers who...  ...the backend systems and infrastructure that power the factory...  ...factory floor and cloud ML Infrastructure & Data... 
    Senior
    Full time
    Contract work

    Garuda Ventures

    San Francisco, CA
    3 days ago
  •  ...and builds the shared infrastructure that helps DoorDash, Wolt...  ...serving and inference engines, fine‑tuning and...  ...This role is ideal for a senior engineer who enjoys owning...  ...technical bar for — ML engineers, product...  ...industry experience in software engineering. Deep backend... 
    Senior
    Hourly pay
    Work at office
    Flexible hours

    DoorDash USA

    San Francisco, CA
    1 day ago
  • $176k - $230k

     ...progress. Over the last decade, software has transformed the digital...  ...scale. We are roboticists, engineers, operators, and builders. We...  ...the Machine Learning and AI Infrastructure team, which is focused on providing...  ...and other engineers to use ML and AI technologies... 
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours

    Cssmerge

    San Francisco, CA
    1 day ago
  • $149k - $186k

    We are looking for brilliant software engineers who have a passion for consumer products and want...  ...systems, and/or machine learning infrastructure, with an understanding of the complexities...  ...with operational tooling for ML services (monitoring, alerting, etc),... 
    Senior
    Full time
    Work at office

    Turo Inc.

    San Francisco, CA
    1 day ago
  • $200k - $250k

    Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you will design and build new infrastructure systems while scaling and strengthening...  ...to Have Experience building infrastructure for AI/ML workloads or high‑throughput inference systems... 
    Senior
    Internship
    Worldwide
    Relocation package

    Harvey

    San Francisco, CA
    1 day ago
  •  ...our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about...  ...We’re building the next generation of agentic AI infrastructure at Cohere. This team sits at the intersection of ML systems, distributed infrastructure, and developer... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    San Francisco, CA
    1 day ago
  •  ...and overcoming obstacles. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at...  ...expertise with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure... 
    Senior
    Work at office
    3 days per week

    Altruist

    San Francisco, CA
    1 day ago
  • $160k - $230k

    Senior Software Engineer - Together Cloud Infrastructure Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle...  ...cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables... 
    Senior
    Full time
    Work at office
    Remote work

    Together AI

    San Francisco, CA
    3 days ago
  • $180k - $270k

     ...and guidance to teams across engineering, product, and business and...  ...the data and machine learning infrastructure to enable Plaid engineers to...  ...projects such as improving ML development golden paths, implementing...  ...Qualifications 5+ years of software engineering experience... 
    Senior
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    1 day ago
  • $200k - $400k

     ...grow as a team. About the Team The Infrastructure team builds and operates the foundations...  ...power Decagon: networking, data, ML serving, developer platform, and...  ...accurately. About the Role We’re hiring a Senior Data Infrastructure Engineer to design, build, and operate the... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago
  •  ...financial data network. The Machine Learning Infrastructure team sits at the center of this...  ..., and establishing a standardized ML Ops “golden path.” Our mission is to...  ...powered financial experiences. As a Senior Software Engineer on the Machine Learning Infrastructure... 
    Senior
    Shift work

    Plaid

    San Francisco, CA
    more than 2 months ago
  • $186.07k - $218.9k

    Senior Software Engineer, Developer Infrastructure What you’ll be doing (job duties) Design, build, and operate core developer‑infrastructure services — spanning CI and build systems, deployment orchestration, and test infrastructure — that are fast, reliable, and secure... 
    Senior
    Local area
    Remote work

    Coinbase

    San Francisco, CA
    1 day ago
  •  ...decarbonize their business. We’re looking for software engineers to help build the AI platform that...  ...you will: Design and build the agent infrastructure that powers Watershed's products...  ...experience in backend, platform, or AI/ML engineering Experience building products... 
    Senior
    Work at office
    Remote work

    WaterSHED

    San Francisco, CA
    3 days ago
  • $176k - $220k

     ...institutions Work together with engineers, scientists, operators, and more...  ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI...  ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team.... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    6 days ago
  • Cruise LLC in San Francisco is seeking an experienced Senior Software Engineer to join our Machine Learning Orchestration team. This role involves building scalable infrastructure and automation tools to support self-driving technology. The ideal candidate will have over... 
    Senior

    Cruise LLC

    San Francisco, CA
    1 day ago
  • $200k - $250k

     ...and ship category-defining software that enables Ryder and its...  ...creating impact for the engine of the American economy, you...  ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning...  ...in distributed systems and ML operations to enhance our... 
    Senior
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    more than 2 months ago
  • Hayden AI Technologies, Inc. is looking for a Senior Software Engineer to join their Platform - Cloud Events team in San Francisco. The role focuses on optimizing cloud-based ML operations, improving architecture, and collaborating with multiple teams. Candidates should... 
    Senior
    Work at office
    3 days per week

    Hayden AI Technologies, Inc.

    San Francisco, CA
    19 hours ago
  • Handshake is seeking a Senior Software Engineer on the Allocation & Onboarding team to own end-to-end experiences...  ..., from onboarding to scalable platform infrastructure. You’ll collaborate with Growth, Product, Operations, ML, and Platform to translate evolving business... 
    Senior

    Apply

    San Francisco, CA
    3 days ago
  • A leading software company in San Francisco is seeking a Software Developer to drive feature implementation and improve developer productivity...  ...skills are essential. Come join us to create innovative solutions in the world of design and engineering. #J-18808-Ljbffr Autodesk, Inc.
    Senior

    Autodesk, Inc.

    San Francisco, CA
    1 day ago
  •  ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team...  ..., and build the platform and infrastructure that makes state‑of‑the‑art document...  ...You'll work closely with our ML engineers to serve in‑house... 
    Senior
    Work at office
    Local area

    SupportFinity

    San Francisco, CA
    19 hours ago
  • Weights & Biases is looking for a Senior Software Engineer in San Francisco to design and build a generative AI platform aimed at users, leveraging...  ...in Python or TypeScript, alongside experience with ML libraries and managing production services. You will be a key... 
    Senior
    Flexible hours

    Weights & Biases

    San Francisco, CA
    1 day ago
  • An innovating tech company in San Francisco is seeking a Senior Software Engineer to lead the design and development of an AI platform. In this role...  ...like Java or Python, and a strong background in AI/ML. This position offers a unique opportunity to influence the... 
    Senior
    Work experience placement

    JazzX AI

    San Francisco, CA
    1 day ago
  • Regional Manager, Sales Engineering - Public Sector As a Regional Manager, Sales Engineering,...  ...Developer (BigCommerce Experience Required) AI/ML Headquarters: Philippines URL:...  ...2018. We provide a variety of tools to… Senior Web Developer SaaS Headquarters: Remote... 
    Senior
    Part time
    Internship
    Remote work

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  • We are looking for a Senior Platform Engineer with 5+ years of experience to own and strengthen the...  ...distributed systems. You'll work closely with ML engineers and take on‑call...  ...pipelines Building and maintaining infrastructure including databases, task orchestration... 
    Senior
    Work experience placement

    RST Recruitment

    San Francisco, CA
    1 day ago
  • $177.9k - $257.55k

    Adobe is seeking a skilled software engineer for the Kodiak team. In this role, you'll create and manage features for an enterprise-scale security scanning platform, integrating AI and skilled at backend engineering. The ideal candidate has a Bachelor's degree or equivalent... 
    Senior

    Adobe

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!