Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

LMArena

Senior Software Engineer, ML Infrastructure Posted 2 days ago. Be among the first 25 applicants. Get AI‑powered advice on this job and more exclusive features. About LMArena: LMArena is the open platform for evaluating how AI models perform in the real world. Created by researchers from UC Berkeley’s SkyLab, our mission is to measure and advance the frontier of AI for real‑world use. Millions of people use LMArena each month to explore how frontier systems perform — and we use our community’s feedback to build transparent, rigorous, and human‑centered model evaluations. Leading enterprises and AI labs rely on our evaluations to understand real‑world reliability, alignment, and impact. Our leaderboards are the gold standard for AI performance — trusted by leaders across the AI community and shaping the global conversation on model reliability and progress. We’re a team of researchers, engineers, academics, and builders from places like UC Berkeley, Google, Stanford, DeepMind, and Discord. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We’re building a company where thoughtful, curious people from all backgrounds can do their best work. Everyone on our team is a deep expert in their field — our office radiates excellence, energy, and focus. About the Role: LMArena is seeking a Senior Software Engineer (Infrastructure) to lead the design and development of scalable, high‑performance real‑time data and API infrastructure. In this role, you’ll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world’s most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast‑moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real‑world use cases. Responsibilities Architect and scale high‑performance, real‑time API and data systems Design and implement low‑latency pipelines to process and analyze large‑scale event streams Ensure reliability through robust data integrity, availability, and consistency mechanisms Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning Collaborate cross‑functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems Qualifications 5+ years of experience in software engineering, with a focus on infrastructure or large‑scale data and ML systems Deep expertise in distributed systems, stream processing, and scalable backend architecture Proven ability to design and operate low‑latency, high‑throughput, and fault‑tolerant systems Strong foundation in systems design, performance tuning, and building reliable, fault‑tolerant services Comfortable in a dynamic, high‑ownership, fast‑growth environment What We Offer Competitive compensation and equity aligned to the markets where our team members are based. Base salary depends on candidate’s permanent work location. Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs. The opportunity to work on cutting‑edge AI with a small, mission‑driven team. A culture that values transparency, trust, and community impact. Come help build the space where anyone can explore and help shape the future of AI. LMArena provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities. Seniority level Mid‑Senior level Employment type Full‑time Job function Engineering and Information Technology Industries Research Services #J-18808-Ljbffr LMArena

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  • $140k - $225k

     ...assembling a diverse, world-class team—engineers, designers, researchers, and...  ...best work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role...  ...electronics a plusFamiliarity with ML Usage. Some familiarity with how... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    6 days ago
  • $200k - $280k

     ...SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE Build the core infrastructure that powers petabyte-scale data collection and delivery for the world's leading...  ...TO HAVE Experience with robotics, computer vision, or ML infrastructure Background in video processing or real... 
    Senior
    Home office

    Gerra, Inc.

    San Francisco, CA
    1 day ago
  •  ...Senior Software Engineer - ML Infrastructure Location Employment Type Full time Location Type On-site Department Compensation We're looking for a Senior Machine Learning Engineer to build and scale the infrastructure that powers our AI-driven... 
    Senior
    Full time
    Work at office
    3 days per week

    Claryo

    San Francisco, CA
    1 day ago
  •  ...institutions Work together with engineers, scientists, operators, and...  ...Human data is the core infrastructure to AI advancement. Frontier...  ...Role Handshake is hiring a Senior Software Engineer to join Backend...  ...Developer Platform group, including ML and Cloud Engineering, on... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    1 day ago
  •  ...Platform Engineer HUD is building infrastructure to create RL training data and evals for frontier AI agents,...  ...maintainable code and apply strong software engineering judgment across product...  ...operating infrastructure for data-heavy, ML/AI, workflow, marketplace,... 
    Senior
    Full time
    Work at office
    Remote work
    Relocation
    Visa sponsorship

    Hud (yc W25)

    San Francisco, CA
    1 day ago
  •  ...immediate opportunities for senior software developers who want their lines...  ...review, mentoring junior engineers, and providing technical guidance...  ...products over public cloud infrastructure - AWS/Azure/GCP. ~- Proven...  ...Experience with Big-Data/ML and S3 Hands-on experience... 
    Senior
    Immediate start

    Leadout Capital

    San Francisco, CA
    2 days ago
  • $148.5k - $223.9k

     ...immediate opportunities for senior software developers who want their lines...  ...review, mentoring junior engineers, and providing technical guidance...  ...products over public cloud infrastructure - AWS/Azure/GCP.- Proven...  ...Skills:Experience with Big-Data/ML and S3 Hands-on experience... 
    Senior
    Full time
    Immediate start

    Salesforce

    San Francisco, CA
    4 days ago
  • $200k - $400k

    # Senior Software Engineer, Cloud InfrastructureDecagonSan FranciscoFull TimeJuly 10, 2026Senior Software...  ...grow as a team. ABOUT THE TEAM The Infrastructure team builds and operates the...  ...that power Decagon: networking, data, ML serving, developer platform, and real... 
    Senior
    Full time
    Work at office
    Local area
    Shift work

    OfferGenie

    San Francisco, CA
    1 day ago
  • $176k - $230k

     ...progress. Over the last decade, software has transformed the digital...  ...scale. We are roboticists, engineers, operators, and builders. We...  ...the Machine Learning and AI Infrastructure team, which is focused on providing...  ...and other engineers to use ML and AI technologies... 
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours

    Atoms

    San Francisco, CA
    2 days ago
  •  ...and overcoming obstacles. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at...  ...with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure operations... 
    Senior
    Work at office
    Immediate start
    3 days per week

    Altruist

    San Francisco, CA
    2 days ago
  • $180k - $270k

     ...and guidance to teams across engineering, product, and business and...  ...the data and machine learning infrastructure to enable Plaid engineers to...  ...projects such as improving ML development golden paths, implementing...  ...Qualifications 5+ years of software engineering experience... 
    Senior
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    2 days ago
  • $180k - $220k

     ...Lightning AI combines developer-first software with cost-efficient, large-scale...  ...Role Lightning AI is seeking a Senior Infrastructure Software Engineer to join our Infrastructure Engineering...  ...systems our customers depend on for AI/ML training, inference, and HPC... 
    Senior
    Work at office
    Remote work
    Work from home
    Flexible hours

    Lightning AI

    San Francisco, CA
    1 day ago
  • $165k - $226.6k

     ...potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era....  ..., and transform their users’ experiences. Okta's Core Engineering team is responsible for building and evolving shared infrastructure... 
    Senior
    Permanent employment
    Work at office
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    4 days ago
  •  ...every small business has the financial tools they need.About The PositionWe’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly... 
    Senior
    Flexible hours

    Parafin

    San Francisco, CA
    6 days ago
  • $148.5k - $223.9k

     ...re looking for an experienced and hands-on software engineer to join our team to build and scale the next generation of infrastructure management service and operation solutions....  ...Apply AI and Machine Learning: Leverage AI/ML models for intelligent data analysis, anomaly... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  •  ...patients worldwide.We’re a team of engineers, clinicians, and innovators...  ...DescriptionPrimary Function of PositionAs a Senior Software Engineer - Simulation & ML Platform, you will build software...  ...and maintain software infrastructure for robotic simulations & ML using... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    6 days ago
  • $187k

     ...Platform (MLP) team builds and operates the infrastructure, tooling, and developer experience...  .... We enable data scientists and ML engineers to develop, train, deploy, and monitor...  ...models reliably and efficiently.As a Senior Software Engineer on the Machine Learning Platform... 
    Senior
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    7 days ago
  • $159.8k - $235k

     ...reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant...  ...-tenant scheduling, and end-user tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will set the technical direction for... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  •  ...sits at the center of Pave Engineering, bridging product and platform...  ...to ship enterprise-grade software with speed and confidence. In...  ...well as the foundational data infrastructure and models powering Pave’s...  ...pipelines/ ETLs, data modeling; ML/AI platform experience a... 
    Senior
    Flexible hours

    Trove Information Technologies

    San Francisco, CA
    5 days ago
  • $200k - $400k

     ...builds the foundational systems that enable every engineer at Decagon to build with AI. Our users are...  ..., write, test, review, and ship production software. We sit within Infrastructure and work closely with product, ML, data, and security teams. Our goal is to turn... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago
  • $250k - $320k

    (Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens...  ...hotfix. Partner with the inference/ML platform team from the production side:... 
    Senior
    Permanent employment
    Full time

    Together Computer Inc

    San Francisco, CA
    16 hours ago
  •  ...Mariana Minerals Mariana Minerals is a software-first, vertically integrated minerals...  ...is looking for a Sr. or Staff Software Engineer, Infrastructure to join the team that owns and...  ...learning engineers and data engineers on the ML compute platform and data pipeline infrastructure... 
    Senior

    Mariana Minerals

    San Francisco, CA
    5 days ago
  •  ...Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of...  ...for small businesses.As a Senior Software Engineer, you’ll be responsible...  ...models that power internal dashboards, ML models, and customer-facing... 
    Senior
    Flexible hours

    Parafin

    San Francisco, CA
    6 days ago
  • $165k - $185k

     ...learn more, go to . THE ROLEAs a Senior Data Platform Engineer, you will build and operate the data infrastructure that supports Zeta’s products...  ...for trusted reporting, ML models, and AI agents. Evaluate...  ...sessions. QUALIFICATIONS7+ years of software engineering experience.... 
    Senior
    Work at office

    Zeta Global

    San Francisco, CA
    4 days ago
  • CoreWeave is hiring a Senior Software Engineer to own architecture across ML Workflows, including artifacts, registry, and automation components. The role spans Go backend services, GraphQL APIs, Python SDK, and a TypeScript frontend, with collaboration across product... 
    Senior

    CoreWeave Europe

    San Francisco, CA
    4 days ago
  • $180k - $250k

     ...Senior Software Engineer, Robotics Platform About Nimble Nimble is an AI robotics company building...  ...Collaborate with robotics, ML, and product teams to define requirements...  ...between our multi-agent systems, cloud infrastructures, internal tooling, and robot-facing... 
    Senior
    Local area
    Flexible hours

    Nimble

    San Francisco, CA
    2 days ago
  • $170k - $205k

     ...only vertically integrated AI infrastructure company built from the...  ...Role:Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire...  ...Engineering Teams: Partner with software engineers, data scientists,...  ...infrastructure for AI/ML workloads or cloud computing... 
    Senior
    Full time
    Temporary work
    Work at office
    Remote work

    Crusoe

    San Francisco, CA
    7 days ago
  • Nimble seeks a Senior Software Engineer for its Robotics Platform to design and ship the backend and robotics software powering robot-enabled products...  ...services, APIs, and tooling, and collaborate with robotics, ML, and product teams to meet demanding production requirements... 
    Senior

    Nimble

    San Francisco, CA
    2 days ago
  •  ...Senior Data Platform Engineer Handshake is hiring a Senior Data Platform Engineer...  ...to build and operate the infrastructure that moves data reliably...  ...products. On the Data and ML Platform team, you will own...  ...Capabilities Strong software engineering skills in Python... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    2 days ago
  • A leading technology company in San Francisco is seeking an experienced Software Engineer for its Machine Learning Platform team. You will design and build services that support Apple’s machine learning and computer vision efforts. Responsibilities include leading systems... 
    Senior

    Apple

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!