Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

LMArena

Senior Software Engineer, ML Infrastructure Posted 2 days ago. Be among the first 25 applicants. Get AI‑powered advice on this job and more exclusive features. About LMArena: LMArena is the open platform for evaluating how AI models perform in the real world. Created by researchers from UC Berkeley’s SkyLab, our mission is to measure and advance the frontier of AI for real‑world use. Millions of people use LMArena each month to explore how frontier systems perform — and we use our community’s feedback to build transparent, rigorous, and human‑centered model evaluations. Leading enterprises and AI labs rely on our evaluations to understand real‑world reliability, alignment, and impact. Our leaderboards are the gold standard for AI performance — trusted by leaders across the AI community and shaping the global conversation on model reliability and progress. We’re a team of researchers, engineers, academics, and builders from places like UC Berkeley, Google, Stanford, DeepMind, and Discord. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We’re building a company where thoughtful, curious people from all backgrounds can do their best work. Everyone on our team is a deep expert in their field — our office radiates excellence, energy, and focus. About the Role: LMArena is seeking a Senior Software Engineer (Infrastructure) to lead the design and development of scalable, high‑performance real‑time data and API infrastructure. In this role, you’ll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world’s most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast‑moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real‑world use cases. Responsibilities Architect and scale high‑performance, real‑time API and data systems Design and implement low‑latency pipelines to process and analyze large‑scale event streams Ensure reliability through robust data integrity, availability, and consistency mechanisms Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning Collaborate cross‑functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems Qualifications 5+ years of experience in software engineering, with a focus on infrastructure or large‑scale data and ML systems Deep expertise in distributed systems, stream processing, and scalable backend architecture Proven ability to design and operate low‑latency, high‑throughput, and fault‑tolerant systems Strong foundation in systems design, performance tuning, and building reliable, fault‑tolerant services Comfortable in a dynamic, high‑ownership, fast‑growth environment What We Offer Competitive compensation and equity aligned to the markets where our team members are based. Base salary depends on candidate’s permanent work location. Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs. The opportunity to work on cutting‑edge AI with a small, mission‑driven team. A culture that values transparency, trust, and community impact. Come help build the space where anyone can explore and help shape the future of AI. LMArena provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities. Seniority level Mid‑Senior level Employment type Full‑time Job function Engineering and Information Technology Industries Research Services #J-18808-Ljbffr

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  •  ...progress. We’re a team of researchers, engineers, academics, and builders from places...  ...Arena Intelligence is seeking a Senior Software Engineer (Infrastructure) to lead the design and development...  ...infrastructure or large-scale data and ML systems Deep expertise in... 
    Senior
    Permanent employment
    Work at office

    Arena

    San Francisco, CA
    5 days ago
  • $200k - $240k

     ...workflow compliance, process efficiency. Every new use case runs through the perception team. We’re hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You’ll build systems that let our applied ML team train... 
    Senior
    Work at office
    Flexible hours

    Voxel

    San Francisco, CA
    5 days ago
  • $200k - $250k

     ...Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you will design and build new infrastructure systems while scaling and strengthening...  ...Nice to Have Experience building infrastructure for AI/ML workloads or high‑throughput inference systems... 
    Senior
    Internship
    Worldwide
    Relocation package

    Harvey

    San Francisco, CA
    5 days ago
  • $149k - $186k

    We are looking for brilliant software engineers who have a passion for consumer products and want...  ...systems, and/or machine learning infrastructure, with an understanding of the complexities...  ...with operational tooling for ML services (monitoring, alerting, etc),... 
    Senior
    Full time
    Work at office

    Turo Inc.

    San Francisco, CA
    1 day ago
  • $180k - $270k

     ...and guidance to teams across engineering, product, and business and...  ...the data and machine learning infrastructure to enable Plaid engineers to...  ...projects such as improving ML development golden paths, implementing...  ...Qualifications 5+ years of software engineering experience... 
    Senior
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences...  ...the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago
  • $186.07k - $218.9k

     ...Senior Software Engineer, Developer Infrastructure What you’ll be doing (job duties) Design, build, and operate core developer‑infrastructure services — spanning CI and build systems, deployment orchestration, and test infrastructure — that are fast, reliable, and secure... 
    Senior
    Local area
    Remote work

    Coinbase

    San Francisco, CA
    5 days ago
  •  ...financial data network. The Machine Learning Infrastructure team sits at the center of this...  ..., and establishing a standardized ML Ops “golden path.” Our mission is to...  ...powered financial experiences. As a Senior Software Engineer on the Machine Learning Infrastructure... 
    Senior
    Shift work

    Plaid

    San Francisco, CA
    more than 2 months ago
  •  ...decarbonize their business. We’re looking for software engineers to help build the AI platform that...  ...you will: Design and build the agent infrastructure that powers Watershed's products...  ...experience in backend, platform, or AI/ML engineering Experience building products... 
    Senior
    Work at office
    Remote work

    WaterSHED

    San Francisco, CA
    3 days ago
  • $176k - $220k

     ...institutions Work together with engineers, scientists, operators, and more...  ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI...  ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team.... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    11 days ago
  •  ...Your Role: Senior Software Engineer - Agentic AI Platform Tenable is building a world‑class engineering...  ...with control. Bridge AI & Enterprise Infrastructure: Create the integration layer between...  ...skills in Python (essential for AI/ML ecosystems) with experience in, or a... 
    Senior
    Live in
    Work from home
    Relocation

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    5 days ago
  •  ...systems that power our products, enable our engineers, and keep our platform infrastructure reliable as we grow. As a Senior Software Engineer on the Platform Team, you will own...  ...projects across Compa's products, systems, AI/ML, and data warehouse. Join us and help design... 
    Senior

    COMPA

    San Francisco, CA
    5 days ago
  • $200k - $350k

     ...About the Role Join a well-funded AI/ML data analytics startup building an agentic...  ...from messy enterprise data. As a Senior Software Engineer, Platform , you'll be a core member...  ...engineering resources. Contribute across infrastructure, services, and frontend as the team... 
    Senior
    Work at office
    Remote work
    Visa sponsorship

    Clera

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...and ship category-defining software that enables Ryder and its...  ...creating impact for the engine of the American economy, you...  ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning...  ...in distributed systems and ML operations to enhance our... 
    Senior
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    more than 2 months ago
  • $127k - $223k

     ...realistic closed-loop simulation engine built with the latest in...  ...will… - Develop the tooling, infrastructure, and pipelines to support complex...  ...programming and strong software engineering fundamentals with...  ...Experience in evaluating complex ML models or self-driving... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    27 days ago
  • $220k - $300k

     ...the best product managers, software, and hardware talent at innovative...  ...to help them hire. Senior Software Engineer, Platform Location: San...  ...of Funding: Series A/B AI Infrastructure + Document Intelligence...  ...infrastructure and production ML systems The company... 
    Senior
    Work at office
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    San Francisco, CA
    3 days ago
  •  ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team...  ..., and build the platform and infrastructure that makes state‑of‑the‑art document...  ...You'll work closely with our ML engineers to serve in‑house... 
    Senior
    Work at office
    Local area

    SupportFinity

    San Francisco, CA
    5 days ago
  •  ...Discord safe for all users. We provide the infrastructure and services that enable scalable and...  ...on Discord. We're looking for a Senior Software Engineer who is capable of handling ambiguous,...  ...Collaborate with Trust & Safety, ML, and product teams to understand requirements... 
    Senior
    Work at office
    Relocation package
    2 days per week

    EngineersOfAI

    San Francisco, CA
    5 days ago
  •  ...team that ships hardware‑software systems into customer facilities...  ...‑backed team of robotics, ML, and operations engineers building the foundation...  ...to be rock‑solid. As a Senior Software Engineer on the Robotics...  ...Full‑stack or cloud infrastructure experience (monitoring, logging... 
    Senior
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    3 days ago
  •  ...and guidance to teams across engineering, product, and business and...  ...the data and machine learning infrastructure to enable Plaid engineers to...  ...projects such as improving ML development golden paths, implementing...  ...~5+ years of software engineering experience  ~ Extensive... 
    Senior

    Plaid

    San Francisco, CA
    more than 2 months ago
  •  ...team. About the role We are hiring a Senior Software Engineer to own the data platform that powers...  ...experience building backend or data infrastructure in production Deep expertise in relational...  ...consume structured data, not pure ML research Comfort in customer‑facing technical... 
    Senior
    Work at office
    Flexible hours
    2 days per week

    Plenful

    San Francisco, CA
    5 days ago
  • $220k - $265k

     ...Position: We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of...  ...for small businesses. As a Senior Software Engineer, you’ll be responsible...  ...that power internal dashboards, ML models, and customer-facing products... 
    Senior
    Work from home
    Flexible hours

    Parafin Inc

    San Francisco, CA
    4 days ago
  • $180k - $220k

     ...traction, and building out its founding engineering team. Founded 2025 · 11–50 people · Industry: AI research / data infrastructure The Role As a Senior Software Engineer, Infrastructure and...  ...infrastructure, LLM evaluation systems, or ML pipelines Experience working at... 
    Senior
    Full time
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    10 days ago
  •  ...design teams for Google Workspace.  What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building...  ...leverage distributed databases, retrieval systems, and ML models. Develop and maintain core data serving abstractions... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    21 days ago
  • $190k - $221k

     ...Senior Software Engineer, Infrastructure TRM Labs is a blockchain intelligence company committed to fighting crime and creating a safer world. By leveraging blockchain data, threat intelligence, and advanced analytics, our products empower governments, financial institutions... 
    Senior
    Remote work

    TRM Labs

    San Francisco, CA
    3 days ago
  • $170k - $220k

     ...About Sift Sift is the data infrastructure platform for hardware engineering teams. Sift turns high-frequency telemetry into engineering insights for...  ...growing platform and customer base. Collaborate with software engineers to optimize application performance and... 
    Senior
    Work at office
    Relocation

    Sift Science

    San Francisco, CA
    2 days ago
  • $280k

     ...About the role: Anthropic is seeking talented and experienced Infrastructure Engineers to join our team and support the development, scaling, and...  ...design tradeoffs, keeping track of rapidly evolving software systems Deadline to apply: None. Applications will be reviewed... 
    Senior
    Work at office
    Home office
    Visa sponsorship
    Relocation package

    Anthropic

    San Francisco, CA
    4 days ago
  • $155k - $216k

     ...CA, but you can visit us at clever.com anytime. The Infrastructure team handles platform engineering at Clever. It builds and evolves the internal developer...  .... What We're Looking For 4+ years of experience as a Software Engineer including backend work Experience with... 
    Senior
    Work at office
    Worldwide
    Flexible hours
    Shift work

    Clever

    San Francisco, CA
    3 days ago
  •  ...drive toward a sustainable future. About the Role The Infrastructure Engineering team is crucial to the overall success of Hayden products:...  ...Engineering Standards: Establish and enforce elite software engineering and DevOps standards, including rigorous practices... 
    Senior
    Shift work

    Hayden AI

    San Francisco, CA
    4 days ago
  •  ...Join to apply for the Founding DevOps Engineer role at Retell AI Join to apply for the...  .../Azure/GCP and coordinate with on-prem infrastructure teams; standardize with IaC (e.g., Terraform...  ...that redefine AI-driven communication. Seniority level Seniority level Mid-Senior level... 
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Visa sponsorship
    Flexible hours

    Retell AI

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!