Senior Software Engineer, ML Infrastructure
LMArena
Senior Software Engineer, ML Infrastructure Posted 2 days ago. Be among the first 25 applicants. Get AI‑powered advice on this job and more exclusive features. About LMArena: LMArena is the open platform for evaluating how AI models perform in the real world. Created by researchers from UC Berkeley’s SkyLab, our mission is to measure and advance the frontier of AI for real‑world use. Millions of people use LMArena each month to explore how frontier systems perform — and we use our community’s feedback to build transparent, rigorous, and human‑centered model evaluations. Leading enterprises and AI labs rely on our evaluations to understand real‑world reliability, alignment, and impact. Our leaderboards are the gold standard for AI performance — trusted by leaders across the AI community and shaping the global conversation on model reliability and progress. We’re a team of researchers, engineers, academics, and builders from places like UC Berkeley, Google, Stanford, DeepMind, and Discord. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We’re building a company where thoughtful, curious people from all backgrounds can do their best work. Everyone on our team is a deep expert in their field — our office radiates excellence, energy, and focus. About the Role: LMArena is seeking a Senior Software Engineer (Infrastructure) to lead the design and development of scalable, high‑performance real‑time data and API infrastructure. In this role, you’ll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world’s most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast‑moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real‑world use cases. Responsibilities Architect and scale high‑performance, real‑time API and data systems Design and implement low‑latency pipelines to process and analyze large‑scale event streams Ensure reliability through robust data integrity, availability, and consistency mechanisms Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning Collaborate cross‑functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems Qualifications 5+ years of experience in software engineering, with a focus on infrastructure or large‑scale data and ML systems Deep expertise in distributed systems, stream processing, and scalable backend architecture Proven ability to design and operate low‑latency, high‑throughput, and fault‑tolerant systems Strong foundation in systems design, performance tuning, and building reliable, fault‑tolerant services Comfortable in a dynamic, high‑ownership, fast‑growth environment What We Offer Competitive compensation and equity aligned to the markets where our team members are based. Base salary depends on candidate’s permanent work location. Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs. The opportunity to work on cutting‑edge AI with a small, mission‑driven team. A culture that values transparency, trust, and community impact. Come help build the space where anyone can explore and help shape the future of AI. LMArena provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities. Seniority level Mid‑Senior level Employment type Full‑time Job function Engineering and Information Technology Industries Research Services #J-18808-Ljbffr LMArena
$204k - $259k
....S. states. The Simulation ML Infrastructure team builds scalable AI/ML infrastructure... .... We seek an experienced senior IC to lead the development... .... This role reports to an Engineering Manager. You will: Be part... ...: 5+ years of professional software engineering experience, with...SeniorFull timeRemote work- ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ...The Lambda Infrastructure Engineering organization forges the... ...looking for an experienced Senior Software Engineer to join our storage... ...to Have Experience with AI/ML workloads and the unique storage...SeniorWork at officeLocal areaWork from home
- Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform... ...non-engineers to build and manage data and ML pipelines. Establish monitoring,...SeniorWork at office3 days per week
$200k - $240k
...workflow compliance, process efficiency. Every new use case runs through the perception team. We’re hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You’ll build systems that let our applied ML team train...SeniorWork at officeFlexible hours- Senior Software Engineer, Tooling and Development Infrastructure Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we... ...consumer electronics is a plus. Familiarity with ML usage - leveraging machine learning models in a...SeniorFull timeTemporary workLocal areaFlexible hours
$150k - $250k
...founding member of our engineering team, you will have a... ...just “models.” It’s the software layer that turns:... ...engineering. It is for senior software engineers who... ...the backend systems and infrastructure that power the factory... ...factory floor and cloud ML Infrastructure & Data...SeniorFull timeContract work- ...and builds the shared infrastructure that helps DoorDash, Wolt... ...serving and inference engines, fine‑tuning and... ...This role is ideal for a senior engineer who enjoys owning... ...technical bar for — ML engineers, product... ...industry experience in software engineering. Deep backend...SeniorHourly payWork at officeFlexible hours
$176k - $230k
...progress. Over the last decade, software has transformed the digital... ...scale. We are roboticists, engineers, operators, and builders. We... ...the Machine Learning and AI Infrastructure team, which is focused on providing... ...and other engineers to use ML and AI technologies...SeniorFull timeTemporary workWork at officeFlexible hours$149k - $186k
We are looking for brilliant software engineers who have a passion for consumer products and want... ...systems, and/or machine learning infrastructure, with an understanding of the complexities... ...with operational tooling for ML services (monitoring, alerting, etc),...SeniorFull timeWork at office$200k - $250k
Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you will design and build new infrastructure systems while scaling and strengthening... ...to Have Experience building infrastructure for AI/ML workloads or high‑throughput inference systems...SeniorInternshipWorldwideRelocation package- ...our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about... ...We’re building the next generation of agentic AI infrastructure at Cohere. This team sits at the intersection of ML systems, distributed infrastructure, and developer...SeniorFull timeWork at officeRemote workFlexible hours
- ...and overcoming obstacles. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at... ...expertise with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure...SeniorWork at office3 days per week
$160k - $230k
Senior Software Engineer - Together Cloud Infrastructure Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle... ...cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables...SeniorFull timeWork at officeRemote work$180k - $270k
...and guidance to teams across engineering, product, and business and... ...the data and machine learning infrastructure to enable Plaid engineers to... ...projects such as improving ML development golden paths, implementing... ...Qualifications 5+ years of software engineering experience...SeniorWork experience placementLocal area$200k - $400k
...grow as a team. About the Team The Infrastructure team builds and operates the foundations... ...power Decagon: networking, data, ML serving, developer platform, and... ...accurately. About the Role We’re hiring a Senior Data Infrastructure Engineer to design, build, and operate the...SeniorFull timeWork at officeLocal area- ...financial data network. The Machine Learning Infrastructure team sits at the center of this... ..., and establishing a standardized ML Ops “golden path.” Our mission is to... ...powered financial experiences. As a Senior Software Engineer on the Machine Learning Infrastructure...SeniorShift work
$186.07k - $218.9k
Senior Software Engineer, Developer Infrastructure What you’ll be doing (job duties) Design, build, and operate core developer‑infrastructure services — spanning CI and build systems, deployment orchestration, and test infrastructure — that are fast, reliable, and secure...SeniorLocal areaRemote work- ...decarbonize their business. We’re looking for software engineers to help build the AI platform that... ...you will: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering Experience building products...SeniorWork at officeRemote work
$176k - $220k
...institutions Work together with engineers, scientists, operators, and more... ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI... ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team....SeniorFull timeWork at officeRemote workFlexible hours- Cruise LLC in San Francisco is seeking an experienced Senior Software Engineer to join our Machine Learning Orchestration team. This role involves building scalable infrastructure and automation tools to support self-driving technology. The ideal candidate will have over...Senior
$200k - $250k
...and ship category-defining software that enables Ryder and its... ...creating impact for the engine of the American economy, you... ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning... ...in distributed systems and ML operations to enhance our...SeniorFull timeWork at officeImmediate startRemote workMonday to Friday- Hayden AI Technologies, Inc. is looking for a Senior Software Engineer to join their Platform - Cloud Events team in San Francisco. The role focuses on optimizing cloud-based ML operations, improving architecture, and collaborating with multiple teams. Candidates should...SeniorWork at office3 days per week
- Handshake is seeking a Senior Software Engineer on the Allocation & Onboarding team to own end-to-end experiences... ..., from onboarding to scalable platform infrastructure. You’ll collaborate with Growth, Product, Operations, ML, and Platform to translate evolving business...Senior
- A leading software company in San Francisco is seeking a Software Developer to drive feature implementation and improve developer productivity... ...skills are essential. Come join us to create innovative solutions in the world of design and engineering. #J-18808-Ljbffr Autodesk, Inc.Senior
- ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team... ..., and build the platform and infrastructure that makes state‑of‑the‑art document... ...You'll work closely with our ML engineers to serve in‑house...SeniorWork at officeLocal area
- Weights & Biases is looking for a Senior Software Engineer in San Francisco to design and build a generative AI platform aimed at users, leveraging... ...in Python or TypeScript, alongside experience with ML libraries and managing production services. You will be a key...SeniorFlexible hours
- An innovating tech company in San Francisco is seeking a Senior Software Engineer to lead the design and development of an AI platform. In this role... ...like Java or Python, and a strong background in AI/ML. This position offers a unique opportunity to influence the...SeniorWork experience placement
- Regional Manager, Sales Engineering - Public Sector As a Regional Manager, Sales Engineering,... ...Developer (BigCommerce Experience Required) AI/ML Headquarters: Philippines URL:... ...2018. We provide a variety of tools to… Senior Web Developer SaaS Headquarters: Remote...SeniorPart timeInternshipRemote work
- We are looking for a Senior Platform Engineer with 5+ years of experience to own and strengthen the... ...distributed systems. You'll work closely with ML engineers and take on‑call... ...pipelines Building and maintaining infrastructure including databases, task orchestration...SeniorWork experience placement
$177.9k - $257.55k
Adobe is seeking a skilled software engineer for the Kodiak team. In this role, you'll create and manage features for an enterprise-scale security scanning platform, integrating AI and skilled at backend engineering. The ideal candidate has a Bachelor's degree or equivalent...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!
- ngo software engineer San Francisco, CA
- software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- junior software developer San Francisco, CA
- part time software developer remote San Francisco, CA
- financial software developer San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software engineer amazon San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer part time San Francisco, CA

