Senior Software Engineer, ML Infrastructure
LMArena
Senior Software Engineer, ML Infrastructure Posted 2 days ago. Be among the first 25 applicants. Get AI‑powered advice on this job and more exclusive features. About LMArena: LMArena is the open platform for evaluating how AI models perform in the real world. Created by researchers from UC Berkeley’s SkyLab, our mission is to measure and advance the frontier of AI for real‑world use. Millions of people use LMArena each month to explore how frontier systems perform — and we use our community’s feedback to build transparent, rigorous, and human‑centered model evaluations. Leading enterprises and AI labs rely on our evaluations to understand real‑world reliability, alignment, and impact. Our leaderboards are the gold standard for AI performance — trusted by leaders across the AI community and shaping the global conversation on model reliability and progress. We’re a team of researchers, engineers, academics, and builders from places like UC Berkeley, Google, Stanford, DeepMind, and Discord. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We’re building a company where thoughtful, curious people from all backgrounds can do their best work. Everyone on our team is a deep expert in their field — our office radiates excellence, energy, and focus. About the Role: LMArena is seeking a Senior Software Engineer (Infrastructure) to lead the design and development of scalable, high‑performance real‑time data and API infrastructure. In this role, you’ll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world’s most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast‑moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real‑world use cases. Responsibilities Architect and scale high‑performance, real‑time API and data systems Design and implement low‑latency pipelines to process and analyze large‑scale event streams Ensure reliability through robust data integrity, availability, and consistency mechanisms Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning Collaborate cross‑functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems Qualifications 5+ years of experience in software engineering, with a focus on infrastructure or large‑scale data and ML systems Deep expertise in distributed systems, stream processing, and scalable backend architecture Proven ability to design and operate low‑latency, high‑throughput, and fault‑tolerant systems Strong foundation in systems design, performance tuning, and building reliable, fault‑tolerant services Comfortable in a dynamic, high‑ownership, fast‑growth environment What We Offer Competitive compensation and equity aligned to the markets where our team members are based. Base salary depends on candidate’s permanent work location. Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs. The opportunity to work on cutting‑edge AI with a small, mission‑driven team. A culture that values transparency, trust, and community impact. Come help build the space where anyone can explore and help shape the future of AI. LMArena provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities. Seniority level Mid‑Senior level Employment type Full‑time Job function Engineering and Information Technology Industries Research Services #J-18808-Ljbffr
- ...progress. We’re a team of researchers, engineers, academics, and builders from places... ...Arena Intelligence is seeking a Senior Software Engineer (Infrastructure) to lead the design and development... ...infrastructure or large-scale data and ML systems Deep expertise in...SeniorPermanent employmentWork at office
$200k - $240k
...workflow compliance, process efficiency. Every new use case runs through the perception team. We’re hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You’ll build systems that let our applied ML team train...SeniorWork at officeFlexible hours$200k - $250k
...Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you will design and build new infrastructure systems while scaling and strengthening... ...Nice to Have Experience building infrastructure for AI/ML workloads or high‑throughput inference systems...SeniorInternshipWorldwideRelocation package$149k - $186k
We are looking for brilliant software engineers who have a passion for consumer products and want... ...systems, and/or machine learning infrastructure, with an understanding of the complexities... ...with operational tooling for ML services (monitoring, alerting, etc),...SeniorFull timeWork at office$180k - $270k
...and guidance to teams across engineering, product, and business and... ...the data and machine learning infrastructure to enable Plaid engineers to... ...projects such as improving ML development golden paths, implementing... ...Qualifications 5+ years of software engineering experience...SeniorWork experience placementLocal area$200k - $400k
...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences... ...the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner...SeniorFull timeWork at officeLocal area$186.07k - $218.9k
...Senior Software Engineer, Developer Infrastructure What you’ll be doing (job duties) Design, build, and operate core developer‑infrastructure services — spanning CI and build systems, deployment orchestration, and test infrastructure — that are fast, reliable, and secure...SeniorLocal areaRemote work- ...financial data network. The Machine Learning Infrastructure team sits at the center of this... ..., and establishing a standardized ML Ops “golden path.” Our mission is to... ...powered financial experiences. As a Senior Software Engineer on the Machine Learning Infrastructure...SeniorShift work
- ...decarbonize their business. We’re looking for software engineers to help build the AI platform that... ...you will: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering Experience building products...SeniorWork at officeRemote work
$176k - $220k
...institutions Work together with engineers, scientists, operators, and more... ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI... ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team....SeniorFull timeWork at officeRemote workFlexible hours- ...Your Role: Senior Software Engineer - Agentic AI Platform Tenable is building a world‑class engineering... ...with control. Bridge AI & Enterprise Infrastructure: Create the integration layer between... ...skills in Python (essential for AI/ML ecosystems) with experience in, or a...SeniorLive inWork from homeRelocation
- ...systems that power our products, enable our engineers, and keep our platform infrastructure reliable as we grow. As a Senior Software Engineer on the Platform Team, you will own... ...projects across Compa's products, systems, AI/ML, and data warehouse. Join us and help design...Senior
$200k - $350k
...About the Role Join a well-funded AI/ML data analytics startup building an agentic... ...from messy enterprise data. As a Senior Software Engineer, Platform , you'll be a core member... ...engineering resources. Contribute across infrastructure, services, and frontend as the team...SeniorWork at officeRemote workVisa sponsorship$200k - $250k
...and ship category-defining software that enables Ryder and its... ...creating impact for the engine of the American economy, you... ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning... ...in distributed systems and ML operations to enhance our...SeniorFull timeWork at officeImmediate startRemote workMonday to Friday$127k - $223k
...realistic closed-loop simulation engine built with the latest in... ...will… - Develop the tooling, infrastructure, and pipelines to support complex... ...programming and strong software engineering fundamentals with... ...Experience in evaluating complex ML models or self-driving...SeniorFull timeWork at officeWork from homeFlexible hours$220k - $300k
...the best product managers, software, and hardware talent at innovative... ...to help them hire. Senior Software Engineer, Platform Location: San... ...of Funding: Series A/B AI Infrastructure + Document Intelligence... ...infrastructure and production ML systems The company...SeniorWork at officeRemote workVisa sponsorship- ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team... ..., and build the platform and infrastructure that makes state‑of‑the‑art document... ...You'll work closely with our ML engineers to serve in‑house...SeniorWork at officeLocal area
- ...Discord safe for all users. We provide the infrastructure and services that enable scalable and... ...on Discord. We're looking for a Senior Software Engineer who is capable of handling ambiguous,... ...Collaborate with Trust & Safety, ML, and product teams to understand requirements...SeniorWork at officeRelocation package2 days per week
- ...team that ships hardware‑software systems into customer facilities... ...‑backed team of robotics, ML, and operations engineers building the foundation... ...to be rock‑solid. As a Senior Software Engineer on the Robotics... ...Full‑stack or cloud infrastructure experience (monitoring, logging...SeniorFlexible hours
- ...and guidance to teams across engineering, product, and business and... ...the data and machine learning infrastructure to enable Plaid engineers to... ...projects such as improving ML development golden paths, implementing... ...~5+ years of software engineering experience ~ Extensive...Senior
- ...team. About the role We are hiring a Senior Software Engineer to own the data platform that powers... ...experience building backend or data infrastructure in production Deep expertise in relational... ...consume structured data, not pure ML research Comfort in customer‑facing technical...SeniorWork at officeFlexible hours2 days per week
$220k - $265k
...Position: We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of... ...for small businesses. As a Senior Software Engineer, you’ll be responsible... ...that power internal dashboards, ML models, and customer-facing products...SeniorWork from homeFlexible hours$180k - $220k
...traction, and building out its founding engineering team. Founded 2025 · 11–50 people · Industry: AI research / data infrastructure The Role As a Senior Software Engineer, Infrastructure and... ...infrastructure, LLM evaluation systems, or ML pipelines Experience working at...SeniorFull timeVisa sponsorship- ...design teams for Google Workspace. What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building... ...leverage distributed databases, retrieval systems, and ML models. Develop and maintain core data serving abstractions...Full timeFlexible hours
$190k - $221k
...Senior Software Engineer, Infrastructure TRM Labs is a blockchain intelligence company committed to fighting crime and creating a safer world. By leveraging blockchain data, threat intelligence, and advanced analytics, our products empower governments, financial institutions...SeniorRemote work$170k - $220k
...About Sift Sift is the data infrastructure platform for hardware engineering teams. Sift turns high-frequency telemetry into engineering insights for... ...growing platform and customer base. Collaborate with software engineers to optimize application performance and...SeniorWork at officeRelocation$280k
...About the role: Anthropic is seeking talented and experienced Infrastructure Engineers to join our team and support the development, scaling, and... ...design tradeoffs, keeping track of rapidly evolving software systems Deadline to apply: None. Applications will be reviewed...SeniorWork at officeHome officeVisa sponsorshipRelocation package$155k - $216k
...CA, but you can visit us at clever.com anytime. The Infrastructure team handles platform engineering at Clever. It builds and evolves the internal developer... .... What We're Looking For 4+ years of experience as a Software Engineer including backend work Experience with...SeniorWork at officeWorldwideFlexible hoursShift work- ...drive toward a sustainable future. About the Role The Infrastructure Engineering team is crucial to the overall success of Hayden products:... ...Engineering Standards: Establish and enforce elite software engineering and DevOps standards, including rigorous practices...SeniorShift work
- ...Join to apply for the Founding DevOps Engineer role at Retell AI Join to apply for the... .../Azure/GCP and coordinate with on-prem infrastructure teams; standardize with IaC (e.g., Terraform... ...that redefine AI-driven communication. Seniority level Seniority level Mid-Senior level...SeniorFull timeWork at officeLocal areaWork from homeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!
- ngo software engineer San Francisco, CA
- software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- junior software developer San Francisco, CA
- part time software developer remote San Francisco, CA
- financial software developer San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software engineer amazon San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer part time San Francisco, CA


