Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

Arena AI

Senior Software Engineer (ML Infrastructure)Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world's most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.You'llArchitect and scale high-performance, real-time API and data systemsDesign and implement low-latency pipelines to process and analyze large-scale event streamsEnsure reliability through robust data integrity, availability, and consistency mechanismsMentor and guide engineers on infrastructure best practices, architecture, and performance tuningCollaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systemsYou'll have5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systemsDeep expertise in distributed systems, stream processing, and scalable backend architectureProven ability to design and operate low-latency, high-throughput, and fault-tolerant systemsStrong foundation in systems design, performance tuning, and building reliable, fault-tolerant servicesComfortable in a dynamic, high-ownership, fast-growth environmentPrior experience with PyTorch model development is a plus.What We OfferCompetitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.The opportunity to work on cutting-edge AI with a small, mission-driven teamA culture that values transparency, trust, and community impactCome help build the space where anyone can explore and help shape the future of AI.Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  • $140k - $225k

     ...assembling a diverse, world-class team—engineers, designers, researchers, and...  ...best work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role...  ...electronics a plusFamiliarity with ML Usage. Some familiarity with how... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    2 days ago
  •  ...and builds the shared infrastructure that helps DoorDash, Wolt...  ...serving and inference engines, fine-tuning and...  ...This role is ideal for a senior engineer who enjoys owning...  ...technical bar for — ML engineers, product...  ...industry experience in software engineeringDeep backend... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  •  ...Senior Software Engineer - InfrastructureAs a Senior Software Engineer - Infrastructure at AfterQuery, you will design and build the core infrastructure that powers our data generation...  ...infrastructure, LLM evaluation systems, or ML pipelinesExperience working at high-growth... 
    Senior

    afterquery

    San Francisco, CA
    3 days ago
  •  ...Software EngineerVoxel's perception system is the technical core of everything we ship. Our models detect human activity...  ...the perception team.We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You... 
    Senior
    Work at office
    Flexible hours

    Voxel

    San Francisco, CA
    2 days ago
  • $176k - $220k

     ...institutions Work together with engineers, scientists, operators, and more...  ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI...  ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team.... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...customers' own locked-down environments) is an infrastructure problem, and that's the problem this...  ..., Kubernetes, and networking that let engineers ship without becoming infrastructure...  ...Experience operating latency-sensitive or ML/AI-serving workloads in production.Experience... 
    Senior
    Full time
    Work at office
    Local area
    Shift work

    Decagon

    San Francisco, CA
    3 days ago
  • $150k - $250k

     ...founding member of our engineering team, you will have a...  ...just “models.” It’s the software layer that turns:...  ...engineering. It is for senior software engineers who...  ...the backend systems and infrastructure that power the factory...  ...factory floor and cloud ML Infrastructure & Data... 
    Senior
    Full time
    Contract work

    Foundry Robotics

    San Francisco, CA
    3 days ago
  • Handshake is hiring a Senior Software Engineer for the Coding Pod in San Francisco. You will lead the design and development of data infrastructure powering frontier AI coding models, building large...  ...platform investments, partner with ML researchers, and translate research... 
    Senior

    Apply

    San Francisco, CA
    3 days ago
  • $160k - $230k

    Senior Software Engineer - Together Cloud Infrastructure Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle...  ...cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables... 
    Senior
    Full time
    Work at office
    Remote work

    Together AI

    San Francisco, CA
    4 days ago
  • $174k - $252k

     ...one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise...  ...maintaining, or launching software products, and 1 year of...  ...technologies.Google's software engineers develop the next-...  ...technology forward.As a Senior Software Engineer for ML... 
    Senior

    Google

    San Bruno, CA
    3 days ago
  •  ...every small business has the financial tools they need.About The PositionWe’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly... 
    Senior
    Flexible hours

    Parafin

    San Francisco, CA
    2 days ago
  • $148.5k - $223.9k

     ...re looking for an experienced and hands-on software engineer to join our team to build and scale the next generation of infrastructure management service and operation solutions....  ...Apply AI and Machine Learning: Leverage AI/ML models for intelligent data analysis, anomaly... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    4 days ago
  •  ...patients worldwide.We’re a team of engineers, clinicians, and innovators...  ...DescriptionPrimary Function of PositionAs a Senior Software Engineer - Simulation & ML Platform, you will build software...  ...and maintain software infrastructure for robotic simulations & ML using... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    1 day ago
  • $187k

     ...Platform (MLP) team builds and operates the infrastructure, tooling, and developer experience...  .... We enable data scientists and ML engineers to develop, train, deploy, and monitor...  ...processingStrong foundation in computer science and software engineering principlesDeeply... 
    Senior
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    2 days ago
  •  ...reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant...  ...-tenant scheduling, and end-user tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will set the technical direction for... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  •  ...sits at the center of Pave Engineering, bridging product and platform...  ...to ship enterprise-grade software with speed and confidence. In...  ...well as the foundational data infrastructure and models powering Pave’s...  ...pipelines/ ETLs, data modeling; ML/AI platform experience a... 
    Senior
    3 days per week

    Trove Information Technologies

    San Francisco, CA
    2 days ago
  •  ...Software EngineerWatershed is building the AI suite for companies...  .... We're looking for software engineers to help build the AI platform...  ...will:Design and build the agent infrastructure that powers Watershed's...  ...in backend, platform, or AI/ML engineeringExperience building... 
    Senior
    Work at office
    Remote work

    WaterSHED

    San Francisco, CA
    4 days ago
  • Foundry Robotics is hiring a Senior Software Engineer (IC) to build the backend systems and infrastructure powering the factory of the future. You will design and implement cloud-based backend systems, on‑prem factory services, and data flows across embedded to cloud environments... 
    Senior

    Foundry Robotics

    San Francisco, CA
    3 days ago
  •  ...Senior Software Engineer, Developer PlatformHouston, TX or San Francisco Bay AreaCompany IntroductionAt Bot Auto, we are revolutionizing...  ..., retries, and resource optimization.Partner with ML, simulation, data, and infrastructure teams to understand workload requirements and... 
    Senior
    Temporary work

    Bot Auto

    San Francisco, CA
    3 days ago
  • Cruise LLC in San Francisco is seeking an experienced Senior Software Engineer to join our Machine Learning Orchestration team. This role involves building scalable infrastructure and automation tools to support self-driving technology. The ideal candidate will have over... 
    Senior

    Cruise LLC

    San Francisco, CA
    2 days ago
  • Scale is seeking a Senior Software Engineer in San Francisco to lead backend design for federal customers, orchestrate asynchronous agent...  ...requirements. You will own stakeholder communication and drive ML infrastructure improvements for scalable, secure systems. The role... 
    Senior

    Scale

    San Francisco, CA
    5 days ago
  •  ...Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of...  ...for small businesses.As a Senior Software Engineer, you’ll be responsible...  ...models that power internal dashboards, ML models, and customer-facing... 
    Senior
    Flexible hours

    Parafin

    San Francisco, CA
    2 days ago
  • Hayden AI Technologies, Inc. is looking for a Senior Software Engineer to join their Platform - Cloud Events team in San Francisco. The role focuses on optimizing cloud-based ML operations, improving architecture, and collaborating with multiple teams. Candidates should... 
    Senior
    Work at office
    3 days per week

    Hayden AI Technologies, Inc.

    San Francisco, CA
    1 day ago
  •  ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team...  ..., and build the platform and infrastructure that makes state‑of‑the‑art document...  ...You'll work closely with our ML engineers to serve in‑house... 
    Senior
    Work at office
    Local area

    SupportFinity

    San Francisco, CA
    1 day ago
  • $194k - $239k

     ...Hover Infrastructure EngineerHover helps people design, improve...  ...by whether the engineers using it move faster,...  ...Infrastructure here is a software engineering problem. We...  ...team. This role is the senior technical partner to...  ...with backend, frontend, ML, CV, data, and... 
    Senior
    Full time
    For contractors
    Work at office
    Local area
    Flexible hours

    Almaz Capital

    San Francisco, CA
    3 days ago
  • Weights & Biases is looking for a Senior Software Engineer in San Francisco to design and build a generative AI platform aimed at users, leveraging...  ...in Python or TypeScript, alongside experience with ML libraries and managing production services. You will be a key... 
    Senior
    Flexible hours

    Weights & Biases

    San Francisco, CA
    2 days ago
  • $158k - $260k

     ...our unique combination of proprietary infrastructure and software, we empower over 250,000 businesses...  ...entire company to leverage data, AI, and ML into business impact. We accomplish...  ...at a global scale. As a champion of engineering rigor, you will advocate for elite software... 
    Senior
    Temporary work
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    2 days ago
  • Discord is seeking a Senior Software Engineer for the Ads team to design and build new ad formats and infrastructure across backend and frontend. You will partner with Revenue Infrastructure, Core Tech, ML, Data Science to shape product and revenue growth. The role emphasizes... 
    Senior

    Discord

    San Francisco, CA
    3 days ago
  • An innovating tech company in San Francisco is seeking a Senior Software Engineer to lead the design and development of an AI platform. In this role...  ...like Java or Python, and a strong background in AI/ML. This position offers a unique opportunity to influence the... 
    Senior
    Work experience placement

    Jazzx Ai

    San Francisco, CA
    2 days ago
  •  ...Discord safe for all users. We provide the infrastructure and services that enable scalable and...  ...on Discord. We're looking for a Senior Software Engineer who is capable of handling ambiguous,...  ...Collaborate with Trust & Safety, ML, and product teams to understand requirements... 
    Senior
    Work at office
    Relocation package
    2 days per week

    EngineersOfAI

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!