Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

Arena AI

Senior Software Engineer (ML Infrastructure)

Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world's most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.

You'll
  • Architect and scale high-performance, real-time API and data systems
  • Design and implement low-latency pipelines to process and analyze large-scale event streams
  • Ensure reliability through robust data integrity, availability, and consistency mechanisms
  • Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
  • Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems
You'll have
  • 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
  • Deep expertise in distributed systems, stream processing, and scalable backend architecture
  • Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
  • Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
  • Comfortable in a dynamic, high-ownership, fast-growth environment
  • Prior experience with PyTorch model development is a plus.
What We Offer
  • Competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.
  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
  • The opportunity to work on cutting-edge AI with a small, mission-driven team
  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  • $209k - $235k

    The Role We're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by the nature of energy markets: forecasts and trading decisions run on tight... 
    Senior
    Full time
    Home office
    Flexible hours

    Gridmatic Inc

    San Francisco, CA
    1 day ago
  • $140k - $225k

     ...assembling a diverse, world-class team—engineers, designers, researchers, and...  .... About The Role As the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role...  ...a plus Familiarity with ML Usage. Some familiarity with how... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    8 hours ago
  • $200k - $250k

     ...Francisco FiDi office. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at...  ...with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure operations... 
    Senior
    Work at office
    Immediate start
    3 days per week

    Altruist

    San Francisco, CA
    3 days ago
  • $213k - $263k

     ...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the...  ...set of sensors, enabling software engineers like you to develop multi-modal models and...  ...building, integrating, debugging and evaluating ML-based systems We prefer: MS or... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    8 hours ago
  • $230k - $265k

     ...business has the financial tools they need. About The Position We’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly... 
    Senior
    Full time
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    8 hours ago
  •  ...decarbonize their business. We’re looking for software engineers to help build the AI platform that...  ...you will: Design and build the agent infrastructure that powers Watershed's products...  ...experience in backend, platform, or AI/ML engineering Experience building products... 
    Senior
    Work at office
    Remote work

    WaterSHED

    San Francisco, CA
    4 days ago
  • $176k - $220k

     ...institutions Work together with engineers, scientists, operators, and more...  ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI...  ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team.... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    27 days ago
  • $220k - $300k

     ...AI foundation: the model layer and agent infrastructure that determine the quality of work our...  ...Representative Projects Context Engineering & Agent Infrastructure. Build the platform...  ..., with at least 1+ year focused on AI/ML engineering. Staff candidates will typically... 
    Senior

    Harvey

    San Francisco, CA
    2 days ago
  • $220k - $300k

     ...the best product managers, software, and hardware talent at innovative...  ...to help them hire. Senior Software Engineer, Platform Location: San...  ...of Funding: Series A/B AI Infrastructure + Document Intelligence...  ...infrastructure and production ML systems The company... 
    Senior
    Work at office
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    San Francisco, CA
    4 days ago
  • $127k - $223k

     ...realistic closed-loop simulation engine built with the latest in...  ...will… - Develop the tooling, infrastructure, and pipelines to support complex...  ...programming and strong software engineering fundamentals with...  ...Experience in evaluating complex ML models or self-driving... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    13 days ago
  •  ...Senior Software Engineer, Developer Platform Houston, TX or San Francisco Bay Area Company Introduction At Bot Auto,...  ...retries, and resource optimization. Partner with ML, simulation, data, and infrastructure teams to understand workload requirements and deliver... 
    Senior
    Temporary work

    Bot Auto

    San Francisco, CA
    3 days ago
  •  ...and builds the shared infrastructure that helps DoorDash, Wolt...  ...serving and inference engines, fine-tuning and...  ...This role is ideal for a senior engineer who enjoys owning...  ...technical bar for — ML engineers, product...  ...industry experience in software engineeringDeep backend... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  • $180k - $250k

     ...obsessed team of the world’s best engineers and operators. If you are...  ...We are looking for a Senior Software Engineer to join our Robotics...  ...Collaborate with robotics, ML, and product teams to define...  ...multi-agent systems, cloud infrastructures, internal tooling, and robot... 
    Senior
    Full time
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    8 hours ago
  •  ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team...  ..., and build the platform and infrastructure that makes state‑of‑the‑art document...  ...You'll work closely with our ML engineers to serve in‑house... 
    Senior
    Work at office
    Local area

    SupportFinity

    San Francisco, CA
    1 day ago
  • $250k - $350k

     ...people (Series A) · Industry: AI / Data The Role As a Senior Software Engineer, Infrastructure and Platform, you'll design and build the core...  ...Experience with AI infrastructure, LLM evaluation systems, or ML pipelines Experience at high-growth startups or scaling... 
    Senior
    Full time
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    26 days ago
  •  ...systems that power our products, enable our engineers, and keep our platform infrastructure reliable as we grow. As a Senior Software Engineer on the Platform Team, you will own...  ...projects across Compa's products, systems, AI/ML, and data warehouse. Join us and help design... 
    Senior

    COMPA

    San Francisco, CA
    1 day ago
  • $180k - $250k

    About the Role We are looking for a Senior Software Engineer to join our Robotics organization, focused...  ...Collaborate with robotics, ML, and product teams to define requirements...  ...between our multi‑agent systems, cloud infrastructures, internal tooling, and robot‑facing interfaces... 
    Senior
    Local area
    Flexible hours

    Nimblerobotics

    San Francisco, CA
    4 days ago
  •  ...Discord safe for all users. We provide the infrastructure and services that enable scalable and...  ...on Discord. We're looking for a Senior Software Engineer who is capable of handling ambiguous,...  ...Collaborate with Trust & Safety, ML, and product teams to understand requirements... 
    Senior
    Work at office
    Relocation package
    2 days per week

    EngineersOfAI

    San Francisco, CA
    2 days ago
  •  ...expanded into a horizontal automation engine adopted by HR, Finance, Legal, Security...  ...automate employee onboarding/offboarding, software access management, and the long tail of...  ...enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational... 
    Senior
    Full time

    Serval

    San Francisco, CA
    8 hours ago
  • $170k - $220k

     ...tested, and operated. Our platform gives engineers real-time observability over high-...  ...ensuring mission reliability demanded new infrastructure. Founded by a team from SpaceX, Google,...  ...and customer base. Collaborate with software engineers to optimize application performance... 
    Senior
    Full time
    Relocation

    Sift Stack

    San Francisco, CA
    8 hours ago
  • $230k - $265k

     ...where every small business has the financial tools they need. About the Position We're seeking an experienced software engineer to join our Infrastructure team and help build the foundation for our rapidly growing financial technology platform. The Infrastructure... 
    Senior
    Full time
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    8 hours ago
  • $130k - $175k

     ...enable and empower Kiddom’s engineering by building a scalable and sustainable...  ...services. Practicing Infrastructure as Code (IaC) wherever...  ...field ~5+ years professional software engineering experience ~...  ...geography, past experience, seniority, and demonstrated role... 
    Senior
    Permanent employment
    Full time
    Work at office
    Local area
    Remote work

    Kiddom

    San Francisco, CA
    8 hours ago
  •  ...team that ships hardware‑software systems into customer facilities...  ...‑backed team of robotics, ML, and operations engineers building the foundation...  ...to be rock‑solid. As a Senior Software Engineer on the Robotics...  ...Full‑stack or cloud infrastructure experience (monitoring, logging... 
    Senior
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    4 days ago
  •  ...team. About the role We are hiring a Senior Software Engineer to own the data platform that powers...  ...experience building backend or data infrastructure in production Deep expertise in relational...  ...consume structured data, not pure ML research Comfort in customer‑facing... 
    Senior
    Work at office
    Flexible hours
    2 days per week

    Plenful

    San Francisco, CA
    2 days ago
  •  ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning...  ...of AI. The Role As a Software Engineer on our...  ...Points Experience with AI/ML workloads and infrastructure.... 
    Full time
    Work at office
    Work from home
    1 day per week

    Runloop

    San Francisco, CA
    8 hours ago
  •  ...hardware caching  Much more! About the Role As an engineer within Fleet infrastructure, you will design, write, deploy, and operate infrastructure...  ...requirements As a bonus, have an understanding of AI/ML workloads About OpenAI OpenAI is an AI research... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    8 hours ago
  • $215k - $265k

     ...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of...  .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,...  ...or building platforms that support AI/ML workflows Familiarity with GPU workloads... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    Apollo Research

    San Francisco, CA
    8 hours ago
  •  ...applied AI research, flexible infrastructure, and seamless developer tooling...  ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Software Engineer at on the Training Infrastructure...  ...systems for our ML training platform (e.g. scheduling... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    8 hours ago
  •  ...Background Specter is creating a software-defined "control plane" for the physical...  ...will ultimately become the perception engine for a company's physical footprint, enabling...  ...Specter is hiring an ML infrastructure engineer to build and scale the machine... 
    Full time

    Specter

    San Francisco, CA
    8 hours ago
  • $145.4k - $188.1k

     ...the Machine Learning Infrastructure Team At Thumbtack,...  ...detection, and more. The ML Infrastructure team is...  .... We empower product engineering teams by providing scalable...  ...The challenge As a Software Engineer on the ML...  .... Partner with senior engineers to evaluate... 
    Full time
    Seasonal work
    Local area

    Thumbtack

    San Francisco, CA
    8 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!