Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

Arena AI

Senior Software Engineer (ML Infrastructure)

Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world's most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.

You'll
  • Architect and scale high-performance, real-time API and data systems
  • Design and implement low-latency pipelines to process and analyze large-scale event streams
  • Ensure reliability through robust data integrity, availability, and consistency mechanisms
  • Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
  • Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems
You'll have
  • 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
  • Deep expertise in distributed systems, stream processing, and scalable backend architecture
  • Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
  • Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
  • Comfortable in a dynamic, high-ownership, fast-growth environment
  • Prior experience with PyTorch model development is a plus.
What We Offer
  • Competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.
  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
  • The opportunity to work on cutting-edge AI with a small, mission-driven team
  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  • $140k - $225k

     ...assembling a diverse, world-class team—engineers, designers, researchers, and...  ...best work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role...  ...electronics a plusFamiliarity with ML Usage. Some familiarity with how... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    3 hours ago
  •  ...and builds the shared infrastructure that helps DoorDash, Wolt...  ...serving and inference engines, fine-tuning and...  ...This role is ideal for a senior engineer who enjoys owning...  ...technical bar for — ML engineers, product...  ...industry experience in software engineeringDeep backend... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago
  • $193.93k - $291.15k

     ...Senior Software Engineer, ML Infrastructure Mountain View, California (HQ) Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    San Francisco, CA
    4 days ago
  •  ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple... 
    Senior
    Work at office
    Flexible hours

    Voxel Labs

    San Francisco, CA
    11 hours ago
  • $200k - $250k

     ...we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in designing...  ...Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background... 
    Senior
    Internship
    Relocation package

    Harvey

    San Francisco, CA
    4 days ago
  • $137.1k - $299.3k

     ...and builds the shared infrastructure that helps DoorDash, Wolt...  ...serving and inference engines, fine-tuning and...  ...This role is ideal for a senior engineer who enjoys owning...  ...technical bar for — ML engineers, product...  ...industry experience in software engineering ~ Deep... 
    Senior
    Hourly pay
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    DoorDash USA

    San Francisco, CA
    3 days ago
  • Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform...  ...non-engineers to build and manage data and ML pipelines. Establish monitoring,... 
    Senior
    Work at office
    3 days per week

    Claryo

    San Francisco, CA
    3 days ago
  • $176k - $220k

     ...institutions Work together with engineers, scientists, operators, and more...  ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI...  ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team.... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    6 days ago
  • $200k - $250k

     ...Francisco FiDi office. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at...  ...with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure operations... 
    Senior
    Work at office
    Immediate start
    3 days per week

    Altruist

    San Francisco, CA
    11 hours ago
  •  ...decarbonize their business. We're looking for software engineers to help build the AI platform that...  ...: Design and build the agent infrastructure that powers Watershed's products...  ...experience in backend, platform, or AI/ML engineering ~ Experience building products... 
    Senior
    Full time
    Work at office
    Remote work

    Watershed

    San Francisco, CA
    1 day ago
  • $213k - $263k

     ...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the...  ...set of sensors, enabling software engineers like you to develop multi-modal models and...  ...building, integrating, debugging and evaluating ML-based systems We prefer: MS or... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $160k - $230k

     ...combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play...  ...that virtualizes cutting-edge ML hardware (GB200s/GB300s,...  ...well-tested, and maintainable software and IaC for both new and existing... 
    Senior
    Full time
    Remote work

    Together Ai

    San Francisco, CA
    1 day ago
  • $250k - $330k

     ...a team. About the Team The Infrastructure team builds and operates the foundations...  ...power Decagon: networking, data, ML serving, developer platform, and real...  ...About the Role We’re looking for a Senior Software Engineer to help build and evolve our... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago
  •  ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of...  ...Tuesday. About the Role As a Senior Software Engineer on Lambda’s Core Cloud Platform team,...  ...Kubernetes, Slurm, or large-scale AI/ML infrastructure. Experience with... 
    Senior
    Full time
    Work experience placement
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    1 day ago
  •  ...every small business has the financial tools they need.About The PositionWe’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly... 
    Senior
    Flexible hours

    Parafin

    San Francisco, CA
    3 hours ago
  • $148.5k - $223.9k

     ...re looking for an experienced and hands-on software engineer to join our team to build and scale the next generation of infrastructure management service and operation solutions....  ...Apply AI and Machine Learning: Leverage AI/ML models for intelligent data analysis, anomaly... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    2 days ago
  •  ...patients worldwide.We’re a team of engineers, clinicians, and innovators...  ...DescriptionPrimary Function of PositionAs a Senior Software Engineer - Simulation & ML Platform, you will build software...  ...and maintain software infrastructure for robotic simulations & ML using... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    49 minutes ago
  •  ...reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant...  ...-tenant scheduling, and end-user tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will set the technical direction for... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago
  •  ...sits at the center of Pave Engineering, bridging product and platform...  ...to ship enterprise-grade software with speed and confidence. In...  ...well as the foundational data infrastructure and models powering Pave’s...  ...pipelines/ ETLs, data modeling; ML/AI platform experience a... 
    Senior
    3 days per week

    Trove Information Technologies

    San Francisco, CA
    3 hours ago
  • $180k - $250k

     ...obsessed team of the world’s best engineers and operators. If you are...  ...We are looking for a Senior Software Engineer to join our Robotics...  ...Collaborate with robotics, ML, and product teams to define...  ...multi-agent systems, cloud infrastructures, internal tooling, and robot... 
    Senior
    Full time
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    1 day ago
  • $220k - $300k

     ...AI foundation: the model layer and agent infrastructure that determine the quality of work our...  ...Representative Projects Context Engineering & Agent Infrastructure. Build the platform...  ..., with at least 1+ year focused on AI/ML engineering. Staff candidates will typically... 
    Senior

    Harvey

    San Francisco, CA
    5 days ago
  • Foundry Robotics is hiring a Senior Software Engineer (IC) to build the backend systems and infrastructure powering the factory of the future. You will design and implement cloud-based backend systems, on‑prem factory services, and data flows across embedded to cloud environments... 
    Senior

    Foundry Robotics

    San Francisco, CA
    1 day ago
  • $127k - $223k

     ...realistic closed-loop simulation engine built with the latest in...  ...will… - Develop the tooling, infrastructure, and pipelines to support complex...  ...programming and strong software engineering fundamentals with...  ...Experience in evaluating complex ML models or self-driving... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    11 days ago
  •  ...Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of...  ...for small businesses.As a Senior Software Engineer, you’ll be responsible...  ...models that power internal dashboards, ML models, and customer-facing... 
    Senior
    Flexible hours

    Parafin

    San Francisco, CA
    3 hours ago
  •  ...decarbonize their business. We’re looking for software engineers to help build the AI platform that...  ...you will: Design and build the agent infrastructure that powers Watershed's products...  ...experience in backend, platform, or AI/ML engineering Experience building products... 
    Senior
    Work at office
    Remote work

    Watershed

    San Francisco, CA
    3 days ago
  •  ...customers. She will pick the best candidates from Jack's network. The next step is to speak to Jack . Senior Software Engineer (Infrastructure) Company Description: Tavus - Series B AI video platform backed by Sequoia and CRV Job Description:... 
    Senior
    Full time

    Jack & Jill/external Ats

    San Francisco, CA
    1 day ago
  •  ...About the team Merge's Core Software team builds the software...  ...implement, and maintain the infrastructure that moves experimental data...  ...clinicians, neuroscientists, and ML researchers. Our mandate is...  .... About the role As our Senior Software Engineer for Platform Instrument... 
    Senior

    Merge LLC

    San Francisco, CA
    3 days ago
  • $100k - $300k

     ...Wiz, Abnormal AI, Zscaler Preeminent research labs like Deepmind and SAIL About the Role We're hiring a Senior Storage Infrastructure Engineer on our Core Platform team to own how we store, protect, and operate data at scale. You'll build the backup, observability... 
    Senior
    Full time

    Cogent Security

    San Francisco, CA
    1 day ago
  •  ...Job Description Job Description Senior Software Engineer, ML Platform Location: San Francisco, CA / Remote Flexible Employment Type...  ..., MLOps, Model Serving, Feature Stores, Underwriting Infrastructure About Our Client Our client is building financial... 
    Senior
    Full time
    Remote work
    Flexible hours

    NxT Level

    San Francisco, CA
    8 days ago
  •  ...expanded into a horizontal automation engine adopted by HR, Finance, Legal, Security...  ...automate employee onboarding/offboarding, software access management, and the long tail of...  ...enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational... 
    Senior
    Full time

    Serval

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!