Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Infrastructure

Arena AI

Senior Software Engineer (ML Infrastructure)

Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world's most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.

You'll
  • Architect and scale high-performance, real-time API and data systems
  • Design and implement low-latency pipelines to process and analyze large-scale event streams
  • Ensure reliability through robust data integrity, availability, and consistency mechanisms
  • Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
  • Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems
You'll have
  • 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
  • Deep expertise in distributed systems, stream processing, and scalable backend architecture
  • Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
  • Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
  • Comfortable in a dynamic, high-ownership, fast-growth environment
  • Prior experience with PyTorch model development is a plus.
What We Offer
  • Competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.
  • Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
  • The opportunity to work on cutting-edge AI with a small, mission-driven team
  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.

Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Infrastructure in San Francisco, CA vacancy
  • $200k - $280k

     ...SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE Build the core infrastructure that powers petabyte-scale data collection and delivery for the world's leading robotics...  ...TO HAVE Experience with robotics, computer vision, or ML infrastructure Background in video processing or real-... 
    Senior
    Home office

    Gerra Group

    San Francisco, CA
    3 days ago
  •  ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple... 
    Senior
    Work at office
    Flexible hours

    Voxel Labs

    San Francisco, CA
    3 days ago
  • $200k - $250k

     ...and we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in...  ...to Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background... 
    Senior
    Internship
    Relocation package

    Harvey

    San Francisco, CA
    1 day ago
  • $200k - $400k

     ...a team. About the Team The Infrastructure team builds and operates the foundations...  ...power Decagon: networking, data, ML serving, developer platform, and...  ...About the Role We're hiring a Senior Infrastructure Engineer to design, build, and operate production... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    2 days ago
  • Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform...  ...non-engineers to build and manage data and ML pipelines. Establish monitoring,... 
    Senior
    Work at office
    3 days per week

    Claryo

    San Francisco, CA
    5 days ago
  •  ...The Role Handshake is building the infrastructure layer that powers the next generation...  ...AI agents across our platform. As a Senior Software Engineer on our Agentic Infrastructure team, you...  ...engineer to build with AI Partner with ML, product, & platform engineers to... 
    Senior
    Full time
    Freelance
    Internship
    Work at office
    Remote work
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...founding member of our engineering team, you will have a...  ...just “models.” It’s the software layer that turns:...  ...engineering. It is for senior software engineers who...  ...the backend systems and infrastructure that power the factory...  ...factory floor and cloud ML Infrastructure & Data... 
    Senior
    Full time
    Contract work

    Foundry Robotics Inc.

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences...  ...the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    22 days ago
  • $250k - $330k

     ...grow as a team. About the Team The Infrastructure team builds and operates the foundations...  ...power Decagon: networking, data, ML serving, developer platform, and...  ...accurately. About the Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate... 
    Senior
    Work at office

    Decagon

    San Francisco, CA
    5 days ago
  •  ...and guidance to teams across engineering, product, and business and...  ...effectively. Engineers on Data Infrastructure are domain experts in Data...  ...projects such as improving ML development golden paths, implementing...  ...Qualifications 5+ years of software engineering experience... 
    Senior
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    5 days ago
  • $194k - $239k

     ...Senior Software Engineer, Infrastructure Hover helps people design, improve, and protect the properties they love. With proprietary AI built on over a decade of real property data, Hover answers age-old questions like “What will it look like?” and “What will it cost?”... 
    Senior
    Full time
    For contractors
    Work at office
    Local area
    Flexible hours

    HOVER Inc.

    San Francisco, CA
    4 days ago
  •  ...decarbonize their business. We’re looking for software engineers to help build the AI platform that...  ...you will: Design and build the agent infrastructure that powers Watershed's products...  ...experience in backend, platform, or AI/ML engineering Experience building products... 
    Senior
    Work at office
    Remote work

    WaterSHED

    San Francisco, CA
    4 days ago
  • $200k - $350k

     ...About the Role Join a well-funded AI/ML data analytics startup building an agentic...  ...from messy enterprise data. As a Senior Software Engineer, Platform , you'll be a core member...  ...engineering resources. Contribute across infrastructure, services, and frontend as the team... 
    Senior
    Work at office
    Remote work
    Visa sponsorship

    Clera

    San Francisco, CA
    3 days ago
  • $220k - $300k

     ...the best product managers, software, and hardware talent at innovative...  ...to help them hire. Senior Software Engineer, Platform Location: San...  ...of Funding: Series A/B AI Infrastructure + Document Intelligence...  ...infrastructure and production ML systems The company... 
    Senior
    Work at office
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    San Francisco, CA
    4 days ago
  • $220k - $300k

     ...AI foundation: the model layer and agent infrastructure that determine the quality of work our...  ...can do. REPRESENTATIVE PROJECTS - Context Engineering & Agent Infrastructure. Build the...  ...systems, with at least 1+ year focused on AI/ML engineering. Staff candidates will typically... 
    Senior

    Harvey

    San Francisco, CA
    2 days ago
  • $230k - $265k

     ...business has the financial tools they need. About The Position We're looking for a software engineer to join Parafin's Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly... 
    Senior
    Work from home
    Flexible hours

    Parafin Inc

    San Francisco, CA
    2 days ago
  •  ...financial data network. The Machine Learning Infrastructure team sits at the center of this...  ..., and establishing a standardized ML Ops “golden path.” Our mission is to...  ...powered financial experiences. As a Senior Software Engineer on the Machine Learning Infrastructure... 
    Senior
    Shift work

    Plaid

    San Francisco, CA
    more than 2 months ago
  • Hayden AI Technologies, Inc. is looking for a Senior Software Engineer to join their Platform - Cloud Events team in San Francisco. The role focuses on optimizing cloud-based ML operations, improving architecture, and collaborating with multiple teams. Candidates should... 
    Senior
    Work at office
    3 days per week

    Hayden AI Technologies, Inc.

    San Francisco, CA
    1 day ago
  • A leading software company in San Francisco is seeking a Software Developer to drive feature implementation and improve developer productivity...  ...skills are essential. Come join us to create innovative solutions in the world of design and engineering. #J-18808-Ljbffr Autodesk
    Senior

    Autodesk

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...and ship category-defining software that enables Ryder and its...  ...creating impact for the engine of the American economy, you...  ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning...  ...in distributed systems and ML operations to enhance our... 
    Senior
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton (A Ryder Technology Lab)

    San Francisco, CA
    more than 2 months ago
  • Regional Manager, Sales Engineering - Public Sector As a Regional Manager, Sales Engineering,...  ...Developer (BigCommerce Experience Required) AI/ML Headquarters: Philippines URL:...  ...2018. We provide a variety of tools to… Senior Web Developer SaaS Headquarters: Remote... 
    Senior
    Part time
    Internship
    Remote work

    United States Digital Space LLC

    San Francisco, CA
    2 days ago
  •  ...experienced professional to lead the delivery of solution or infrastructure development services in San Francisco. This role involves...  ...complex project issues and developing strong relationships with engineering teams to enhance solutions. Ideal candidates will have over... 
    Senior
    Flexible hours

    EY

    San Francisco, CA
    5 days ago
  • AfterQuery in San Francisco is seeking a Senior Platform Engineer, Applied AI to design and build the core infrastructure for data generation and evaluation systems. This is a highly technical role requiring expertise in distributed systems. As part of a rapidly growing... 
    Senior

    AfterQuery

    San Francisco, CA
    5 days ago
  •  ...systems that power our products, enable our engineers, and keep our platform infrastructure reliable as we grow. As a Senior Software Engineer on the Platform Team, you will own...  ...projects across Compa's products, systems, AI/ML, and data warehouse. Join us and help design... 
    Senior

    Compa

    San Francisco, CA
    6 days ago
  •  ...AGI that benefits all of humanity. As a Software Engineer on the Future of Computing Research...  ...will work together with both the best ML researchers in the world and the greatest...  ...model endpoints, deployments, and compute infrastructure, and improve reliability through health... 
    Senior
    Work at office
    Relocation package

    AI Chopping Block

    San Francisco, CA
    3 days ago
  • $180k - $250k

     ...obsessed team of the world's best engineers and operators. If you are...  ...We are looking for a Senior Software Engineer to join our Robotics...  ...Collaborate with robotics, ML, and product teams to define...  ...multi-agent systems, cloud infrastructures, internal tooling, and robot... 
    Senior
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    4 days ago
  • $230k - $265k

     ...We're looking for a seasoned software engineer to join Parafin's Infrastructure team and lead the development of our...  ...services for small businesses. As a Senior Software Engineer, you'll be...  ...models that power internal dashboards, ML models, and customer-facing... 
    Senior
    Work from home
    Flexible hours

    Parafin Inc

    San Francisco, CA
    2 days ago
  • $200k - $400k

     ...grow as a team. About the Team The Infrastructure team builds and operates the foundations...  ...power Decagon: networking, data, ML serving, developer platform, and real...  ...About the Role We’re looking for a Senior Software Engineer to help build and evolve our internal... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    5 days ago
  • $200k - $220k

     ...only vertically integrated AI infrastructure company built from the...  ...Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire...  ...Engineering Teams: Partner with software engineers, data scientists,...  ...building infrastructure for AI/ML workloads or cloud... 
    Senior
    Full time
    Temporary work
    Work at office
    Remote work

    Crusoe

    San Francisco, CA
    1 day ago
  •  ...and guidance to teams across engineering, product, and business and...  ...the data and machine learning infrastructure to enable Plaid engineers to...  ...projects such as improving ML development golden paths, implementing...  ...~5+ years of software engineering experience  ~ Extensive... 
    Senior

    Plaid

    San Francisco, CA
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!