Senior Software Engineer, ML Infrastructure
Arena AI
Senior Software Engineer (ML Infrastructure)
Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world's most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.
You'll
- Architect and scale high-performance, real-time API and data systems
- Design and implement low-latency pipelines to process and analyze large-scale event streams
- Ensure reliability through robust data integrity, availability, and consistency mechanisms
- Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
- Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems
You'll have
- 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
- Deep expertise in distributed systems, stream processing, and scalable backend architecture
- Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
- Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
- Comfortable in a dynamic, high-ownership, fast-growth environment
- Prior experience with PyTorch model development is a plus.
What We Offer
- Competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- The opportunity to work on cutting-edge AI with a small, mission-driven team
- A culture that values transparency, trust, and community impact
Come help build the space where anyone can explore and help shape the future of AI.
Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.
$200k - $280k
...SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE Build the core infrastructure that powers petabyte-scale data collection and delivery for the world's leading robotics... ...TO HAVE Experience with robotics, computer vision, or ML infrastructure Background in video processing or real-...SeniorHome office- ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple...SeniorWork at officeFlexible hours
$200k - $250k
...and we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in... ...to Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background...SeniorInternshipRelocation package$200k - $400k
...a team. About the Team The Infrastructure team builds and operates the foundations... ...power Decagon: networking, data, ML serving, developer platform, and... ...About the Role We're hiring a Senior Infrastructure Engineer to design, build, and operate production...SeniorFull timeWork at officeLocal area- Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform... ...non-engineers to build and manage data and ML pipelines. Establish monitoring,...SeniorWork at office3 days per week
- ...The Role Handshake is building the infrastructure layer that powers the next generation... ...AI agents across our platform. As a Senior Software Engineer on our Agentic Infrastructure team, you... ...engineer to build with AI Partner with ML, product, & platform engineers to...SeniorFull timeFreelanceInternshipWork at officeRemote workFlexible hours
$150k - $250k
...founding member of our engineering team, you will have a... ...just “models.” It’s the software layer that turns:... ...engineering. It is for senior software engineers who... ...the backend systems and infrastructure that power the factory... ...factory floor and cloud ML Infrastructure & Data...SeniorFull timeContract work$200k - $400k
...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences... ...the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner...SeniorFull timeWork at officeLocal area$250k - $330k
...grow as a team. About the Team The Infrastructure team builds and operates the foundations... ...power Decagon: networking, data, ML serving, developer platform, and... ...accurately. About the Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate...SeniorWork at office- ...and guidance to teams across engineering, product, and business and... ...effectively. Engineers on Data Infrastructure are domain experts in Data... ...projects such as improving ML development golden paths, implementing... ...Qualifications 5+ years of software engineering experience...SeniorWork experience placementLocal area
$194k - $239k
...Senior Software Engineer, Infrastructure Hover helps people design, improve, and protect the properties they love. With proprietary AI built on over a decade of real property data, Hover answers age-old questions like “What will it look like?” and “What will it cost?”...SeniorFull timeFor contractorsWork at officeLocal areaFlexible hours- ...decarbonize their business. We’re looking for software engineers to help build the AI platform that... ...you will: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering Experience building products...SeniorWork at officeRemote work
$200k - $350k
...About the Role Join a well-funded AI/ML data analytics startup building an agentic... ...from messy enterprise data. As a Senior Software Engineer, Platform , you'll be a core member... ...engineering resources. Contribute across infrastructure, services, and frontend as the team...SeniorWork at officeRemote workVisa sponsorship$220k - $300k
...the best product managers, software, and hardware talent at innovative... ...to help them hire. Senior Software Engineer, Platform Location: San... ...of Funding: Series A/B AI Infrastructure + Document Intelligence... ...infrastructure and production ML systems The company...SeniorWork at officeRemote workVisa sponsorship$220k - $300k
...AI foundation: the model layer and agent infrastructure that determine the quality of work our... ...can do. REPRESENTATIVE PROJECTS - Context Engineering & Agent Infrastructure. Build the... ...systems, with at least 1+ year focused on AI/ML engineering. Staff candidates will typically...Senior$230k - $265k
...business has the financial tools they need. About The Position We're looking for a software engineer to join Parafin's Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly...SeniorWork from homeFlexible hours- ...financial data network. The Machine Learning Infrastructure team sits at the center of this... ..., and establishing a standardized ML Ops “golden path.” Our mission is to... ...powered financial experiences. As a Senior Software Engineer on the Machine Learning Infrastructure...SeniorShift work
- Hayden AI Technologies, Inc. is looking for a Senior Software Engineer to join their Platform - Cloud Events team in San Francisco. The role focuses on optimizing cloud-based ML operations, improving architecture, and collaborating with multiple teams. Candidates should...SeniorWork at office3 days per week
- A leading software company in San Francisco is seeking a Software Developer to drive feature implementation and improve developer productivity... ...skills are essential. Come join us to create innovative solutions in the world of design and engineering. #J-18808-Ljbffr AutodeskSenior
$200k - $250k
...and ship category-defining software that enables Ryder and its... ...creating impact for the engine of the American economy, you... ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning... ...in distributed systems and ML operations to enhance our...SeniorFull timeWork at officeImmediate startRemote workMonday to Friday- Regional Manager, Sales Engineering - Public Sector As a Regional Manager, Sales Engineering,... ...Developer (BigCommerce Experience Required) AI/ML Headquarters: Philippines URL:... ...2018. We provide a variety of tools to… Senior Web Developer SaaS Headquarters: Remote...SeniorPart timeInternshipRemote work
- ...experienced professional to lead the delivery of solution or infrastructure development services in San Francisco. This role involves... ...complex project issues and developing strong relationships with engineering teams to enhance solutions. Ideal candidates will have over...SeniorFlexible hours
- AfterQuery in San Francisco is seeking a Senior Platform Engineer, Applied AI to design and build the core infrastructure for data generation and evaluation systems. This is a highly technical role requiring expertise in distributed systems. As part of a rapidly growing...Senior
- ...systems that power our products, enable our engineers, and keep our platform infrastructure reliable as we grow. As a Senior Software Engineer on the Platform Team, you will own... ...projects across Compa's products, systems, AI/ML, and data warehouse. Join us and help design...Senior
- ...AGI that benefits all of humanity. As a Software Engineer on the Future of Computing Research... ...will work together with both the best ML researchers in the world and the greatest... ...model endpoints, deployments, and compute infrastructure, and improve reliability through health...SeniorWork at officeRelocation package
$180k - $250k
...obsessed team of the world's best engineers and operators. If you are... ...We are looking for a Senior Software Engineer to join our Robotics... ...Collaborate with robotics, ML, and product teams to define... ...multi-agent systems, cloud infrastructures, internal tooling, and robot...SeniorLocal areaFlexible hours$230k - $265k
...We're looking for a seasoned software engineer to join Parafin's Infrastructure team and lead the development of our... ...services for small businesses. As a Senior Software Engineer, you'll be... ...models that power internal dashboards, ML models, and customer-facing...SeniorWork from homeFlexible hours$200k - $400k
...grow as a team. About the Team The Infrastructure team builds and operates the foundations... ...power Decagon: networking, data, ML serving, developer platform, and real... ...About the Role We’re looking for a Senior Software Engineer to help build and evolve our internal...SeniorFull timeWork at officeLocal area$200k - $220k
...only vertically integrated AI infrastructure company built from the... ...Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire... ...Engineering Teams: Partner with software engineers, data scientists,... ...building infrastructure for AI/ML workloads or cloud...SeniorFull timeTemporary workWork at officeRemote work- ...and guidance to teams across engineering, product, and business and... ...the data and machine learning infrastructure to enable Plaid engineers to... ...projects such as improving ML development golden paths, implementing... ...~5+ years of software engineering experience ~ Extensive...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!
- software engineer amazon San Francisco, CA
- experienced software developer San Francisco, CA
- federal - software developer San Francisco, CA
- software developer internship San Francisco, CA
- senior software engineer San Francisco, CA
- software developer fintech San Francisco, CA
- part time software developer remote San Francisco, CA
- software developer intern San Francisco, CA
- software data engineer San Francisco, CA
- fall software engineering internship San Francisco, CA

