Senior Software Engineer, ML Infrastructure
Arena AI
Senior Software Engineer (ML Infrastructure)
Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world's most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.
You'll
- Architect and scale high-performance, real-time API and data systems
- Design and implement low-latency pipelines to process and analyze large-scale event streams
- Ensure reliability through robust data integrity, availability, and consistency mechanisms
- Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
- Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems
You'll have
- 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
- Deep expertise in distributed systems, stream processing, and scalable backend architecture
- Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
- Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
- Comfortable in a dynamic, high-ownership, fast-growth environment
- Prior experience with PyTorch model development is a plus.
What We Offer
- Competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- The opportunity to work on cutting-edge AI with a small, mission-driven team
- A culture that values transparency, trust, and community impact
Come help build the space where anyone can explore and help shape the future of AI.
Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.
$209k - $235k
The Role We're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by the nature of energy markets: forecasts and trading decisions run on tight...SeniorFull timeHome officeFlexible hours$140k - $225k
...assembling a diverse, world-class team—engineers, designers, researchers, and... .... About The Role As the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role... ...a plus Familiarity with ML Usage. Some familiarity with how...SeniorFull timeTemporary workLocal areaFlexible hours$200k - $250k
...Francisco FiDi office. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at... ...with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure operations...SeniorWork at officeImmediate start3 days per week$213k - $263k
...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the... ...set of sensors, enabling software engineers like you to develop multi-modal models and... ...building, integrating, debugging and evaluating ML-based systems We prefer: MS or...SeniorFull timeRemote work$230k - $265k
...business has the financial tools they need. About The Position We’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly...SeniorFull timeWork from homeFlexible hours- ...decarbonize their business. We’re looking for software engineers to help build the AI platform that... ...you will: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering Experience building products...SeniorWork at officeRemote work
$176k - $220k
...institutions Work together with engineers, scientists, operators, and more... ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI... ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team....SeniorFull timeWork at officeRemote workFlexible hours$220k - $300k
...AI foundation: the model layer and agent infrastructure that determine the quality of work our... ...Representative Projects Context Engineering & Agent Infrastructure. Build the platform... ..., with at least 1+ year focused on AI/ML engineering. Staff candidates will typically...Senior$220k - $300k
...the best product managers, software, and hardware talent at innovative... ...to help them hire. Senior Software Engineer, Platform Location: San... ...of Funding: Series A/B AI Infrastructure + Document Intelligence... ...infrastructure and production ML systems The company...SeniorWork at officeRemote workVisa sponsorship$127k - $223k
...realistic closed-loop simulation engine built with the latest in... ...will… - Develop the tooling, infrastructure, and pipelines to support complex... ...programming and strong software engineering fundamentals with... ...Experience in evaluating complex ML models or self-driving...SeniorFull timeWork at officeWork from homeFlexible hours- ...Senior Software Engineer, Developer Platform Houston, TX or San Francisco Bay Area Company Introduction At Bot Auto,... ...retries, and resource optimization. Partner with ML, simulation, data, and infrastructure teams to understand workload requirements and deliver...SeniorTemporary work
- ...and builds the shared infrastructure that helps DoorDash, Wolt... ...serving and inference engines, fine-tuning and... ...This role is ideal for a senior engineer who enjoys owning... ...technical bar for — ML engineers, product... ...industry experience in software engineeringDeep backend...SeniorHourly payWork at officeLocal areaRemote workFlexible hours
$180k - $250k
...obsessed team of the world’s best engineers and operators. If you are... ...We are looking for a Senior Software Engineer to join our Robotics... ...Collaborate with robotics, ML, and product teams to define... ...multi-agent systems, cloud infrastructures, internal tooling, and robot...SeniorFull timeLocal areaFlexible hours- ...Capital, and are looking for senior engineers for our Platform team. The Opportunity As a Senior Software Engineer on our Platform team... ..., and build the platform and infrastructure that makes state‑of‑the‑art document... ...You'll work closely with our ML engineers to serve in‑house...SeniorWork at officeLocal area
$250k - $350k
...people (Series A) · Industry: AI / Data The Role As a Senior Software Engineer, Infrastructure and Platform, you'll design and build the core... ...Experience with AI infrastructure, LLM evaluation systems, or ML pipelines Experience at high-growth startups or scaling...SeniorFull timeVisa sponsorship- ...systems that power our products, enable our engineers, and keep our platform infrastructure reliable as we grow. As a Senior Software Engineer on the Platform Team, you will own... ...projects across Compa's products, systems, AI/ML, and data warehouse. Join us and help design...Senior
$180k - $250k
About the Role We are looking for a Senior Software Engineer to join our Robotics organization, focused... ...Collaborate with robotics, ML, and product teams to define requirements... ...between our multi‑agent systems, cloud infrastructures, internal tooling, and robot‑facing interfaces...SeniorLocal areaFlexible hours- ...Discord safe for all users. We provide the infrastructure and services that enable scalable and... ...on Discord. We're looking for a Senior Software Engineer who is capable of handling ambiguous,... ...Collaborate with Trust & Safety, ML, and product teams to understand requirements...SeniorWork at officeRelocation package2 days per week
- ...expanded into a horizontal automation engine adopted by HR, Finance, Legal, Security... ...automate employee onboarding/offboarding, software access management, and the long tail of... ...enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational...SeniorFull time
$170k - $220k
...tested, and operated. Our platform gives engineers real-time observability over high-... ...ensuring mission reliability demanded new infrastructure. Founded by a team from SpaceX, Google,... ...and customer base. Collaborate with software engineers to optimize application performance...SeniorFull timeRelocation$230k - $265k
...where every small business has the financial tools they need. About the Position We're seeking an experienced software engineer to join our Infrastructure team and help build the foundation for our rapidly growing financial technology platform. The Infrastructure...SeniorFull timeWork from homeFlexible hours$130k - $175k
...enable and empower Kiddom’s engineering by building a scalable and sustainable... ...services. Practicing Infrastructure as Code (IaC) wherever... ...field ~5+ years professional software engineering experience ~... ...geography, past experience, seniority, and demonstrated role...SeniorPermanent employmentFull timeWork at officeLocal areaRemote work- ...team that ships hardware‑software systems into customer facilities... ...‑backed team of robotics, ML, and operations engineers building the foundation... ...to be rock‑solid. As a Senior Software Engineer on the Robotics... ...Full‑stack or cloud infrastructure experience (monitoring, logging...SeniorFlexible hours
- ...team. About the role We are hiring a Senior Software Engineer to own the data platform that powers... ...experience building backend or data infrastructure in production Deep expertise in relational... ...consume structured data, not pure ML research Comfort in customer‑facing...SeniorWork at officeFlexible hours2 days per week
- ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning... ...of AI. The Role As a Software Engineer on our... ...Points Experience with AI/ML workloads and infrastructure....Full timeWork at officeWork from home1 day per week
- ...hardware caching Much more! About the Role As an engineer within Fleet infrastructure, you will design, write, deploy, and operate infrastructure... ...requirements As a bonus, have an understanding of AI/ML workloads About OpenAI OpenAI is an AI research...Full timeWork at officeRelocation package
$215k - $265k
...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of... .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,... ...or building platforms that support AI/ML workflows Familiarity with GPU workloads...Full timeWork experience placementWork at officeImmediate startVisa sponsorshipFlexible hours- ...applied AI research, flexible infrastructure, and seamless developer tooling... ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Software Engineer at on the Training Infrastructure... ...systems for our ML training platform (e.g. scheduling...Full timeFlexible hours
- ...Background Specter is creating a software-defined "control plane" for the physical... ...will ultimately become the perception engine for a company's physical footprint, enabling... ...Specter is hiring an ML infrastructure engineer to build and scale the machine...Full time
$145.4k - $188.1k
...the Machine Learning Infrastructure Team At Thumbtack,... ...detection, and more. The ML Infrastructure team is... .... We empower product engineering teams by providing scalable... ...The challenge As a Software Engineer on the ML... .... Partner with senior engineers to evaluate...Full timeSeasonal workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!
- ngo software engineer San Francisco, CA
- software data engineer San Francisco, CA
- graduate software engineer San Francisco, CA
- software development engineer (robotics engineer) San Francisco, CA
- software system engineer San Francisco, CA
- graduate software developer San Francisco, CA
- software engineer - early career San Francisco, CA
- entry level software engineer remote San Francisco, CA
- software engineer intern San Francisco, CA
- IT software developer San Francisco, CA


