Senior Software Engineer, ML Infrastructure
Arena AI
Senior Software Engineer (ML Infrastructure)
Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world's most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.
You'll
- Architect and scale high-performance, real-time API and data systems
- Design and implement low-latency pipelines to process and analyze large-scale event streams
- Ensure reliability through robust data integrity, availability, and consistency mechanisms
- Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
- Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems
You'll have
- 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
- Deep expertise in distributed systems, stream processing, and scalable backend architecture
- Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
- Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
- Comfortable in a dynamic, high-ownership, fast-growth environment
- Prior experience with PyTorch model development is a plus.
What We Offer
- Competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate's permanent work location.
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- The opportunity to work on cutting-edge AI with a small, mission-driven team
- A culture that values transparency, trust, and community impact
Come help build the space where anyone can explore and help shape the future of AI.
Arena Intelligence provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity, or gender expression. We are committed to a diverse and inclusive workforce and welcome people from all backgrounds, experiences, perspectives, and abilities.
$140k - $225k
...assembling a diverse, world-class team—engineers, designers, researchers, and... ...best work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role... ...electronics a plusFamiliarity with ML Usage. Some familiarity with how...SeniorFull timeTemporary workLocal areaFlexible hours- ...and builds the shared infrastructure that helps DoorDash, Wolt... ...serving and inference engines, fine-tuning and... ...This role is ideal for a senior engineer who enjoys owning... ...technical bar for — ML engineers, product... ...industry experience in software engineeringDeep backend...SeniorHourly payWork at officeLocal areaRemote workFlexible hours
$193.93k - $291.15k
...Senior Software Engineer, ML Infrastructure Mountain View, California (HQ) Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier...SeniorImmediate startFlexible hours- ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple...SeniorWork at officeFlexible hours
$200k - $250k
...we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in designing... ...Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background...SeniorInternshipRelocation package$137.1k - $299.3k
...and builds the shared infrastructure that helps DoorDash, Wolt... ...serving and inference engines, fine-tuning and... ...This role is ideal for a senior engineer who enjoys owning... ...technical bar for — ML engineers, product... ...industry experience in software engineering ~ Deep...SeniorHourly payFull timeWork at officeLocal areaRemote workFlexible hours- Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform... ...non-engineers to build and manage data and ML pipelines. Establish monitoring,...SeniorWork at office3 days per week
$176k - $220k
...institutions Work together with engineers, scientists, operators, and more... ...Handshake AI Human data is the core infrastructure to AI advancement. Frontier AI... ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team....SeniorFull timeWork at officeRemote workFlexible hours$200k - $250k
...Francisco FiDi office. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at... ...with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure operations...SeniorWork at officeImmediate start3 days per week- ...decarbonize their business. We're looking for software engineers to help build the AI platform that... ...: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering ~ Experience building products...SeniorFull timeWork at officeRemote work
$213k - $263k
...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the... ...set of sensors, enabling software engineers like you to develop multi-modal models and... ...building, integrating, debugging and evaluating ML-based systems We prefer: MS or...SeniorFull timeRemote work$160k - $230k
...combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play... ...that virtualizes cutting-edge ML hardware (GB200s/GB300s,... ...well-tested, and maintainable software and IaC for both new and existing...SeniorFull timeRemote work$250k - $330k
...a team. About the Team The Infrastructure team builds and operates the foundations... ...power Decagon: networking, data, ML serving, developer platform, and real... ...About the Role We’re looking for a Senior Software Engineer to help build and evolve our...SeniorFull timeWork at officeLocal area- ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ...Tuesday. About the Role As a Senior Software Engineer on Lambda’s Core Cloud Platform team,... ...Kubernetes, Slurm, or large-scale AI/ML infrastructure. Experience with...SeniorFull timeWork experience placementWork at officeLocal areaWork from homeFlexible hours
- ...every small business has the financial tools they need.About The PositionWe’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly...SeniorFlexible hours
$148.5k - $223.9k
...re looking for an experienced and hands-on software engineer to join our team to build and scale the next generation of infrastructure management service and operation solutions.... ...Apply AI and Machine Learning: Leverage AI/ML models for intelligent data analysis, anomaly...SeniorFull time- ...patients worldwide.We’re a team of engineers, clinicians, and innovators... ...DescriptionPrimary Function of PositionAs a Senior Software Engineer - Simulation & ML Platform, you will build software... ...and maintain software infrastructure for robotic simulations & ML using...SeniorLocal areaWorldwideFlexible hours
- ...reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant... ...-tenant scheduling, and end-user tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will set the technical direction for...SeniorHourly payWork at officeLocal areaRemote workRelocationFlexible hours
- ...sits at the center of Pave Engineering, bridging product and platform... ...to ship enterprise-grade software with speed and confidence. In... ...well as the foundational data infrastructure and models powering Pave’s... ...pipelines/ ETLs, data modeling; ML/AI platform experience a...Senior3 days per week
$180k - $250k
...obsessed team of the world’s best engineers and operators. If you are... ...We are looking for a Senior Software Engineer to join our Robotics... ...Collaborate with robotics, ML, and product teams to define... ...multi-agent systems, cloud infrastructures, internal tooling, and robot...SeniorFull timeLocal areaFlexible hours$220k - $300k
...AI foundation: the model layer and agent infrastructure that determine the quality of work our... ...Representative Projects Context Engineering & Agent Infrastructure. Build the platform... ..., with at least 1+ year focused on AI/ML engineering. Staff candidates will typically...Senior- Foundry Robotics is hiring a Senior Software Engineer (IC) to build the backend systems and infrastructure powering the factory of the future. You will design and implement cloud-based backend systems, on‑prem factory services, and data flows across embedded to cloud environments...Senior
$127k - $223k
...realistic closed-loop simulation engine built with the latest in... ...will… - Develop the tooling, infrastructure, and pipelines to support complex... ...programming and strong software engineering fundamentals with... ...Experience in evaluating complex ML models or self-driving...SeniorFull timeWork at officeWork from homeFlexible hours- ...Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of... ...for small businesses.As a Senior Software Engineer, you’ll be responsible... ...models that power internal dashboards, ML models, and customer-facing...SeniorFlexible hours
- ...decarbonize their business. We’re looking for software engineers to help build the AI platform that... ...you will: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering Experience building products...SeniorWork at officeRemote work
- ...customers. She will pick the best candidates from Jack's network. The next step is to speak to Jack . Senior Software Engineer (Infrastructure) Company Description: Tavus - Series B AI video platform backed by Sequoia and CRV Job Description:...SeniorFull time
- ...About the team Merge's Core Software team builds the software... ...implement, and maintain the infrastructure that moves experimental data... ...clinicians, neuroscientists, and ML researchers. Our mandate is... .... About the role As our Senior Software Engineer for Platform Instrument...Senior
$100k - $300k
...Wiz, Abnormal AI, Zscaler Preeminent research labs like Deepmind and SAIL About the Role We're hiring a Senior Storage Infrastructure Engineer on our Core Platform team to own how we store, protect, and operate data at scale. You'll build the backup, observability...SeniorFull time- ...Job Description Job Description Senior Software Engineer, ML Platform Location: San Francisco, CA / Remote Flexible Employment Type... ..., MLOps, Model Serving, Feature Stores, Underwriting Infrastructure About Our Client Our client is building financial...SeniorFull timeRemote workFlexible hours
- ...expanded into a horizontal automation engine adopted by HR, Finance, Legal, Security... ...automate employee onboarding/offboarding, software access management, and the long tail of... ...enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!
- software engineer internship San Francisco, CA
- software development engineer aws San Francisco, CA
- software developer internship no experience San Francisco, CA
- real time software engineer San Francisco, CA
- financial software developer San Francisco, CA
- part time software developer San Francisco, CA
- graduate software developer San Francisco, CA
- software engineer travel San Francisco, CA
- experienced software developer San Francisco, CA
- remote entry level software developer San Francisco, CA



