Senior Software Engineer, ML Infrastructure
$200k - $275kSambaNova Systems
Role Description
The Senior Software Engineer, ML Infrastructure will be responsible for designing, building, and operating the production-grade inference infrastructure that powers SambaNova's serving stack on our Reconfigurable Dataflow Unit (RDU) architecture. This role sits at the heart of our mission: turning state-of-the-art inference techniques into reliable, high-throughput, low-latency services exposed to customers through SambaStack and SambaCloud.
- Own end-to-end systems spanning request scheduling, advanced decoding algorithms, caching layers, API surfaces, and the accuracy infrastructure.
- Partner closely with ML, compiler, runtime, and product teams to ship inference features from prototype to production.
Qualifications
- Bachelor's degree in Computer Science, Electrical Engineering, or related field
- 5+ years of industry experience building and operating large-scale distributed systems, ideally in ML serving
- Strong software engineering fundamentals: algorithms, data structures, concurrency, and systems design
- Experience designing and maintaining production services with strict latency, throughput, and availability requirements
- Working knowledge of modern LLM inference techniques and familiarity with open-source serving stacks such as vLLM, TensorRT-LLM, or SGLang
- Proficiency in Python
- Experience collaborating across teams to deliver complex, system-level engineering solutions
Requirements
- Design and productionize advanced inference techniques on RDU to optimize for performance and cost.
- Own SambaNova's integration with vLLM and adjacent serving frameworks, adapting them to RDU's architecture.
- Own the public inference API surface exposed through SambaStack and SambaCloud.
- Build and maintain the accuracy verification and regression infrastructure that gates every inference feature shipped to customers.
- Partner with ML, compiler, runtime, and product teams to take inference features from prototype to production.
- Contribute to technical design discussions, code reviews, and architectural decisions as a senior individual contributor.
Benefits
- Competitive total rewards package, including base salary, equity, and benefits.
- 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents.
- Health Savings Account (HSA) with employer contribution.
- Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans.
- Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care.
- Well-being benefits including a full subscription to Headspace, Gympass+ membership, One Medical membership, and counseling services with an Employee Assistance Program.
- ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ...The Lambda Infrastructure Engineering organization forges the... ...looking for an experienced Senior Software Engineer to join our storage... ...to Have Experience with AI/ML workloads and the unique storage...SeniorWork at officeLocal areaWork from home
$150k - $250k
...founding member of our engineering team, you will have a... ...just “models.” It’s the software layer that turns:... ...engineering. It is for senior software engineers who... ...the backend systems and infrastructure that power the factory... ...factory floor and cloud ML Infrastructure & Data...SeniorFull timeContract work- ...institutions Work together with engineers, scientists, operators, and more from... ...AI Human data is the core infrastructure to AI advancement. Frontier AI labs... ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This...SeniorFull timeWork at officeRemote workFlexible hours
$211k - $222k
Role Description As a Senior Engineer on the ML/AI platform team, you will play a key role in building... ...~3 years of experience with software development in one or more programming... ...in building platforms and high scale infrastructure ~Visionary thinker capable of generating...SeniorFull timeRemote work$216.7k - $303.4k
...training, tools that enable machine learning engineers (MLEs) and data scientists (DSs) to improve the ML feature software development lifecycle. ~Lead the building,... ...ML Feature Store and Feature Engineering infrastructure at Reddit that serves 100 million+ redditors...SeniorFull timeRemote workFlexible hours$170k - $230k
Role Description As a Senior Software Engineer, you will play a key role in developing and maintaining the core infrastructure that underpins our AI platform. Your expertise in coding and... ...build the infrastructure that supports ML workflows, ensuring seamless and...SeniorFull timeContract workLocal area$160k - $180k
...a talented and passionate Senior Full-Stack Engineer to join our growing engineering... ...embedded engineers, AI/ML specialists, and business owners... ...maintenance of our cloud infrastructure (e.g., AWS, Azure, GCP).... ...degree in Computer Science, Software Engineering, or a related field...SeniorFull timeWork experience placement- Role Description In the Senior Engineer role, you will own meaningful subsystems... ...~Partner with product and infrastructure teams on model onboarding,... ...to end. ~Strong Data & ML systems fundamentals: data-... ...also involve working with software and technologies subject to...SeniorFull time
$150k - $180k
...Description We are seeking a Sr AI Platform Engineer to build the shared product-... ...observability, safety, and launch-readiness infrastructure needed to ship AI features with... ...’s degree in Computer Science, Software Engineering, AI/ML, or a related technical field, and 5...SeniorFull timeFlexible hours- ...Description We’re looking for a Senior AI Platform Engineer to help design, build, and scale our AI and data infrastructure. In this role, you’ll focus... ..., and production-grade AI/ML workflows, working closely... ...professional experience in software engineering and...SeniorFull timeImmediate startRemote workFlexible hours
$140.2k - $185.8k
Role Description As a Sr. Software Engineer – AI Platform, you will be a hands-on engineer responsible... ...CI/CD workflows, GitOps practices, and infrastructure automation across AWS and Azure, while... ...engineers, product teams, and data/ML engineers to ensure that AI-native...SeniorFull timeFlexible hours- ...ecosystem through high-quality engineering practices and innovation. We... ...layers. ~Implement Infrastructure as Code (IaC) using Terraform... ...degree in computer science, software engineering, or a related technical... ...experience integrating AI/ML systems using the Model...SeniorFull time
- ...integration for chat and email, working with the frontend platform team, ML teams, infra team, and other backend services. ~Expand our... ...integrations. We are looking for strong versatile backend engineers who want to work at the intersection of distributed systems,...SeniorFull timeWork at officeLocal areaRemote workWork from homeHome office
- Role Description As a Senior Software Engineer II at Aledade, we maintain, improve, and expand our... ...engineers. Requirements ~Deep AWS + infrastructure experience. ~Networking and... ..., Claude Code, etc.). ~Improve AI/ML infrastructure for model development,...SeniorFull timeTemporary work
$213k - $263k
...year. The team is responsible for both the rendering/simulation engine as well as the pipeline that lets a variety of internal customers... ...Requirements ~Prior experience in working on or integrating with ML pipelines and a general understanding of how such pipelines are...SeniorFull time- Dormont Manufacturing Co is seeking a TS/SCI cleared Senior Software Engineer to support cutting-edge data-centric architecture projects. You'll have opportunities in a collaborative environment to accelerate your career with innovative technologies. Responsibilities include...SeniorRemote job
$182k - $222k
...fostering empowerment, inclusion, respect, and accountability. Senior Software Engineer, Platform Location: Seattle, WA; Austin, TX; Boston, MA;... ...distributed system features within production-grade AI or ML systems, including integrating LLMs or generative AI models...SeniorApprenticeshipWork at officeLocal areaRemote workFlexible hoursShift work1 day per week- Regional Manager, Sales Engineering - Public Sector As a Regional Manager, Sales Engineering,... ...Developer (BigCommerce Experience Required) AI/ML Headquarters: Philippines URL:... ...2018. We provide a variety of tools to… Senior Web Developer SaaS Headquarters: Remote...SeniorPart timeInternshipRemote work
- ...decarbonize their business. We’re looking for software engineers to help build the AI platform that... ...you will: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering Experience building products...SeniorWork at officeRemote work
$200k - $350k
About the Role Join a well-funded AI/ML data analytics startup building an agentic... ...from messy enterprise data. As a Senior Software Engineer, Platform , you'll be a core member... ...engineering resources. Contribute across infrastructure, services, and frontend as the team...SeniorWork at officeRemote workVisa sponsorship$200k - $250k
...and ship category-defining software that enables Ryder and its... ...creating impact for the engine of the American economy, you... ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning... ...in distributed systems and ML operations to enhance our...SeniorFull timeWork at officeImmediate startRemote workMonday to Friday$145k - $220k
...Senior Software Engineer, Data Platform New York Hiring for multiple roles. Traditional forecasting breaks under petabytes of features,... ...basic probability and statistics Experience implementing ML models Experience with DBT MS or PhD in STEM field...SeniorWork at officeRemote work$208k - $263k
...Every line of that autonomous driving software has to be compiled, tested, and validated... ...'ll join the team that owns the build infrastructure making that possible: maintaining and evolving... ...-language monorepo used by hundreds of engineers. As a key contributor, you will take...SeniorFull timeTemporary workRemote workRelocation package$155k - $237k
...Clever to power secure digital learning experiences. The Infrastructure team handles platform engineering at Clever, building and evolving the internal... .... Qualifications ~4+ years of experience as a Software Engineer including backend work. ~Experience with...SeniorFull timeWorldwideFlexible hours$160k - $210k
Role Description Cribl Inc is seeking a Senior Software Engineer to join our mission to unlock the value of all observability data. You will... ...and deliver solutions that improve our cloud service, infrastructure, and tools. ~Solve infrastructure problems with a software...SeniorFull timeTemporary workRemote work$196k - $220.5k
Role Description As a Senior Software Engineer on the Web Platform team, you will continuously improve our build tooling, developer workflows, and infrastructure, affecting the productivity of every frontend engineer at Discord and ultimately every user interaction on the...SeniorFull timeRelocationRelocation package$172.2k - $215.2k
...metadata storage platform that underpins the company's data infrastructure. The platform provides a horizontally scalable... ...stored, discoverable, and accessible. We're looking for a Senior Software Engineer to help evolve this platform. You'll work across the stack...SeniorFull timeWork at officeLocal areaRemote workHome office3 days per week$165k - $225k
...delivers high-performance AI infrastructure for organizations running... ...and subnet configuration, and software-designed networking orchestration... ...that enable researchers and engineering teams to programmatically... ...computing platforms and AI/ML infrastructure requirements...SeniorImmediate startRemote workFlexible hours$209k - $235k
The Role We're looking for a Senior Software Engineer to join our Platform team and build the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped... ...must execute reliably in real time, and ML models need to train and deploy continuously...SeniorFull timeHome officeFlexible hours- ...technologies, and we're building the data infrastructure and tools that enable it to happen.... ...team. Qualifications ~A strong software engineering background. ~Deep Kubernetes... ...bonus). ~Interest in robotics, AR/VR, ML, or simulation (bonus). Benefits...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!
- ngo software engineer Remote
- software developer Remote
- software developer internship no experience Remote
- software developer apprenticeship Remote
- junior software developer Remote
- part time software developer remote Remote
- financial software developer Remote
- senior software engineer ruby on rails Remote
- software engineer amazon Remote
- senior software design engineer Remote









