Senior Software Engineer, ML Infrastructure
$200k - $275kSambaNova Systems
Role Description
The Senior Software Engineer, ML Infrastructure will be responsible for designing, building, and operating the production-grade inference infrastructure that powers SambaNova's serving stack on our Reconfigurable Dataflow Unit (RDU) architecture. This role sits at the heart of our mission: turning state-of-the-art inference techniques into reliable, high-throughput, low-latency services exposed to customers through SambaStack and SambaCloud.
- Own end-to-end systems spanning request scheduling, advanced decoding algorithms, caching layers, API surfaces, and the accuracy infrastructure.
- Partner closely with ML, compiler, runtime, and product teams to ship inference features from prototype to production.
Qualifications
- Bachelor's degree in Computer Science, Electrical Engineering, or related field
- 5+ years of industry experience building and operating large-scale distributed systems, ideally in ML serving
- Strong software engineering fundamentals: algorithms, data structures, concurrency, and systems design
- Experience designing and maintaining production services with strict latency, throughput, and availability requirements
- Working knowledge of modern LLM inference techniques and familiarity with open-source serving stacks such as vLLM, TensorRT-LLM, or SGLang
- Proficiency in Python
- Experience collaborating across teams to deliver complex, system-level engineering solutions
Requirements
- Design and productionize advanced inference techniques on RDU to optimize for performance and cost.
- Own SambaNova's integration with vLLM and adjacent serving frameworks, adapting them to RDU's architecture.
- Own the public inference API surface exposed through SambaStack and SambaCloud.
- Build and maintain the accuracy verification and regression infrastructure that gates every inference feature shipped to customers.
- Partner with ML, compiler, runtime, and product teams to take inference features from prototype to production.
- Contribute to technical design discussions, code reviews, and architectural decisions as a senior individual contributor.
Benefits
- Competitive total rewards package, including base salary, equity, and benefits.
- 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents.
- Health Savings Account (HSA) with employer contribution.
- Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans.
- Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care.
- Well-being benefits including a full subscription to Headspace, Gympass+ membership, One Medical membership, and counseling services with an Employee Assistance Program.
$160k - $230k
Role Description We are looking for a Senior Software Engineer (5-10yrs experience) to bridge the... ...Terraform for managing cloud-agnostic infrastructure. ~Strong proficiency building developer... ...workloads. Experience with AI/ML technologies, Evals Infra. Benefits...SeniorFull timeLocal area$153k - $222k
...Machine Learning Engineer Applied Intuition, Inc. is powering the... ...is creating the digital infrastructure needed to bring intelligence... ...machine learning pipelines and ML engineers that want to work beyond... ...degree in Computer Science, Software Engineering, or equivalent...SeniorFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift- ...institutions Work together with engineers, scientists, operators, and more from... ...AI Human data is the core infrastructure to AI advancement. Frontier AI labs... ...About the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This...SeniorFull timeWork at officeRemote workFlexible hours
$211k - $222k
Role Description As a Senior Engineer on the ML/AI platform team, you will play a key role in building... ...~3 years of experience with software development in one or more programming... ...in building platforms and high scale infrastructure ~Visionary thinker capable of generating...SeniorFull timeRemote work$216.7k - $303.4k
...training, tools that enable machine learning engineers (MLEs) and data scientists (DSs) to improve the ML feature software development lifecycle. ~Lead the building,... ...ML Feature Store and Feature Engineering infrastructure at Reddit that serves 100 million+ redditors...SeniorFull timeRemote workFlexible hours$170k - $230k
Role Description As a Senior Software Engineer, you will play a key role in developing and maintaining the core infrastructure that underpins our AI platform. Your expertise in coding and... ...build the infrastructure that supports ML workflows, ensuring seamless and...SeniorFull timeContract workLocal area$160k - $180k
...a talented and passionate Senior Full-Stack Engineer to join our growing engineering... ...embedded engineers, AI/ML specialists, and business owners... ...maintenance of our cloud infrastructure (e.g., AWS, Azure, GCP).... ...degree in Computer Science, Software Engineering, or a related field...SeniorFull timeWork experience placement$150k - $180k
...Description We are seeking a Sr AI Platform Engineer to build the shared product-... ...observability, safety, and launch-readiness infrastructure needed to ship AI features with... ...’s degree in Computer Science, Software Engineering, AI/ML, or a related technical field, and 5...SeniorFull timeFlexible hours- Role Description In the Senior Engineer role, you will own meaningful subsystems... ...~Partner with product and infrastructure teams on model onboarding,... ...to end. ~Strong Data & ML systems fundamentals: data-... ...also involve working with software and technologies subject to...SeniorFull time
- ...Description We’re looking for a Senior AI Platform Engineer to help design, build, and scale our AI and data infrastructure. In this role, you’ll focus... ..., and production-grade AI/ML workflows, working closely... ...professional experience in software engineering and...SeniorFull timeImmediate startRemote workFlexible hours
$140.2k - $185.8k
Role Description As a Sr. Software Engineer – AI Platform, you will be a hands-on engineer responsible... ...CI/CD workflows, GitOps practices, and infrastructure automation across AWS and Azure, while... ...engineers, product teams, and data/ML engineers to ensure that AI-native...SeniorFull timeFlexible hours- ...ecosystem through high-quality engineering practices and innovation. We... ...layers. ~Implement Infrastructure as Code (IaC) using Terraform... ...degree in computer science, software engineering, or a related technical... ...experience integrating AI/ML systems using the Model...SeniorFull time
- ...decarbonize their business. We're looking for software engineers to help build the AI platform that... ...: Design and build the agent infrastructure that powers Watershed's products... ...experience in backend, platform, or AI/ML engineering ~ Experience building products...SeniorWork at officeRemote work
- Role Description As a Senior Software Engineer II at Aledade, we maintain, improve, and expand our... ...engineers. Requirements ~Deep AWS + infrastructure experience. ~Networking and... ..., Claude Code, etc.). ~Improve AI/ML infrastructure for model development,...SeniorFull timeTemporary work
- ...integration for chat and email, working with the frontend platform team, ML teams, infra team, and other backend services. ~Expand our... ...integrations. We are looking for strong versatile backend engineers who want to work at the intersection of distributed systems,...SeniorFull timeWork at officeLocal areaRemote workWork from homeHome office
$220k - $300k
...the best product managers, software, and hardware talent at innovative... ...to help them hire. Senior Software Engineer, Platform Location: San... ...of Funding: Series A/B AI Infrastructure + Document Intelligence... ...infrastructure and production ML systems The company...SeniorWork at officeRemote workVisa sponsorship$15k
...worked at the frontier of applying AI/ML to investment management. We have... ...lunches, and more. Your Team As a Senior Software Engineer on the Software Platform team, you... ...scalable services that abstract away infrastructure complexity. Operating at the heart...SeniorWork at officeLocal areaRemote work$220k - $265k
...business has the financial tools they need. About The Position We're looking for a software engineer to join Parafin's Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly...SeniorWork from homeFlexible hours$213k - $263k
...year. The team is responsible for both the rendering/simulation engine as well as the pipeline that lets a variety of internal customers... ...Requirements ~Prior experience in working on or integrating with ML pipelines and a general understanding of how such pipelines are...SeniorFull time$190k - $230k
...Senior Software Engineer, AI Platform At HackerOne, we're revolutionizing offensive security by combining human intelligence with artificial... ...implementing distributed system features within production-grade AI or ML systems, including integrating LLMs or generative AI models...SeniorApprenticeshipWork at officeLocal areaRemote workFlexible hours1 day per week$182k - $222k
...fostering empowerment, inclusion, respect, and accountability. Senior Software Engineer, Platform Location: Seattle, WA; Austin, TX; Boston, MA;... ...distributed system features within production-grade AI or ML systems, including integrating LLMs or generative AI models...SeniorApprenticeshipWork at officeLocal areaRemote workFlexible hoursShift work1 day per week$145k - $220k
...Senior Software Engineer, Data Platform New York Hiring for multiple roles. Traditional forecasting breaks under petabytes of features,... ...basic probability and statistics Experience implementing ML models Experience with DBT MS or PhD in STEM field...SeniorWork at officeRemote work$230k - $265k
...Parafin Software Engineer Position At Parafin, we're on a mission to grow... ...engineer to join Parafin's Infrastructure team and lead the... ...for small businesses. As a Senior Software Engineer, you'll be... ...power internal dashboards, ML models, and customer-facing...SeniorRemote workWork from homeFlexible hours$200k - $250k
...and ship category-defining software that enables Ryder and its... ...creating impact for the engine of the American economy, you... ...love it here. Role: Senior Software Engineer - Infrastructure Team: Machine Learning... ...in distributed systems and ML operations to enhance our...SeniorFull timeWork at officeImmediate startRemote workMonday to Friday$208k - $263k
...Every line of that autonomous driving software has to be compiled, tested, and validated... ...'ll join the team that owns the build infrastructure making that possible: maintaining and evolving... ...-language monorepo used by hundreds of engineers. As a key contributor, you will take...SeniorFull timeTemporary workRemote workRelocation package$200k - $220k
...only vertically integrated AI infrastructure company built from the... ...Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire... ...Engineering Teams: Partner with software engineers, data scientists,... ...building infrastructure for AI/ML workloads or cloud...SeniorFull timeTemporary workWork at officeRemote work$155k - $237k
...Clever to power secure digital learning experiences. The Infrastructure team handles platform engineering at Clever, building and evolving the internal... .... Qualifications ~4+ years of experience as a Software Engineer including backend work. ~Experience with...SeniorFull timeWorldwideFlexible hours$196k - $220.5k
Role Description As a Senior Software Engineer on the Web Platform team, you will continuously improve our build tooling, developer workflows, and infrastructure, affecting the productivity of every frontend engineer at Discord and ultimately every user interaction on the...SeniorFull timeRelocationRelocation package$172.2k - $215.2k
...metadata storage platform that underpins the company's data infrastructure. The platform provides a horizontally scalable... ...stored, discoverable, and accessible. We're looking for a Senior Software Engineer to help evolve this platform. You'll work across the stack...SeniorFull timeWork at officeLocal areaRemote workHome office3 days per week$170k - $220k
Role Description We're hiring a Senior Software Engineer, Security Infrastructure to build scalable security infrastructure that embeds compliance and risk controls directly into the Cadence platform. You will solve complex security challenges such as data classification...SeniorFull timeWork experience placementRemote workHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, ML Infrastructure. Be the first to apply!
- ngo software engineer Remote
- software developer Remote
- software developer internship no experience Remote
- software developer apprenticeship Remote
- junior software developer Remote
- part time software developer remote Remote
- financial software developer Remote
- senior software engineer ruby on rails Remote
- software engineer amazon Remote
- senior software design engineer Remote










