Senior Software Engineer - ML Infrastructure
$170k - $190kClaryo
We're looking for a Senior Machine Learning Engineer to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform. You'll own the end-to-end lifecycle of ML vision models — from training pipelines through optimized cloud deployment — ensuring our cutting-edge computer vision and multi-modal AI systems run reliably and efficiently in production. Your work will directly enable the real-time perception and autonomous decision-making capabilities at the core of our platform.
This is a deeply technical role at the intersection of machine learning, computer vision and distributed systems. You'll design scalable GPU compute clusters, build robust orchestration pipelines, and optimize model serving for low-latency inference at scale. You'll work closely with our research scientists, computer vision engineers, and product teams to bridge the gap between experimental models and production-ready systems that operate across diverse warehouse environments. We've found tremendous value in collaborative problem-solving, thus our team works from our SF office three days a week.
Responsibilities
Build end-to-end ML pipelines — from data ingestion and preprocessing through model training, evaluation, and deployment — and integrate them into core product workflows.
Train, evaluate, deploy and optimize state-of-the-art machine learning models in the cloud using platforms and inference optimization techniques, including VLMs and VLAs.
Establish monitoring, benchmarking, and evaluation frameworks to ensure model performance and reliability in production environments.
Required Experience
B.S. / M.S. in Computer Science, Robotics, or similar technical field, or equivalent practical experience.
5+ years of professional software engineering experience.
3+ years in machine learning— developing, scaling, deploying, and optimizing large-scale ML systems from data to model.
Track record of deploying machine learning models in production environments.
Experience with training and/or deployment of ML models in the computer vision domain.
Strong programming skills in Python.
Preferred Experience
Experience using orchestration systems (Flyte, Temporal, Airflow, or similar) for ML and data pipelines.
Proficiency with ML frameworks (PyTorch, TensorFlow, DeepSpeed, Ray) and model serving platforms (TorchServe, TensorFlow Serving, NVIDIA Triton Inference Server, or similar).
Deep understanding of state-of-the-art machine learning models such as auto-regressive transformers and familiarity with inference optimization techniques (TensorRT, quantization, custom kernels).
Experience with C++ or CUDA programming for GPU acceleration.
Comfortable with distributed messaging and compute systems (Kafka, gRPC, ROS2, or similar).
Prior experience working at autonomous vehicles or robotics companies.
Equal Opportunity Statement
We’re an equal opportunity employer that values diversity and inclusion. We welcome teammates of all backgrounds and don’t discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.
Benefits
At Claryo, we offer a competitive benefits package that supports your health and well-being, including — top-tier medical, dental, and vision coverage, 401k with employer matching, parental leave, and unlimited vacation.
$140k - $225k
...assembling a diverse, world-class team—engineers, designers, researchers, and... ...best work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role... ...electronics a plusFamiliarity with ML Usage. Some familiarity with how...SeniorFull timeTemporary workLocal areaFlexible hours$148.5k - $223.9k
...immediate opportunities for senior software developers who want their lines... ...review, mentoring junior engineers, and providing technical guidance... ...products over public cloud infrastructure - AWS/Azure/GCP.- Proven... ...Skills:Experience with Big-Data/ML and S3 Hands-on experience...SeniorFull timeImmediate start$165k - $226.6k
...potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era.... ..., and transform their users’ experiences. Okta's Core Engineering team is responsible for building and evolving shared infrastructure...SeniorPermanent employmentWork at officeLocal areaWorldwideFlexible hours- ...every small business has the financial tools they need.About The PositionWe’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution of our ML Platform. This role is critical to building reliable, scalable, and developer-friendly...SeniorFlexible hours
$148.5k - $223.9k
...re looking for an experienced and hands-on software engineer to join our team to build and scale the next generation of infrastructure management service and operation solutions.... ...Apply AI and Machine Learning: Leverage AI/ML models for intelligent data analysis, anomaly...SeniorFull time- ...patients worldwide.We’re a team of engineers, clinicians, and innovators... ...DescriptionPrimary Function of PositionAs a Senior Software Engineer - Simulation & ML Platform, you will build software... ...and maintain software infrastructure for robotic simulations & ML using...SeniorLocal areaWorldwideFlexible hours
$187k
...Platform (MLP) team builds and operates the infrastructure, tooling, and developer experience... .... We enable data scientists and ML engineers to develop, train, deploy, and monitor... ...models reliably and efficiently.As a Senior Software Engineer on the Machine Learning Platform...SeniorFull timeWork at officeLocal areaRemote work- ...reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant... ...-tenant scheduling, and end-user tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will set the technical direction for...SeniorHourly payWork at officeLocal areaRemote workRelocationFlexible hours
- ...sits at the center of Pave Engineering, bridging product and platform... ...to ship enterprise-grade software with speed and confidence. In... ...well as the foundational data infrastructure and models powering Pave’s... ...pipelines/ ETLs, data modeling; ML/AI platform experience a...SeniorFlexible hours
- ...Mariana Minerals Mariana Minerals is a software-first, vertically integrated minerals... ...is looking for a Sr. or Staff Software Engineer, Infrastructure to join the team that owns and... ...learning engineers and data engineers on the ML compute platform and data pipeline infrastructure...Senior
- ...Position:We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of... ...for small businesses.As a Senior Software Engineer, you’ll be responsible... ...models that power internal dashboards, ML models, and customer-facing...SeniorFlexible hours
$165k - $185k
...learn more, go to . THE ROLEAs a Senior Data Platform Engineer, you will build and operate the data infrastructure that supports Zeta’s products... ...for trusted reporting, ML models, and AI agents. Evaluate... ...sessions. QUALIFICATIONS7+ years of software engineering experience....SeniorWork at office$165k - $226.6k
...potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era.... ..., and transform their users’ experiences. Okta's Core Engineering team is responsible for building and evolving shared...SeniorPermanent employmentWork at officeLocal areaWorldwideFlexible hours$170k - $205k
...only vertically integrated AI infrastructure company built from the... ...Role:Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire... ...Engineering Teams: Partner with software engineers, data scientists,... ...infrastructure for AI/ML workloads or cloud computing...SeniorFull timeTemporary workWork at officeRemote work$210k - $300k
...are a hardcore and obsessed team of the world's best engineers and operators. If you are obsessed with your craft, enjoy... ...agency. About the Role We're looking for a Software Engineer to join our ML Infrastructure team. In this role, you'll help build the training...SeniorLocal areaFlexible hours$170k - $205k
...As the only vertically integrated AI infrastructure company built from the ground up, we... ...team seeks an ambitious and experienced Senior Software Engineer to join their team. You'll have a... ...early-stage projects quickly. ~ AI/ML Expertise: Experience with Generative...SeniorFull timeTemporary workWork at office- Role SummaryWe have an opening for a Senior Software Infrastructure Engineer in our Infrastructure team focused on driving technical strategy, alignment and execution of projects across compute, networking, cloud orchestration, and observability. This is an opportunity...Senior
- ...and secure, scalable backend infrastructure for automating customer... ...product teams, and strengthen engineering quality through reviews, mentoring... ...: Requires 5+ years of software engineering experience building... ...LLM applications or AI/ML systems in production. Candidates...Senior
$166k - $225k
...running the world's best data and AI infrastructure platform so our customers can use deep... ...to improve their business. Founded by engineers — and customer obsessed — we leap at every... .... And we're only getting started.As a Senior Software Engineer on the Infrastructure teams,...SeniorLocal areaWorldwide$180k - $250k
...obsessed team of the world's best engineers and operators. If you are... ...We are looking for a Senior Software Engineer to join our Robotics... ...Collaborate with robotics, ML, and product teams to define... ...multi-agent systems, cloud infrastructures, internal tooling, and robot...SeniorLocal areaFlexible hours$230k
This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running... ...caching Much more!About the RoleAs an engineer within Fleet infrastructure, you will design... ...a bonus, have an understanding of AI/ML workloadsAbout OpenAIOpenAI is an AI...Work at officeLocal areaRelocation packageFlexible hours$250k - $300k
...-$300,000 / yearSoftware Engineer - Growth InfrastructureJob... ...? We are looking for a Software Engineer - Growth Infrastructure for our client in San Francisco... ...path toward building the ML-driven recommendation... ...bias toward ownership.Seniority: 2-5 years of experience...Full timeInternshipVisa sponsorship$293k - $385k
About the TeamThe GPT Infrastructure team builds systems that turn advances... ...and runtimes, performance engineering, secure partner integrations... ...the RoleWe are seeking a software engineer to help build the platform... ...inference, distributed ML systems, or inference-...Work at officeLocal areaRemote workFlexible hours$230k - $390k
...and design teams for Google Workspace.What you’ll doAs a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building... ...that leverage distributed databases, retrieval systems, and ML models.Develop and maintain core data serving abstractions...Full timeFlexible hours$245.4k - $429.45k
...our recruiting process here.Sr. Staff Software Engineer, Product ML InfrastructureMillions of people... ...collaborate with AI.Pinterest’s Product ML Infrastructure (PMLI) team enables fast, safe, and... ..., and operational standards; mentor senior engineers and raise the engineering...SeniorWork at officeLocal areaRemote workRelocationRelocation package$148.5k - $223.9k
...generation Ingress Gateway control and data planes, transforming the software stack to adopt cloud-native primitives, and contributing to... .... The team seeks experienced distributed systems software engineers passionate about new challenges and capable of owning significant...SeniorFull time$180.5k - $236.91k
Hi, we're Oscar. We're hiring a Senior Software Engineer, Cloud Infrastructure / SRE to join our Engineering team.Oscar is the first health insurance company built around a full stack technology platform and a relentless focus on serving our members. We started Oscar in...SeniorFull timeWork at officeRemote work$15k
...have led our industry and worked at the frontier of applying AI/ML to investment management. We have become a multibillion-dollar... ...office, daily catered lunches, and more.Strategy Platform owns the infrastructure between quantitative research and live trading. Our systems...SeniorWork at officeLocal area$149.9k - $270k
...diverse, world-class team—engineers, designers,... ...work.About The RoleAs a Senior Platform Engineer at HP... ...build and evolve the infrastructure, tooling, and shared platform... ..., services, AI/ML, and security teams to... ...observability practices.Strong software development and...SeniorFull timeTemporary workLocal areaFlexible hours$178.88k - $320.65k
...Autodesk is seeking a passionate and experienced Software Architect to lead our skilled team of software and ML engineers in the design, development, and execution of... ...management, data science, data, and cloud infrastructure to define and execute the AI/ML platform roadmapProvide...SeniorFull timeTemporary workFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer - ML Infrastructure. Be the first to apply!
- scientific software engineer San Francisco, CA
- intel software engineer San Francisco, CA
- director software engineering San Francisco, CA
- software engineer San Francisco, CA
- software engineer student San Francisco, CA
- senior robotics software engineer San Francisco, CA
- financial software developer San Francisco, CA
- graduate software developer San Francisco, CA
- part time software developer remote San Francisco, CA
- software engineer remote San Francisco, CA



