Software Engineer - ML Infrastructure
Specter
Company Background Specter is creating a software-defined "control plane" for the physical world. We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets. To do so, we are creating a connected hardware-software ecosystem on top of multi-modal wireless mesh sensing technology. This allows us to drive down the cost and time of deploying sensors by 10x. Our platform will ultimately become the perception engine for a company's physical footprint, enabling real-time perimeter visibility, autonomous operations management, and "digital twinning" of physical processes. Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast-approaching world of physical AI and robotics. We are a small, fast-growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces. Role + Responsibilities Specter is hiring an ML infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment, and optimization of computer vision and sensor fusion models that enable autonomous monitoring and decision-making for our customers' physical assets. Key responsibilities include: Designing and implementing scalable ML training pipelines for computer vision models (object detection, tracking, classification, segmentation). Building efficient model serving infrastructure for real-time inference on edge devices with constrained compute and power budgets. Optimizing models for deployment on embedded hardware (quantization, pruning, TensorRT, ONNX, CoreML). Developing continuous training and evaluation systems to improve model performance from production data feedback loops. Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal). Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems. Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes. Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking. Preferred Qualifications Strong experience with ML frameworks (PyTorch, TensorFlow) and model optimization tools (TensorRT, ONNX Runtime, OpenVINO). Deep understanding of computer vision architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking). Hands-on experience deploying models on edge devices (NVIDIA Jetson, ARM processors, or similar embedded platforms). Expertise building MLOps infrastructure — experiment tracking (Weights & Biases, MLflow), feature stores, model registries, CI/CD for ML. Experience with distributed training frameworks (PyTorch DDP, DeepSpeed, Ray) and GPU cluster management. Strong software engineering skills in Python and systems languages (C++, Rust) for performance-critical inference code. Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus. Prior experience in robotics, autonomous systems, or real-time ML applications is highly valued. #J-18808-Ljbffr Specter
- ...About the role We are hiring an engineer obsessed with building systems and infrastructure that are as simple as possible while... ...love, moved and scaled AI/ML systems into production, and can... ...AI technology. You should have: Software experience: Bachelor’s degree or...SuggestedFull timeWork at officeFlexible hours
- ...and design teams for Google Workspace. What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building... ...leverage distributed databases, retrieval systems, and ML models. Develop and maintain core data serving abstractions...SuggestedFull timeFlexible hours
- ...pioneering the next generation of AI-driven software engineering. Our platform empowers developers to... ...Role As a Software Engineer on our Infrastructure team, you'll play a pivotal role in... ...systems. Bonus Points Experience with AI/ML workloads and infrastructure....SuggestedWork at officeWork from home1 day per week
$200k - $280k
...SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE Build the core infrastructure that powers petabyte-scale data collection and delivery for the world's leading... ...NICE TO HAVE Experience with robotics, computer vision, or ML infrastructure Background in video processing or real-time...SuggestedHome office- ...applied AI lab building a search engine unlike the world has ever... ...want to build massive-scale ML systems that will define the... ...is the place for you. Our Infrastructure Team builds the underlying tooling... ...our agent fleet Automate software maintenance and improvements...SuggestedH1b
- ...just as language models are changing how engineers write code. Our vision is a design suite... ...obsessed with building systems and infrastructure that are as simple as possible while being... ...that developers love, moved and scaled AI/ML systems into production, and can help us...Flexible hours
$168k - $213k
...Senior Infrastructure Engineer Bretton AI is the leading AI agent platform for financial services. Companies like Robinhood, Mercury, and Gusto... ...for highly regulated industries. Experience with AI/ML infrastructure and model deployment at scale. Why You'll...Flexible hours- ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple...Work at officeFlexible hours
$200k - $400k
...as a team. About the Team The Infrastructure team builds and operates the foundations that power Decagon: networking, data, ML serving, developer platform, and realtime... ...We're hiring a Senior Infrastructure Engineer to design, build, and operate production...Full timeWork at officeLocal area$200k - $250k
...and we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in... ...to Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background...InternshipRelocation package$250k - $330k
...work and grow as a team. About the Team The Infrastructure team builds and operates the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑... ...Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production...Work at office$150k - $250k
...As a founding member of our engineering team, you will have a direct... ...isn’t just “models.” It’s the software layer that turns: Orders →... ...the backend systems and infrastructure that power the factory of the... ...between factory floor and cloud ML Infrastructure & Data...Full timeContract work- Software Engineer (AI Infrastructure / Training / Inference) About the Role We are hiring Software Engineers focused on AI Infrastructure to build the... ...or container orchestration. Familiarity with GPU-based ML workloads or distributed training/inference systems. Experience...
$215k - $265k
...scheming mitigations. We’re looking for a Software Engineer to build the platform that the rest of... .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,... ...or building platforms that support AI/ML workflows Familiarity with GPU workloads...Full timeWork experience placementWork at officeImmediate startVisa sponsorshipFlexible hours- ...functional group working across engineering, product, research, and design... ...’re looking for an experienced Software Engineer to help build the machine learning infrastructure that powers OpenAI’s monetization... .... You’ll work across the full ML lifecycle, from large-scale...
- Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform... ...non-engineers to build and manage data and ML pipelines. Establish monitoring,...Work at office3 days per week
- ...applied AI research, flexible infrastructure, and seamless developer tooling... ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Software Engineer - Model Training at Baseten... ...5+ years of experience in ML infrastructure, distributed...Flexible hours
- ...on our team! Why Join Us The Platform Engineering organization at Rad AI builds the foundations... ..., and at scale. Within Platform, the Infrastructure team owns our core cloud infrastructure,... ..., product engineering, data, and ML teams to design systems that are robust,...Full timeWork at officeFlexible hours
- ...revenue The Role Handshake is building the infrastructure layer that powers the next generation... ...across our platform. As a Senior Software Engineer on our Agentic Infrastructure team, you... ...engineer to build with AI Partner with ML, product, & platform engineers to ship...Full timeFreelanceInternshipWork at officeRemote workFlexible hours
- ...applied AI research, flexible infrastructure, and seamless developer... ...and help build the platform engineers turn to to ship AI products.... ...THE ROLE As an Infrastructure Software Engineer at Baseten, you'll build... ...and maintain components of our ML inference platform that powers...Flexible hours
$150k - $300k
Founding Software Engineer - Backend and Infrastructure San Francisco | In office | Full-time We are hiring a Founding Software Engineer in San Francisco.... ...An ownership mindset Nice to have: Experience serving ML / VLM / GPU‑heavy workloads Compensation: $150k - $300...Full timeWork at officeVisa sponsorship- ...running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive... .... About the Role We are looking for an engineer to design and implement the dataset... ...foundational (if not glamorous) part of the ML stack. Bonus points if you: Have background...
$200k - $400k
...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences... ...the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner...Full timeWork at officeLocal area- ...and guidance to teams across engineering, product, and business and... ...effectively. Engineers on Data Infrastructure are domain experts in Data... ...projects such as improving ML development golden paths, implementing... ...Qualifications 5+ years of software engineering experience...Work experience placementLocal area
- ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ...The Lambda Infrastructure Engineering organization forges the... ...seeking a seasoned Storage Software Engineer with experience designing... ...solutions to serve AI/ML workloads. Partner with the...Full timeWork at officeLocal areaWork from homeFlexible hours
- Senior Software Engineer, Infrastructure & Platform Role Overview: As a Senior Software Engineer, Infrastructure & Platform at AfterQuery, you will design... ...with AI infrastructure, LLM evaluation systems, or ML pipelines Experience working at high-growth startups or scaling...
- ...deep expertise in model innovation and systems engineering paired with a design‑minded product... ...lifeblood of our models, and we’re looking for a Software Engineer to help build the training data and ML data infrastructure at Cartesia. This role sits at the intersection...Work at officeVisa sponsorshipFlexible hours
$160k - $225k
...Join Us Build and scale the foundational data infrastructure powering a category‑defining product Work closely with engineering, data science, and product teams to... ...stack. You’ll collaborate closely with data and ML teams and contribute to the systems that ingest...Work experience placementRelocation packageFlexible hours$160k - $225k
...Join Us Build and scale the foundational data infrastructure powering a category‑defining product Work closely with engineering, data science, and product teams to... ...data scientists and engineers to productionise ML and analytics workflows Contribute to secure...Work experience placementRelocation packageFlexible hours$212k - $318.4k
Software Engineer, ML platform and Infrastructure San Francisco Bay Area, California, United States Software and Services The Applied Machine Learning team has been at the forefront of accelerating digital transformation through machine learning across Apple's enterprise...Relocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - ML Infrastructure. Be the first to apply!
- software sales engineer San Francisco, CA
- software engineer amazon San Francisco, CA
- software engineer student San Francisco, CA
- agile software developer San Francisco, CA
- rust software engineer San Francisco, CA
- software developer positions San Francisco, CA
- senior software design engineer San Francisco, CA
- software developer San Francisco, CA
- ngo software engineer San Francisco, CA
- startup software engineer San Francisco, CA

