Software Engineer - ML Infrastructure
S.e. Specter
Company Background
Specter is creating a software-defined "control plane" for the physical world. We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets.
To do so, we are creating a connected hardware-software ecosystem on top of multi-modal wireless mesh sensing technology. This allows us to drive down the cost and time of deploying sensors by 10x. Our platform will ultimately become the perception engine for a company's physical footprint, enabling real-time perimeter visibility and autonomous operations management.
Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast-approaching world of physical AI and robotics. We are a small, fast-growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces.
Role + Responsibilities
Specter is hiring an ML infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment, and optimization of computer vision and sensor fusion models that enable autonomous monitoring and decision-making for our customers' physical assets.
Key responsibilities include:
Designing and implementing scalable ML training pipelines for computer vision models (object detection, tracking, classification, segmentation).
Building efficient model serving infrastructure for real-time inference on edge devices with constrained compute and power budgets.
Optimizing models for deployment on embedded hardware (quantization, pruning, TensorRT, ONNX, CoreML).
Developing continuous training and evaluation systems to improve model performance from production data feedback loops.
Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal).
Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems.
Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes.
Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking.
Preferred Qualifications
Strong experience with ML frameworks (PyTorch, TensorFlow) and model optimization tools (TensorRT, ONNX Runtime, OpenVINO).
Deep understanding of computer vision architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking).
Hands-on experience deploying models on edge devices (NVIDIA Jetson, ARM processors, or similar embedded platforms).
Expertise building MLOps infrastructure — experiment tracking (Weights & Biases, MLflow), feature stores, model registries, CI/CD for ML.
Experience with distributed training frameworks (PyTorch DDP, DeepSpeed, Ray) and GPU cluster management.
Strong software engineering skills in Python and systems languages (C++, Rust) for performance-critical inference code.
Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.
Prior experience in robotics, autonomous systems, or real-time ML applications is highly valued.
$293k - $385k
About the TeamThe GPT Infrastructure team builds systems that turn advances... ...and runtimes, performance engineering, secure partner integrations... ...the RoleWe are seeking a software engineer to help build the platform... ...inference, distributed ML systems, or inference-...SuggestedWork at officeLocal areaRemote workFlexible hours$140k - $225k
...assembling a diverse, world-class team—engineers, designers, researchers, and... ...work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role in... ...a plusFamiliarity with ML Usage. Some familiarity with how...SuggestedFull timeTemporary workLocal areaFlexible hours$230k - $390k
...and design teams for Google Workspace. What you’ll doAs a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building... ...that leverage distributed databases, retrieval systems, and ML models.Develop and maintain core data serving abstractions...SuggestedFull timeFlexible hours$230k
This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running... ...caching Much more!About the RoleAs an engineer within Fleet infrastructure, you will design... ...a bonus, have an understanding of AI/ML workloadsAbout OpenAIOpenAI is an AI...SuggestedWork at officeLocal areaRelocation packageFlexible hours- ...Platform and builds the shared infrastructure that helps DoorDash, Wolt,... ...model serving and inference engines, fine-tuning and training pipelines... ...the technical bar for — ML engineers, product engineers,... ...years of industry experience in software engineeringDeep backend...SuggestedHourly payWork at officeLocal areaRemote workFlexible hours
$193.93k - $291.15k
...Senior Software Engineer, ML Infrastructure Mountain View, California (HQ) Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier...Immediate startFlexible hours- ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple...Work at officeFlexible hours
- ...Senior Software Engineer (ML Infrastructure) Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems...Permanent employment
$200k - $250k
...we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in designing... ...Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background...InternshipRelocation package$153k - $376k
...foundational systems that power analytics, AI/ML, and data-driven decision-making across... ...AI researchers, machine learning engineers, data scientists, product engineers, and... ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing...Minimum wageFull timeLocal areaRemote workFlexible hours$185k - $385k
...and Flink; provide orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is to deliver... ...products, research, and analytics.We’re not just scaling infrastructure - we’re redefining how people interact with data. Our vision...Work at officeLocal areaRelocation packageFlexible hours$170k - $216k
...S. states. The Simulation Infrastructure team creates reliable, scalable... ...evaluate the Waymo Driver's software stack at a massive scale. We... ...range of customers Software Engineers, Product, Data Science, System... ...will: Build and evolve ML inference infrastructure for...Full timeRemote work$176k - $220k
...institutions Work together with engineers, scientists, operators, and more from... ...AI Human data is the core infrastructure to AI advancement. Frontier AI labs... ...the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This...Full timeWork at officeRemote workFlexible hours- ...applied AI research, flexible infrastructure, and seamless developer tooling... ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Software Engineer at on the Training Infrastructure... ...systems for our ML training platform (e.g. scheduling...Full timeFlexible hours
- ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning... ...of AI. The Role As a Software Engineer on our... ...Points Experience with AI/ML workloads and infrastructure....Full timeWork at officeWork from home1 day per week
$145.4k - $188.1k
...About the Machine Learning Infrastructure Team At Thumbtack, our challenges... ...detection, and more. The ML Infrastructure team is... ...experiences. We empower product engineering teams by providing scalable,... ...The challenge As a Software Engineer on the ML Infrastructure...Full timeSeasonal workLocal area$215k - $265k
...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of... .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,... ...or building platforms that support AI/ML workflows Familiarity with GPU workloads...Full timeWork experience placementWork at officeImmediate startVisa sponsorshipFlexible hours- ...our team! Why Join Us The Platform Engineering organization at Rad AI builds the... ...safely, and at scale. Within Platform, the Infrastructure team owns our core cloud infrastructure,... ...leadership, product engineering, data, and ML teams to design systems that are robust,...Full timeWork at officeRemote workFlexible hours
- Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform... ...non-engineers to build and manage data and ML pipelines. Establish monitoring,...Work at office3 days per week
- ...role Your role, should you choose to join us, will be as an Infrastructure / Backend Engineer on our founding team. You're the right person for this... ...likely have: Experience deploying and productionizing ML or AI-heavy workloads Expertise in building secure,...Full time
$200k - $250k
...office. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at Altruist... ...expertise with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure operations,...Work at officeImmediate start3 days per week- ...expertise in model innovation and systems engineering paired with a design-minded product... ...models, and we are looking for a TLM, Data Infrastructure to own the strategy and execution for all... ...team of engineers building dataset and ML data infrastructure. Design and operate...Work at officeVisa sponsorshipFlexible hours
$160k - $225k
...Us Build and scale the foundational data infrastructure powering a category-defining product Work closely with engineering, data science, and product teams to operationalize... .... You’ll collaborate closely with data and ML teams and contribute to the systems that...Full timeWork experience placementRelocation packageFlexible hours$160k - $225k
...Us Build and scale the foundational data infrastructure powering a category-defining product Work closely with engineering, data science, and product teams to operationalize... ...scientists and engineers to productionize ML and analytics workflows Contribute to...Full timeWork experience placementRelocation packageFlexible hours- ...computing and make it accessible to software developers of all skill levels. We’re... ...developer or data scientist can scale an ML application from their laptop to the... ...Anyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next...Full time
$162k - $216k
...Software Engineer - Infrastructure, Data Platform San Francisco, California, United States Who We Are Baton is Ryder's in-house product development... ...with data stakeholders across engineering, product, and ML to translate complex data challenges into scalable,...Full timeWork at officeImmediate startRemote workMonday to Friday$230k - $385k
About the TeamThe Agent Infrastructure team at OpenAI is responsible for building systems that... ...code, debug issues, and develop software just as human SWEs do. Our training environment... ...the world.About the RoleAs a Software Engineer on the Agent Infrastructure team, you...Work at officeLocal areaWorldwideRelocation packageFlexible hours$190k - $270k
Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed with enabling... ...a Staff Software Engineer, AI Research Infrastructure, you will be developing and running the... ...closely with research scientists, ML engineers, and platform teams to turn...Local areaWorldwide$229k - $343k
...scaling the critical Service Infrastructure that powers Snap's entire backend... ..., Content Feed, Growth, Ads, ML Platform, Maps, and Media... ...scale.This role is for a backend engineer focused on Service & Compute... ...experience.9+ years of software development experience; or a...Full timeLive inWork at officeLocal area- ...reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant... ...tenant scheduling, and end-user tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will set the technical direction for...Hourly payWork at officeLocal areaRemote workRelocationFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - ML Infrastructure. Be the first to apply!
- software engineer internship San Francisco, CA
- software development engineer aws San Francisco, CA
- software developer internship no experience San Francisco, CA
- real time software engineer San Francisco, CA
- financial software developer San Francisco, CA
- part time software developer San Francisco, CA
- graduate software developer San Francisco, CA
- software engineer travel San Francisco, CA
- experienced software developer San Francisco, CA
- remote entry level software developer San Francisco, CA


