Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - ML Infrastructure

Full-time

S.e. Specter

Company Background
Specter is creating a software-defined "control plane" for the physical world. We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets.

To do so, we are creating a connected hardware-software ecosystem on top of multi-modal wireless mesh sensing technology. This allows us to drive down the cost and time of deploying sensors by 10x. Our platform will ultimately become the perception engine for a company's physical footprint, enabling real-time perimeter visibility and autonomous operations management.

Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast-approaching world of physical AI and robotics. We are a small, fast-growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces.

Role + Responsibilities
Specter is hiring an ML infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment, and optimization of computer vision and sensor fusion models that enable autonomous monitoring and decision-making for our customers' physical assets.

Key responsibilities include:

  • Designing and implementing scalable ML training pipelines for computer vision models (object detection, tracking, classification, segmentation).

  • Building efficient model serving infrastructure for real-time inference on edge devices with constrained compute and power budgets.

  • Optimizing models for deployment on embedded hardware (quantization, pruning, TensorRT, ONNX, CoreML).

  • Developing continuous training and evaluation systems to improve model performance from production data feedback loops.

  • Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal).

  • Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems.

  • Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes.

  • Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking.

Preferred Qualifications

  • Strong experience with ML frameworks (PyTorch, TensorFlow) and model optimization tools (TensorRT, ONNX Runtime, OpenVINO).

  • Deep understanding of computer vision architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking).

  • Hands-on experience deploying models on edge devices (NVIDIA Jetson, ARM processors, or similar embedded platforms).

  • Expertise building MLOps infrastructure — experiment tracking (Weights & Biases, MLflow), feature stores, model registries, CI/CD for ML.

  • Experience with distributed training frameworks (PyTorch DDP, DeepSpeed, Ray) and GPU cluster management.

  • Strong software engineering skills in Python and systems languages (C++, Rust) for performance-critical inference code.

  • Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.

  • Prior experience in robotics, autonomous systems, or real-time ML applications is highly valued.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - ML Infrastructure in San Francisco, CA vacancy
  • $293k - $385k

    About the TeamThe GPT Infrastructure team builds systems that turn advances...  ...and runtimes, performance engineering, secure partner integrations...  ...the RoleWe are seeking a software engineer to help build the platform...  ...inference, distributed ML systems, or inference-... 
    Suggested
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $140k - $225k

     ...assembling a diverse, world-class team—engineers, designers, researchers, and...  ...work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role in...  ...a plusFamiliarity with ML Usage. Some familiarity with how... 
    Suggested
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    23 hours ago
  • $230k - $390k

     ...and design teams for Google Workspace. What you’ll doAs a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building...  ...that leverage distributed databases, retrieval systems, and ML models.Develop and maintain core data serving abstractions... 
    Suggested
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    4 days ago
  • $230k

    This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running...  ...caching Much more!About the RoleAs an engineer within Fleet infrastructure, you will design...  ...a bonus, have an understanding of AI/ML workloadsAbout OpenAIOpenAI is an AI... 
    Suggested
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  •  ...Platform and builds the shared infrastructure that helps DoorDash, Wolt,...  ...model serving and inference engines, fine-tuning and training pipelines...  ...the technical bar for — ML engineers, product engineers,...  ...years of industry experience in software engineeringDeep backend... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago
  • $193.93k - $291.15k

     ...Senior Software Engineer, ML Infrastructure Mountain View, California (HQ) Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier... 
    Immediate start
    Flexible hours

    Nuro

    San Francisco, CA
    4 days ago
  •  ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple... 
    Work at office
    Flexible hours

    Voxel Labs

    San Francisco, CA
    1 day ago
  •  ...Senior Software Engineer (ML Infrastructure) Arena Intelligence is seeking a Senior Software Engineer (ML Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you'll architect systems... 
    Permanent employment

    Arena AI

    San Francisco, CA
    4 days ago
  • $200k - $250k

     ...we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in designing...  ...Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background... 
    Internship
    Relocation package

    Harvey

    San Francisco, CA
    4 days ago
  • $153k - $376k

     ...foundational systems that power analytics, AI/ML, and data-driven decision-making across...  ...AI researchers, machine learning engineers, data scientists, product engineers, and...  ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    San Francisco, CA
    2 days ago
  • $185k - $385k

     ...and Flink; provide orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is to deliver...  ...products, research, and analytics.We’re not just scaling infrastructure - we’re redefining how people interact with data. Our vision... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • $170k - $216k

     ...S. states. The Simulation Infrastructure team creates reliable, scalable...  ...evaluate the Waymo Driver's software stack at a massive scale. We...  ...range of customers Software Engineers, Product, Data Science, System...  ...will: Build and evolve ML inference infrastructure for... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  • $176k - $220k

     ...institutions Work together with engineers, scientists, operators, and more from...  ...AI Human data is the core infrastructure to AI advancement. Frontier AI labs...  ...the Role We’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    6 days ago
  •  ...applied AI research, flexible infrastructure, and seamless developer tooling...  ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Software Engineer at on the Training Infrastructure...  ...systems for our ML training platform (e.g. scheduling... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    2 days ago
  •  ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning...  ...of AI. The Role As a Software Engineer on our...  ...Points Experience with AI/ML workloads and infrastructure.... 
    Full time
    Work at office
    Work from home
    1 day per week

    Runloop

    San Francisco, CA
    2 days ago
  • $145.4k - $188.1k

     ...About the Machine Learning Infrastructure Team At Thumbtack, our challenges...  ...detection, and more. The ML Infrastructure team is...  ...experiences. We empower product engineering teams by providing scalable,...  ...The challenge As a Software Engineer on the ML Infrastructure... 
    Full time
    Seasonal work
    Local area

    Thumbtack

    San Francisco, CA
    2 days ago
  • $215k - $265k

     ...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of...  .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,...  ...or building platforms that support AI/ML workflows Familiarity with GPU workloads... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    Apollo Research

    San Francisco, CA
    2 days ago
  •  ...our team! Why Join Us The Platform Engineering organization at Rad AI builds the...  ...safely, and at scale. Within Platform, the Infrastructure team owns our core cloud infrastructure,...  ...leadership, product engineering, data, and ML teams to design systems that are robust,... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Rad Ai

    San Francisco, CA
    2 days ago
  • Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform...  ...non-engineers to build and manage data and ML pipelines. Establish monitoring,... 
    Work at office
    3 days per week

    Claryo

    San Francisco, CA
    3 days ago
  •  ...role Your role, should you choose to join us, will be as an Infrastructure / Backend Engineer on our founding team. You're the right person for this...  ...likely have: Experience deploying and productionizing ML or AI-heavy workloads Expertise in building secure,... 
    Full time

    Vooma

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...office. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at Altruist...  ...expertise with the vision and initiative to define how AI/ML tools and patterns can transform infrastructure operations,... 
    Work at office
    Immediate start
    3 days per week

    Altruist

    San Francisco, CA
    1 day ago
  •  ...expertise in model innovation and systems engineering paired with a design-minded product...  ...models, and we are looking for a TLM, Data Infrastructure to own the strategy and execution for all...  ...team of engineers building dataset and ML data infrastructure. Design and operate... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia, Inc.

    San Francisco, CA
    4 days ago
  • $160k - $225k

     ...Us Build and scale the foundational data infrastructure powering a category-defining product Work closely with engineering, data science, and product teams to operationalize...  .... You’ll collaborate closely with data and ML teams and contribute to the systems that... 
    Full time
    Work experience placement
    Relocation package
    Flexible hours

    Fable Security

    San Francisco, CA
    2 days ago
  • $160k - $225k

     ...Us Build and scale the foundational data infrastructure powering a category-defining product Work closely with engineering, data science, and product teams to operationalize...  ...scientists and engineers to productionize ML and analytics workflows Contribute to... 
    Full time
    Work experience placement
    Relocation package
    Flexible hours

    Fable Security

    San Francisco, CA
    2 days ago
  •  ...computing and make it accessible to software developers of all skill levels. We’re...  ...developer or data scientist can scale an ML application from their laptop to the...  ...Anyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next... 
    Full time

    Anyscale

    San Francisco, CA
    2 days ago
  • $162k - $216k

     ...Software Engineer - Infrastructure, Data Platform San Francisco, California, United States Who We Are Baton is Ryder's in-house product development...  ...with data stakeholders across engineering, product, and ML to translate complex data challenges into scalable,... 
    Full time
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Baton

    San Francisco, CA
    3 days ago
  • $230k - $385k

    About the TeamThe Agent Infrastructure team at OpenAI is responsible for building systems that...  ...code, debug issues, and develop software just as human SWEs do. Our training environment...  ...the world.About the RoleAs a Software Engineer on the Agent Infrastructure team, you... 
    Work at office
    Local area
    Worldwide
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    23 hours ago
  • $190k - $270k

    Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed with enabling...  ...a Staff Software Engineer, AI Research Infrastructure, you will be developing and running the...  ...closely with research scientists, ML engineers, and platform teams to turn... 
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  • $229k - $343k

     ...scaling the critical Service Infrastructure that powers Snap's entire backend...  ..., Content Feed, Growth, Ads, ML Platform, Maps, and Media...  ...scale.This role is for a backend engineer focused on Service & Compute...  ...experience.9+ years of software development experience; or a... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    San Francisco, CA
    2 days ago
  •  ...reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant...  ...tenant scheduling, and end-user tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will set the technical direction for... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Doordash

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - ML Infrastructure. Be the first to apply!