Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - ML Infrastructure

Specter

Company Background Specter is creating a software-defined "control plane" for the physical world. We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets. To do so, we are creating a connected hardware-software ecosystem on top of multi-modal wireless mesh sensing technology. This allows us to drive down the cost and time of deploying sensors by 10x. Our platform will ultimately become the perception engine for a company's physical footprint, enabling real-time perimeter visibility, autonomous operations management, and "digital twinning" of physical processes. Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast-approaching world of physical AI and robotics. We are a small, fast-growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces. Role + Responsibilities Specter is hiring an ML infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment, and optimization of computer vision and sensor fusion models that enable autonomous monitoring and decision-making for our customers' physical assets. Key responsibilities include: Designing and implementing scalable ML training pipelines for computer vision models (object detection, tracking, classification, segmentation). Building efficient model serving infrastructure for real-time inference on edge devices with constrained compute and power budgets. Optimizing models for deployment on embedded hardware (quantization, pruning, TensorRT, ONNX, CoreML). Developing continuous training and evaluation systems to improve model performance from production data feedback loops. Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal). Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems. Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes. Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking. Preferred Qualifications Strong experience with ML frameworks (PyTorch, TensorFlow) and model optimization tools (TensorRT, ONNX Runtime, OpenVINO). Deep understanding of computer vision architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking). Hands-on experience deploying models on edge devices (NVIDIA Jetson, ARM processors, or similar embedded platforms). Expertise building MLOps infrastructure — experiment tracking (Weights & Biases, MLflow), feature stores, model registries, CI/CD for ML. Experience with distributed training frameworks (PyTorch DDP, DeepSpeed, Ray) and GPU cluster management. Strong software engineering skills in Python and systems languages (C++, Rust) for performance-critical inference code. Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus. Prior experience in robotics, autonomous systems, or real-time ML applications is highly valued. #J-18808-Ljbffr Specter

Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer - ML Infrastructure in San Francisco, CA vacancy
  •  ...About the role We are hiring an engineer obsessed with building systems and infrastructure that are as simple as possible while...  ...love, moved and scaled AI/ML systems into production, and can...  ...AI technology. You should have: Software experience: Bachelor’s degree or... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Menlo Ventures

    San Francisco, CA
    4 days ago
  •  ...and design teams for Google Workspace. What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building...  ...leverage distributed databases, retrieval systems, and ML models. Develop and maintain core data serving abstractions... 
    Suggested
    Full time
    Flexible hours

    Neura Market

    San Francisco, CA
    4 days ago
  •  ...pioneering the next generation of AI-driven software engineering. Our platform empowers developers to...  ...Role As a Software Engineer on our Infrastructure team, you'll play a pivotal role in...  ...systems. Bonus Points Experience with AI/ML workloads and infrastructure.... 
    Suggested
    Work at office
    Work from home
    1 day per week

    Runloop

    San Francisco, CA
    5 days ago
  • $200k - $280k

     ...SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE Build the core infrastructure that powers petabyte-scale data collection and delivery for the world's leading...  ...NICE TO HAVE Experience with robotics, computer vision, or ML infrastructure Background in video processing or real-time... 
    Suggested
    Home office

    Gerra Group

    San Francisco, CA
    2 days ago
  •  ...applied AI lab building a search engine unlike the world has ever...  ...want to build massive-scale ML systems that will define the...  ...is the place for you. Our Infrastructure Team builds the underlying tooling...  ...our agent fleet Automate software maintenance and improvements... 
    Suggested
    H1b

    Exa Corporation

    San Francisco, CA
    15 hours ago
  •  ...just as language models are changing how engineers write code. Our vision is a design suite...  ...obsessed with building systems and infrastructure that are as simple as possible while being...  ...that developers love, moved and scaled AI/ML systems into production, and can help us... 
    Flexible hours

    Chai Discovery

    San Francisco, CA
    5 days ago
  • $168k - $213k

     ...Senior Infrastructure Engineer Bretton AI is the leading AI agent platform for financial services. Companies like Robinhood, Mercury, and Gusto...  ...for highly regulated industries. Experience with AI/ML infrastructure and model deployment at scale. Why You'll... 
    Flexible hours

    Bretton

    San Francisco, CA
    5 days ago
  •  ...compliance, process efficiency. Every new use case runs through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models. You'll build systems that let our applied ML team train multiple... 
    Work at office
    Flexible hours

    Voxel Labs

    San Francisco, CA
    2 days ago
  • $200k - $400k

     ...as a team. About the Team The Infrastructure team builds and operates the foundations that power Decagon: networking, data, ML serving, developer platform, and realtime...  ...We're hiring a Senior Infrastructure Engineer to design, build, and operate production... 
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago
  • $200k - $250k

     ...and we're just getting started. Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a critical role in...  ...to Have Experience building infrastructure for AI/ML workloads or high-throughput inference systems Background... 
    Internship
    Relocation package

    Harvey

    San Francisco, CA
    5 days ago
  • $250k - $330k

     ...work and grow as a team. About the Team The Infrastructure team builds and operates the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑...  ...Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production... 
    Work at office

    Decagon

    San Francisco, CA
    3 days ago
  • $150k - $250k

     ...As a founding member of our engineering team, you will have a direct...  ...isn’t just “models.” It’s the software layer that turns: Orders →...  ...the backend systems and infrastructure that power the factory of the...  ...between factory floor and cloud ML Infrastructure & Data... 
    Full time
    Contract work

    Foundry Robotics Inc.

    San Francisco, CA
    2 days ago
  • Software Engineer (AI Infrastructure / Training / Inference) About the Role We are hiring Software Engineers focused on AI Infrastructure to build the...  ...or container orchestration. Familiarity with GPU-based ML workloads or distributed training/inference systems. Experience... 

    SpreeAI

    San Francisco, CA
    3 days ago
  • $215k - $265k

     ...scheming mitigations. We’re looking for a Software Engineer to build the platform that the rest of...  .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,...  ...or building platforms that support AI/ML workflows Familiarity with GPU workloads... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    COL Limited

    San Francisco, CA
    4 days ago
  •  ...functional group working across engineering, product, research, and design...  ...’re looking for an experienced Software Engineer to help build the machine learning infrastructure that powers OpenAI’s monetization...  .... You’ll work across the full ML lifecycle, from large-scale... 

    AI Chopping Block, Inc.

    San Francisco, CA
    5 days ago
  • Overview We\'re looking for a Staff Software Engineer - Computer Vision Deployment to build and scale the infrastructure that powers our AI-driven warehouse intelligence platform...  ...non-engineers to build and manage data and ML pipelines. Establish monitoring,... 
    Work at office
    3 days per week

    Claryo

    San Francisco, CA
    4 days ago
  •  ...applied AI research, flexible infrastructure, and seamless developer tooling...  ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Software Engineer - Model Training at Baseten...  ...5+ years of experience in ML infrastructure, distributed... 
    Flexible hours

    BaseTen

    San Francisco, CA
    1 day ago
  •  ...on our team! Why Join Us The Platform Engineering organization at Rad AI builds the foundations...  ..., and at scale. Within Platform, the Infrastructure team owns our core cloud infrastructure,...  ..., product engineering, data, and ML teams to design systems that are robust,... 
    Full time
    Work at office
    Flexible hours

    Rad AI

    San Francisco, CA
    5 days ago
  •  ...revenue The Role Handshake is building the infrastructure layer that powers the next generation...  ...across our platform. As a Senior Software Engineer on our Agentic Infrastructure team, you...  ...engineer to build with AI Partner with ML, product, & platform engineers to ship... 
    Full time
    Freelance
    Internship
    Work at office
    Remote work
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    5 days ago
  •  ...applied AI research, flexible infrastructure, and seamless developer...  ...and help build the platform engineers turn to to ship AI products....  ...THE ROLE As an Infrastructure Software Engineer at Baseten, you'll build...  ...and maintain components of our ML inference platform that powers... 
    Flexible hours

    Baseten

    San Francisco, CA
    3 days ago
  • $150k - $300k

    Founding Software Engineer - Backend and Infrastructure San Francisco | In office | Full-time We are hiring a Founding Software Engineer in San Francisco....  ...An ownership mindset Nice to have: Experience serving ML / VLM / GPU‑heavy workloads Compensation: $150k - $300... 
    Full time
    Work at office
    Visa sponsorship

    PassFort

    San Francisco, CA
    4 days ago
  •  ...running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive...  .... About the Role We are looking for an engineer to design and implement the dataset...  ...foundational (if not glamorous) part of the ML stack. Bonus points if you: Have background... 

    Slope

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences...  ...the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner... 
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    16 days ago
  •  ...and guidance to teams across engineering, product, and business and...  ...effectively. Engineers on Data Infrastructure are domain experts in Data...  ...projects such as improving ML development golden paths, implementing...  ...Qualifications 5+ years of software engineering experience... 
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    2 days ago
  •  ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of...  ...The Lambda Infrastructure Engineering organization forges the...  ...seeking a seasoned Storage Software Engineer with experience designing...  ...solutions to serve AI/ML workloads. Partner with the... 
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    18 hours ago
  • Senior Software Engineer, Infrastructure & Platform Role Overview: As a Senior Software Engineer, Infrastructure & Platform at AfterQuery, you will design...  ...with AI infrastructure, LLM evaluation systems, or ML pipelines Experience working at high-growth startups or scaling... 

    AfterQuery

    San Francisco, CA
    2 days ago
  •  ...deep expertise in model innovation and systems engineering paired with a design‑minded product...  ...lifeblood of our models, and we’re looking for a Software Engineer to help build the training data and ML data infrastructure at Cartesia. This role sits at the intersection... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia

    San Francisco, CA
    2 days ago
  • $160k - $225k

     ...Join Us Build and scale the foundational data infrastructure powering a category‑defining product Work closely with engineering, data science, and product teams to...  ...stack. You’ll collaborate closely with data and ML teams and contribute to the systems that ingest... 
    Work experience placement
    Relocation package
    Flexible hours

    Fable Security, LLC

    San Francisco, CA
    3 days ago
  • $160k - $225k

     ...Join Us Build and scale the foundational data infrastructure powering a category‑defining product Work closely with engineering, data science, and product teams to...  ...data scientists and engineers to productionise ML and analytics workflows Contribute to secure... 
    Work experience placement
    Relocation package
    Flexible hours

    Fable Security

    San Francisco, CA
    1 day ago
  • $212k - $318.4k

    Software Engineer, ML platform and Infrastructure San Francisco Bay Area, California, United States Software and Services The Applied Machine Learning team has been at the forefront of accelerating digital transformation through machine learning across Apple's enterprise... 
    Relocation

    Apple Inc.

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - ML Infrastructure. Be the first to apply!