Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - ML Infrastructure

Specter Services LLC

Company Background Specter is creating a software-defined "control plane" for the physical world. We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets. To do so, we are creating a connected hardware-software ecosystem on top of multi-modal wireless mesh sensing technology. This allows us to drive down the cost and time of deploying sensors by 10x. Our platform will ultimately become the perception engine for a company's physical footprint, enabling real-time perimeter visibility, autonomous operations management, and "digital twinning" of physical processes. Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast-approaching world of physical AI and robotics. We are a small, fast-growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces. Role + Responsibilities Specter is hiring an ML infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment, and optimization of computer vision and sensor fusion models that enable autonomous monitoring and decision-making for our customers' physical assets. Key responsibilities include: Designing and implementing scalable ML training pipelines for computer vision models (object detection, tracking, classification, segmentation). Building efficient model serving infrastructure for real-time inference on edge devices with constrained compute and power budgets. Optimizing models for deployment on embedded hardware (quantization, pruning, TensorRT, ONNX, CoreML). Developing continuous training and evaluation systems to improve model performance from production data feedback loops. Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal). Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems. Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes. Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking. Preferred Qualifications Strong experience with ML frameworks (PyTorch, TensorFlow) and model optimization tools (TensorRT, ONNX Runtime, OpenVINO). Deep understanding of computer vision architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking). Hands-on experience deploying models on edge devices (NVIDIA Jetson, ARM processors, or similar embedded platforms). Expertise building MLOps infrastructure — experiment tracking (Weights & Biases, MLflow), feature stores, model registries, CI/CD for ML. Experience with distributed training frameworks (PyTorch DDP, DeepSpeed, Ray) and GPU cluster management. Strong software engineering skills in Python and systems languages (C++, Rust) for performance-critical inference code. Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus. Prior experience in robotics, autonomous systems, or real-time ML applications is highly valued. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - ML Infrastructure in San Francisco, CA vacancy
  •  ...Senior Software Engineer, Tooling and Development Infrastructure Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global...  ...consumer electronics is a plus. Familiarity with ML usage – leveraging machine learning models in a product... 
    Suggested
    Full time
    Temporary work
    Local area
    Flexible hours

    Hp Iq

    San Francisco, CA
    1 day ago
  •  ...The Role Handshake is building the infrastructure layer that powers the next generation...  ...agents across our platform. As a Senior Software Engineer on our Agentic Infrastructure team, you...  ...engineer to build with AI Partner with ML, product, & platform engineers to ship... 
    Suggested
    Full time
    Freelance
    Internship
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    2 days ago
  • $150k - $250k

     ...As a founding member of our engineering team, you will have a direct...  ...isn't just "models." It's the software layer that turns:...  ...build the backend systems and infrastructure that power the factory of the...  ...factory floor and cloud ML Infrastructure & Data Systems... 
    Suggested
    Full time
    Contract work

    Foundry Robotics Inc

    San Francisco, CA
    2 days ago
  •  ...language models are changing how engineers write code. Our vision is a...  ...with building systems and infrastructure that are as simple as possible...  ...developers love, moved and scaled AI/ML systems into production, and...  .... You should have: Software experience: ~ Bachelor... 
    Suggested
    Flexible hours

    Chai Discovery, Inc

    San Francisco, CA
    1 day ago
  •  ...About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably...  ...orchestration. Familiarity with GPU-based ML workloads or distributed training/inference systems.... 
    Suggested
    Internship
    Immediate start

    SpreeAI

    San Francisco, CA
    3 days ago
  • $200k - $240k

     ...team is led by veteran operators and engineers, alumni of Sonos, Paypal, Tesla,...  ...The Role We're looking for a Software Engineer, Build Infrastructure and Test who thrives at the intersection...  ...tooling that empowers our software and ML engineers to build and test code... 
    Local area
    Remote work

    Sauron

    San Francisco, CA
    2 days ago
  • $168k - $213k

     ...Netflix, Stripe, Plaid, and more. The Role As a Senior Infrastructure Engineer , you will own the foundation that enables us to deploy...  ...systems for highly regulated industries. Experience with AI/ML infrastructure and model deployment at scale. Why You'll... 
    Flexible hours

    Bretton AI

    San Francisco, CA
    1 day ago
  • $204k - $259k

     ...Senior Software Engineer, Simulation ML Infrastructure Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    4 days ago
  • $215k - $265k

     ...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of...  .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking,...  ...or building platforms that support AI/ML workflows Familiarity with GPU workloads... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    Apollo Research

    San Francisco, CA
    4 days ago
  • $170k - $216k

     ...states. The Simulation Infrastructure team creates reliable, scalable...  ...evaluate the Waymo Driver's software stack at a massive scale. We...  ...range of customers Software Engineers, Product, Data Science, System...  ...will: Build and evolve ML inference infrastructure for... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  •  ...Whatnot updates on our news and engineering blogs and join us as we enable...  ...to shape the future of AI and ML at Whatnot. You’ll design and scale the core infrastructure that powers machine learning...  ...work experience. ~3+ years of software engineering experience building... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    Whatnot

    San Francisco, CA
    3 days ago
  • $293k

    Software Engineer, Monetization ML Infrastructure Applied AI Engineering - San Francisco About the Team The Monetization team is a new cross‑functional group working across engineering, product, research, and design to build the foundational systems that will help OpenAI... 

    OpenAI

    San Francisco, CA
    21 hours ago
  • $200k - $280k

    SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE Build the core infrastructure that powers petabyte-scale data collection and delivery for the world's leading...  ...NICE TO HAVE Experience with robotics, computer vision, or ML infrastructure Background in video processing or real-... 
    Home office

    Gerra Group

    San Francisco, CA
    2 days ago
  • $250k - $330k

     ...and grow as a team. About the Team The Infrastructure team builds and operates the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time...  ...Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production... 
    Work at office

    Decagon

    San Francisco, CA
    2 days ago
  •  ...pioneering the next generation of AI-driven software engineering. Our platform empowers developers to...  ...Role As a Software Engineer on our Infrastructure team, you'll play a pivotal role in...  ...systems. Bonus Points Experience with AI/ML workloads and infrastructure.... 
    Work at office
    Work from home
    1 day per week

    Runloop

    San Francisco, CA
    2 days ago
  • $191k - $223k

     .... Our team sits at the intersection of Quality Engineering, Infrastructure, and Applied AI . We are evolving how software quality is built by integrating LLMs, intelligent...  ..., with exposure to or strong interest in AI/ML or LLM-based systems. Quality / DexEx/ Tooling... 
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    Nerdleveltech

    San Francisco, CA
    2 days ago
  •  ...on our team! Why Join Us The Platform Engineering organization at Rad AI builds the foundations...  ..., and at scale. Within Platform, the Infrastructure team owns our core cloud infrastructure,...  ..., product engineering, data, and ML teams to design systems that are robust,... 
    Full time
    Work at office
    Flexible hours

    Rad AI

    San Francisco, CA
    21 hours ago
  •  ...applied AI research, flexible infrastructure, and seamless developer...  ...and help build the platform engineers turn to to ship AI products....  ...THE ROLE As an Infrastructure Software Engineer at Baseten, you'll build...  ...and maintain components of our ML inference platform that powers... 
    Flexible hours

    Baseten

    San Francisco, CA
    3 days ago
  •  ...applied AI research, flexible infrastructure, and seamless developer tooling...  ...and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Software Engineer - Model Training at Baseten...  ...5+ years of experience in ML infrastructure, distributed... 
    Flexible hours

    BaseTen

    San Francisco, CA
    1 day ago
  • $160k - $230k

     ...Senior Software Engineer - Together Cloud Infrastructure Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative...  ...fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables... 
    Full time
    Work at office
    Remote work

    Together AI

    San Francisco, CA
    2 days ago
  • $160k - $225k

     ...placing the best product managers, software, and hardware talent at innovative companies...  ...to help them hire. Software Engineer - Platform / Infrastructure Location: San Francisco, CA (...  ...Collaborate closely with data and ML teams Support production data ingestion... 
    Work at office
    Remote work
    Flexible hours

    Recruiting from Scratch

    San Francisco, CA
    2 days ago
  • $160k - $225k

     ...Us Build and scale the foundational data infrastructure powering a category-defining product Work closely with engineering, data science, and product teams to operationalize...  ...scientists and engineers to productionize ML and analytics workflows Contribute to... 
    Work experience placement
    Relocation package
    Flexible hours

    Fable

    San Francisco, CA
    21 hours ago
  • $250k - $380k

     ...running OpenAI's LLM training and inference infrastructure that powers frontier models at massive...  ...About the Role We are looking for an engineer to design and implement the dataset infrastructure...  ...(if not glamorous) part of the ML stack. Bonus points if you:... 

    OpenAI

    San Francisco, CA
    4 days ago
  • $200k - $400k

     ...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences...  ...the foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time voice. We partner... 
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago
  • $176k - $230k

     ...progress. Over the last decade, software has transformed the digital...  ...scale. We are roboticists, engineers, operators, and builders. We...  ...the Machine Learning and AI Infrastructure team, which is focused on providing...  ...and other engineers to use ML and AI technologies... 
    Full time
    Temporary work
    Work at office
    Flexible hours

    ATOMS Careers page

    San Francisco, CA
    1 day ago
  • $160k - $225k

     ...Join Us Build and scale the foundational data infrastructure powering a category‑defining product Work closely with engineering, data science, and product teams to...  ...stack. You’ll collaborate closely with data and ML teams and contribute to the systems that ingest... 
    Work experience placement
    Relocation package
    Flexible hours

    Fable Security, LLC

    San Francisco, CA
    3 days ago
  •  ...deep expertise in model innovation and systems engineering paired with a design‑minded product...  ...lifeblood of our models, and we’re looking for a Software Engineer to help build the training data and ML data infrastructure at Cartesia. This role sits at the intersection... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia

    San Francisco, CA
    2 days ago
  • $250k - $350k

    Senior Software Engineer - Infrastructure/Platform — AfterQuery Location: San Francisco, CA (Onsite) Compensation: $250,000 - $350,000 base + competitive...  ...at scale AI infrastructure, LLM evaluation systems, or ML platform infrastructure Human-in-the-loop or workflow orchestration... 
    Full time
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    3 days ago
  • $212k - $318.4k

    Software Engineer, ML platform and Infrastructure San Francisco Bay Area, California, United States Software and Services The Applied Machine Learning team has been at the forefront of accelerating digital transformation through machine learning across Apple's enterprise... 
    Relocation

    Apple Inc.

    San Francisco, CA
    21 hours ago
  • Senior Software Engineer, Infrastructure & Platform Role Overview: As a Senior Software Engineer, Infrastructure & Platform at AfterQuery, you will design...  ...with AI infrastructure, LLM evaluation systems, or ML pipelines Experience working at high-growth startups or scaling... 

    AfterQuery

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - ML Infrastructure. Be the first to apply!