Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Backend/Infra Engineer

Judgment Labs Inc.

We're looking for a Senior Backend Engineer to own the services and APIs that power the data layer. You'll design the systems that ingest, evaluate, and serve agent telemetry at scale. What You'll Do Design and build high-throughput backend services that ingest and process hundreds of thousands of agent traces per second. Own the API surface our SDKs and dashboards depend on: define contracts, manage versioning, and keep latency low under real customer load. Tune our OLAP layer (ClickHouse) through schema design, query optimization, and access-pattern analysis so reads stay fast as data grows to petabyte scale. Partner with the platform and infra teams on scalability, reliability, and the systems that back our evaluation and monitoring pipelines. Advocate for a high bar on backend and engineering quality: reliable, efficient, well-documented, testable, and maintainable. What We're Looking For 6+ years of relevant industry experience building and operating high-throughput backend systems and services. Strong fundamentals in API design, data modeling, and the trade-offs of distributed systems under real production load. Hands-on experience with OLAP / columnar databases (ClickHouse, Presto) and a feel for how query patterns map to storage internals. Comfort across the stack, with the breadth to reason about platform and infra decisions. Strong communication skills. You write clearly, review well, and make the people around you better. Nice to Have Experience scaling pipelines that fan out to LLM APIs and managing the rate-limit, retry, and cost dynamics that come with them. Familiarity with streaming systems (Kafka, Spark, Flink, Ray) and ML orchestration tools (Airflow, Dagster, Prefect). Background in embedding / vector search infrastructure or data quality monitoring. Prior work on observability or developer-facing platform products. #J-18808-Ljbffr Judgment Labs Inc.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Backend/Infra Engineer in San Francisco, CA vacancy
  •  ...“AWS for AI models”—not data or raw compute, but a full-stack backend for fine-tuning, reinforcement learning, inference, and long-term...  ...your AI system better. They are hiring a Backend Software Engineer (ML Infrastructure) to help design, build, and scale the core... 
    Suggested
    Full time

    Rockstar

    San Francisco, CA
    12 hours ago
  •  ...these things. Responsibilities Design and build scalable, high-performance infrastructure. Design architectures that allow both engineers and language models to quickly create, test, and deploy application code. Create reliable monitoring, logging, and alerting... 
    Suggested
    Full time

    SafetyKit

    San Francisco, CA
    2 days ago
  • A cutting-edge technology firm in San Francisco is seeking a Backend Engineer to build scalable infrastructure for AI research tools. The role involves collaborating with an engineering team and establishing best practices for model deployment. Ideal candidates should... 
    Suggested
    Flexible hours

    Anara

    San Francisco, CA
    2 days ago
  • A high-growth AI startup in San Francisco seeks a Full-Stack Engineer to design and operate backend services. The role requires strong backend engineering skills and a solid understanding of system design and APIs. Candidates should have at least 2 years of experience... 
    Suggested

    HappyRobot

    San Francisco, CA
    2 days ago
  •  ...Rippletide SAS is seeking a Senior Software Engineer in San Francisco to build the core systems for their Decision Context Graph platform. The role emphasizes performance-critical backend infrastructure and APIs, engaging with a talented team on significant AI projects... 
    Suggested
    Remote work

    Rippletide SAS

    San Francisco, CA
    17 hours ago
  •  ...AI layer for healthcare payments. We are looking for a founding engineer who will own the systems that power our platform: chart...  ...to hundreds of thousands of records. You'll build distributed backend services, orchestration for long-running workflows across EHRs... 
    Remote work

    backbone uk - secure remote working solutions to small & mid...

    San Francisco, CA
    2 days ago
  • A tech startup in San Francisco is seeking a Founding Engineer with a focus on backend and infrastructure. Responsibilities include designing APIs for AI agents, architecting scalable systems, and maintaining documentation. The ideal candidate has prior experience in a... 

    AgentMail

    San Francisco, CA
    2 hours ago
  •  ...Amplitude is looking for a Software Engineer to join their infrastructure team in San Francisco. This role involves taking infrastructure projects from ideation to production, designing reliable backend services, and optimizing data infrastructure. Candidates should have... 
    Flexible hours

    Amplitude

    San Francisco, CA
    1 day ago
  • $260k - $300k

     ...institutions. Our agents have reached 3M+ patient encounters and are on track to 10x this year. About this role As a Staff Backend/Infra Engineer at Amigo, you'll build the core services behind our agent platform. The systems you own handle millions of conversations a... 
    Full time
    Flexible hours

    Amigo

    San Francisco, CA
    22 days ago
  • Founding Engineer, Backend & Infrastructure About Backbone Care should be paid for the moment it’s delivered. At Backbone, we’re making that possible for the first time by building the clinical AI layer for healthcare payments. Today, U.S. healthcare wastes more than $... 

    Backbone Systems

    San Francisco, CA
    2 days ago
  • A prominent technology venture in San Francisco is seeking a Python, Backend Engineer to join their team on a hybrid basis. This role requires building out data infrastructure and developing backend solutions while collaborating closely with engineering teams. The ideal... 
    Full time

    Goliath Partners

    San Francisco, CA
    2 days ago
  • $213k - $263k

     ...do with a fleet of robots. We are looking for passionate engineers who want to build the systems that manage Waymo’s ever-...  ...Science or equivalent practical experience 7+ years of backend/infra experience\ Strong knowledge in building software applications... 
    Full time
    Temporary work
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  • $185k - $225k

     ...provides the infrastructure to make your company’s identity and access management secure, reliable, and scalable. As an Experienced Backend Engineer on the Product Engineering team, you'll partner with leadership to ensure that our product experiences are truly best-in-class... 
    Full time
    Work at office
    3 days per week

    Stytch

    San Francisco, CA
    2 days ago
  • $150k - $200k

     ...for their life’s work. About the Role: As a Software Engineer on Collections Infra, you’ll help scale the infrastructure behind Notion’s database...  ...team sits between infrastructure and product, building backend architecture that improves the customer experience while becoming... 
    Full time
    Local area

    Notion

    San Francisco, CA
    12 hours ago
  • $140k - $165k

     ...backed by leading investors. Join us in our mission to transform how people do work. About the Role We're looking for a Backend Software Engineer to join our Core Engineering team, which powers the document workflows millions of people rely on every day: viewing,... 
    Full time
    Work at office
    Home office
    Flexible hours
    3 days per week

    Scribe

    San Francisco, CA
    1 day ago
  • $140k - $190k

    San Francisco, CA / Golden, COSoftware - Oort /Full time /On-siteWanna join the adventure?Loft Orbital is looking for a Backend Engineer to join our Oort team. Oort is our central web platform—a unified environment that consolidates all infrastructure data and tools, empowering... 
    Full time
    Temporary work

    Loft Orbital

    San Francisco, CA
    2 days ago
  •  ...job and more exclusive features. We’re looking for a senior backend engineer who can architect and scale core systems, take full ownership...  ...scale smart Preferred But Not Required: Experience in fintech, infra, or real-time systems Prior experience as a tech lead or... 
    Full time

    Stealth AI Startup

    San Francisco, CA
    2 days ago
  •  ...Roles and Responsibilities Design, develop, and maintain scalable backend services to help us serve millions of users daily. Work closely...  ...product team to launch new features. Collaborate with frontend engineers to design and implement RESTful APIs and shared API client... 
    Full time
    Contract work
    Work experience placement
    Work at office
    Immediate start

    RainesDev

    San Francisco, CA
    2 days ago
  •  ...are You have several years of experience building internet-based software You have experience driving technical designs for backend systems You adapt quickly and can problem solve through uncertainty You are comfortable making decisions to unblock yourself... 

    Range Labs Inc.

    San Francisco, CA
    more than 2 months ago
  • Simula is seeking a Founding Engineer to blend backend, ML, and traditional system design in a fast-moving startup environment in San Francisco, CA. You will be one of the earliest engineers shaping the engineering culture and building core infrastructure as the company... 

    davidjoseph-co

    San Francisco, CA
    2 days ago
  •  ...multimodal San Francisco-based 200 person venture. They are looking for a Python, Backend Engineer to join them in San Francisco on a hybrid basis. As an Data Engineer, you will: Build out search infra, pipelines and workflows for large-scale data. Developing backend solutions... 
    Full time

    Goliath Partners

    San Francisco, CA
    2 days ago
  •  ...exceptional people. About the Role As a Senior Software Engineer at Mercor, you’ll take end-to-end ownership of complex projects...  ...What You’ll Do Design, build, and scale production-grade backend APIs, services, and infrastructure. Take ownership of system... 
    Full time
    For contractors
    Immediate start

    Mercor

    San Francisco, CA
    12 hours ago
  •  ...term career. Job Title: Founding Infrastructure & Reliability Engineer Location | On-Site — San Francisco, CA Time Zone | PST...  ...Experience operating production infrastructure or high-throughput backend systems - Strong debugging ability across services,... 

    Hire Hangar

    San Francisco, CA
    a month ago
  •  ...Build Foundational Infrastructure for the World’s Largest Dataset You'll be our seventh engineering hire. You'll have full ownership over major features, play a huge role in creating the culture of our engineering team, and will work closely with the founders. You... 
    Full time
    Immediate start

    Recall

    San Francisco, CA
    12 hours ago
  •  ...Description Job Description We are hiring a Founding Software Engineer in San Francisco. We are building a small, talent-dense team...  ...and developer experience. Architect, build, and scale core backend systems powering document intelligence and VLM-based workfows... 

    Unsiloed AI

    San Francisco, CA
    more than 2 months ago
  • $120k - $250k

     ...backed and led by an experienced ML researcher. Founded 2024 · 11–50 people (Series A; ~6-person engineering team) · Industry: Healthcare The Role Own and scale the backend and AI infrastructure behind an agentic clinical-decision platform, supporting rapid customer... 
    Full time
    H1b
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    26 days ago
  • $180k - $300k

     ...growing technology company building sophisticated software systems and infrastructure at scale. We are seeking a Senior Backend Software Engineer with experience in YC-backed or Venture backed start-ups who can work across frontend and backend systems and take... 
    Full time
    Immediate start

    Pragmatike

    San Francisco, CA
    12 hours ago
  • $110k - $270k

     ...Job Description Job Description Maxana is seeking an experienced Backend Engineer for a confidential client — a well-funded AI platform company used by ML teams globally. In this role you will own features end to end across APIs, CLI tooling, billing systems, and... 
    Flexible hours
    2 days per week

    Maxana

    San Francisco, CA
    more than 2 months ago
  •  ...from every exchange, and finding novel ways to show the value of our technology. About the Role We’re looking for backend software engineers with a product mindset to join the GTM Innovation team. You’ll help OpenAI meet the world at scale. You’ll partner... 
    Full time

    OpenAI

    San Francisco, CA
    12 hours ago
  •  ...About the Team OpenAI’s Applications Engineering organization builds and operates the products (such as ChatGPT & Codex) that bring our...  ...and trusted at global scale. About the Role We’re hiring Backend Software Engineers to design and implement safe services and... 
    Full time
    Worldwide

    OpenAI

    San Francisco, CA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Backend/Infra Engineer. Be the first to apply!