Backend/Infra Engineer
Judgment Labs Inc.
We're looking for a Senior Backend Engineer to own the services and APIs that power the data layer. You'll design the systems that ingest, evaluate, and serve agent telemetry at scale. What You'll Do Design and build high-throughput backend services that ingest and process hundreds of thousands of agent traces per second. Own the API surface our SDKs and dashboards depend on: define contracts, manage versioning, and keep latency low under real customer load. Tune our OLAP layer (ClickHouse) through schema design, query optimization, and access-pattern analysis so reads stay fast as data grows to petabyte scale. Partner with the platform and infra teams on scalability, reliability, and the systems that back our evaluation and monitoring pipelines. Advocate for a high bar on backend and engineering quality: reliable, efficient, well-documented, testable, and maintainable. What We're Looking For 6+ years of relevant industry experience building and operating high-throughput backend systems and services. Strong fundamentals in API design, data modeling, and the trade-offs of distributed systems under real production load. Hands-on experience with OLAP / columnar databases (ClickHouse, Presto) and a feel for how query patterns map to storage internals. Comfort across the stack, with the breadth to reason about platform and infra decisions. Strong communication skills. You write clearly, review well, and make the people around you better. Nice to Have Experience scaling pipelines that fan out to LLM APIs and managing the rate-limit, retry, and cost dynamics that come with them. Familiarity with streaming systems (Kafka, Spark, Flink, Ray) and ML orchestration tools (Airflow, Dagster, Prefect). Background in embedding / vector search infrastructure or data quality monitoring. Prior work on observability or developer-facing platform products. #J-18808-Ljbffr Judgment Labs Inc.
- ...“AWS for AI models”—not data or raw compute, but a full-stack backend for fine-tuning, reinforcement learning, inference, and long-term... ...your AI system better. They are hiring a Backend Software Engineer (ML Infrastructure) to help design, build, and scale the core...SuggestedFull time
- ...these things. Responsibilities Design and build scalable, high-performance infrastructure. Design architectures that allow both engineers and language models to quickly create, test, and deploy application code. Create reliable monitoring, logging, and alerting...SuggestedFull time
- A cutting-edge technology firm in San Francisco is seeking a Backend Engineer to build scalable infrastructure for AI research tools. The role involves collaborating with an engineering team and establishing best practices for model deployment. Ideal candidates should...SuggestedFlexible hours
- A high-growth AI startup in San Francisco seeks a Full-Stack Engineer to design and operate backend services. The role requires strong backend engineering skills and a solid understanding of system design and APIs. Candidates should have at least 2 years of experience...Suggested
- ...Rippletide SAS is seeking a Senior Software Engineer in San Francisco to build the core systems for their Decision Context Graph platform. The role emphasizes performance-critical backend infrastructure and APIs, engaging with a talented team on significant AI projects...SuggestedRemote work
- ...AI layer for healthcare payments. We are looking for a founding engineer who will own the systems that power our platform: chart... ...to hundreds of thousands of records. You'll build distributed backend services, orchestration for long-running workflows across EHRs...Remote work
- A tech startup in San Francisco is seeking a Founding Engineer with a focus on backend and infrastructure. Responsibilities include designing APIs for AI agents, architecting scalable systems, and maintaining documentation. The ideal candidate has prior experience in a...
- ...Amplitude is looking for a Software Engineer to join their infrastructure team in San Francisco. This role involves taking infrastructure projects from ideation to production, designing reliable backend services, and optimizing data infrastructure. Candidates should have...Flexible hours
$260k - $300k
...institutions. Our agents have reached 3M+ patient encounters and are on track to 10x this year. About this role As a Staff Backend/Infra Engineer at Amigo, you'll build the core services behind our agent platform. The systems you own handle millions of conversations a...Full timeFlexible hours- Founding Engineer, Backend & Infrastructure About Backbone Care should be paid for the moment it’s delivered. At Backbone, we’re making that possible for the first time by building the clinical AI layer for healthcare payments. Today, U.S. healthcare wastes more than $...
- A prominent technology venture in San Francisco is seeking a Python, Backend Engineer to join their team on a hybrid basis. This role requires building out data infrastructure and developing backend solutions while collaborating closely with engineering teams. The ideal...Full time
$213k - $263k
...do with a fleet of robots. We are looking for passionate engineers who want to build the systems that manage Waymo’s ever-... ...Science or equivalent practical experience 7+ years of backend/infra experience\ Strong knowledge in building software applications...Full timeTemporary workRemote work$185k - $225k
...provides the infrastructure to make your company’s identity and access management secure, reliable, and scalable. As an Experienced Backend Engineer on the Product Engineering team, you'll partner with leadership to ensure that our product experiences are truly best-in-class...Full timeWork at office3 days per week$150k - $200k
...for their life’s work. About the Role: As a Software Engineer on Collections Infra, you’ll help scale the infrastructure behind Notion’s database... ...team sits between infrastructure and product, building backend architecture that improves the customer experience while becoming...Full timeLocal area$140k - $165k
...backed by leading investors. Join us in our mission to transform how people do work. About the Role We're looking for a Backend Software Engineer to join our Core Engineering team, which powers the document workflows millions of people rely on every day: viewing,...Full timeWork at officeHome officeFlexible hours3 days per week$140k - $190k
San Francisco, CA / Golden, COSoftware - Oort /Full time /On-siteWanna join the adventure?Loft Orbital is looking for a Backend Engineer to join our Oort team. Oort is our central web platform—a unified environment that consolidates all infrastructure data and tools, empowering...Full timeTemporary work- ...job and more exclusive features. We’re looking for a senior backend engineer who can architect and scale core systems, take full ownership... ...scale smart Preferred But Not Required: Experience in fintech, infra, or real-time systems Prior experience as a tech lead or...Full time
- ...Roles and Responsibilities Design, develop, and maintain scalable backend services to help us serve millions of users daily. Work closely... ...product team to launch new features. Collaborate with frontend engineers to design and implement RESTful APIs and shared API client...Full timeContract workWork experience placementWork at officeImmediate start
- ...are You have several years of experience building internet-based software You have experience driving technical designs for backend systems You adapt quickly and can problem solve through uncertainty You are comfortable making decisions to unblock yourself...
- Simula is seeking a Founding Engineer to blend backend, ML, and traditional system design in a fast-moving startup environment in San Francisco, CA. You will be one of the earliest engineers shaping the engineering culture and building core infrastructure as the company...
- ...multimodal San Francisco-based 200 person venture. They are looking for a Python, Backend Engineer to join them in San Francisco on a hybrid basis. As an Data Engineer, you will: Build out search infra, pipelines and workflows for large-scale data. Developing backend solutions...Full time
- ...exceptional people. About the Role As a Senior Software Engineer at Mercor, you’ll take end-to-end ownership of complex projects... ...What You’ll Do Design, build, and scale production-grade backend APIs, services, and infrastructure. Take ownership of system...Full timeFor contractorsImmediate start
- ...term career. Job Title: Founding Infrastructure & Reliability Engineer Location | On-Site — San Francisco, CA Time Zone | PST... ...Experience operating production infrastructure or high-throughput backend systems - Strong debugging ability across services,...
- ...Build Foundational Infrastructure for the World’s Largest Dataset You'll be our seventh engineering hire. You'll have full ownership over major features, play a huge role in creating the culture of our engineering team, and will work closely with the founders. You...Full timeImmediate start
- ...Description Job Description We are hiring a Founding Software Engineer in San Francisco. We are building a small, talent-dense team... ...and developer experience. Architect, build, and scale core backend systems powering document intelligence and VLM-based workfows...
$120k - $250k
...backed and led by an experienced ML researcher. Founded 2024 · 11–50 people (Series A; ~6-person engineering team) · Industry: Healthcare The Role Own and scale the backend and AI infrastructure behind an agentic clinical-decision platform, supporting rapid customer...Full timeH1bVisa sponsorship$180k - $300k
...growing technology company building sophisticated software systems and infrastructure at scale. We are seeking a Senior Backend Software Engineer with experience in YC-backed or Venture backed start-ups who can work across frontend and backend systems and take...Full timeImmediate start$110k - $270k
...Job Description Job Description Maxana is seeking an experienced Backend Engineer for a confidential client — a well-funded AI platform company used by ML teams globally. In this role you will own features end to end across APIs, CLI tooling, billing systems, and...Flexible hours2 days per week- ...from every exchange, and finding novel ways to show the value of our technology. About the Role We’re looking for backend software engineers with a product mindset to join the GTM Innovation team. You’ll help OpenAI meet the world at scale. You’ll partner...Full time
- ...About the Team OpenAI’s Applications Engineering organization builds and operates the products (such as ChatGPT & Codex) that bring our... ...and trusted at global scale. About the Role We’re hiring Backend Software Engineers to design and implement safe services and...Full timeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend/Infra Engineer. Be the first to apply!
- remote back end developer San Francisco, CA
- senior backend developer San Francisco, CA
- back-end developer San Francisco, CA
- backend software engineer San Francisco, CA
- backend python developer San Francisco, CA
- backend intern San Francisco, CA
- go backend developer
- back end developer internship summer
- remote back end developer
- backend .net developer




