Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer

$170k - $210k

Entelligence

Research Engineer, Coding Agent Optimization Engine

San Francisco, in person · Full-time · Entelligence

Coding agents ship more code every week, and they fail in repeatable ways: the same wrong assumption, the same missed test, the same review comment on PR after PR. Our Coding Agent Optimization Engine closes that loop. It mines agent sessions and PR review comments for failures, traces them to where the harness went wrong, and feeds the lessons back so the next session does not repeat them. It also routes every turn to the most efficient model that can solve it. It runs on live traffic from Claude Code, Codex, Cursor and API clients. We want a research engineer to make it measurably better at both.

Key Focus Areas
  • Failure mining. Captures coding-agent sessions and links them to the PRs they produced, then mines transcripts and review comments for errors, struggles and recurring root causes.
  • Learning loop. Turns review findings into root-cause patterns and tested rules, and delivers them to the next agent session as guidance cards through CLI hooks.
  • Pre-PR judge. A reviewer model checks an agent's change before the PR is opened, and the harness reports back what happened in each session.
  • Cost-aware routing. Picks a difficulty tier per instruction turn and weights models by expected cost per solved task, with prompt-cache affinity, failover and per-org constraints.
What you will work on
  • Failure attribution. Given a session transcript and the review comments on its PR, find where the harness went wrong: missing context, a bad tool loop, a skipped check, the wrong model.
  • Prevention that measurably works. Decide which lessons become rules, cards or judge checks, and prove with held-out data that they cut repeat findings without flooding agents with noise.
  • Evaluation. Own the benchmark harness of record: replay real agentic tasks headlessly against competing harness configs and routing policies, and measure quality vs. cost honestly.
  • Engineering world model. Build the comprehensive data layer connecting sessions, PRs, projects, errors and incidents. Leverage the world model to catch issues from happening in future sessions.
  • Cost and outcome modeling. Turn measured usage, cache shares, latency and review outcomes into continuously refreshed model and harness parameters.
Your Background
  • 3+ years building ML or LLM systems that run in production, or equivalent research experience with shipped code.
  • Strong Python and comfort reading a large production codebase.
  • Experiment design you can defend: held-out sets, variance, confidence intervals, leakage checks.
  • Hands-on experience with LLM APIs, agents or tool-use loops, and their failure modes.
  • Work on agent evaluation, failure analysis, LLM-as-judge or automated code review.
  • Work on routing, cascades, bandits or learning-to-defer.
  • Experience with LLM inference economics: prompt caching, batching, token pricing.
  • Built or maintained public evals (SWE-bench, Terminal-Bench style harnesses).
  • Published research or well-known open-source work in ML systems or developer tools.
Compensation and benefits

Base salary: $170,000 - $210,000 plus meaningful equity. Final offer depends on level and experience. Healthcare and a generous compute budget for experiments.

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Engineer in San Francisco, CA vacancy
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will be a core contributor on Zyphra’s Audio Team, building the next generation of open-source... 
    Suggested
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    25 days ago
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Agency and Reasoning , you will be a core contributor to Zyphra’s Agency and Reasoning Team. You will be involved with... 
    Suggested
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    25 days ago
  •  ...Job Description Job Description The Role: As a Research Engineer - Vision & Vision-Language Models , you will be a core contributor on Zyphra’s Vision Team, building the next generation of models for image understanding, computer use, and other agentic visual... 
    Suggested
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    4 days ago
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models , you will be a core contributor to Zyphra’s BCI work, building the next generation of open... 
    Suggested
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    6 days ago
  • $122k - $215k

     ...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer, you will be at the forefront of advancing and deploying artificial intelligence algorithms for our self-driving vehicles. You... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    5 days ago
  •  ...Job Description Job Description We are Genmo, a research lab developing the world’s most sophisticated video world models to understand...  .... About the Role We're seeking an exceptional Software Engineer to join our research team in advancing the frontiers of visual... 
    Work at office

    Genmo

    San Francisco, CA
    23 days ago
  •  ...In just months, we’ve gone from our first line of code to deploying real humanoid capabilities. The role As our VLA/WAM Research Engineer, you'll develop the foundation models that power our humanoid robots, spanning model architecture, large-scale pre-training, adaptation... 
    Work at office
    Relocation

    Flexion Robotics

    San Francisco, CA
    15 days ago
  •  ...is a startup company developing technology on the frontier of engineering and biology. Our first product is a smart microinvasive needle...  ...Ideal BS candidates are juniors or seniors with experience in a research lab and/or prior internships. Ideal MS candidates have prior... 
    Summer work
    Internship

    Current Surgical Inc.

    San Francisco, CA
    1 day ago
  • $155k - $269k

     ...autonomous-driving stack is powered by Waabi World, which delivers realistic, scalable, controllable, and efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and productionize the next generation of World Models that can reason... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    19 days ago
  • $134k - $235k

     ...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer in Neural Rendering, you will create the next generation of multi-sensor rendering systems for autonomous driving. You will... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    29 days ago
  •  ...robotic systems that increase the speed and capacity of buildout, starting with data centers. About the Role At Watney, research engineers decide what our models learn to do next, and a live fleet of robots is the only test that counts. The plan is a staged path... 

    Watney

    San Francisco, CA
    2 days ago
  • $140k - $250k

     ...This is the company's top hiring priority and a genuinely hard research problem. Because data flows through a decentralized marketplace...  ...scale is the single biggest bottleneck to growth. As a Research Engineer, you will build the automated systems that verify and assure... 
    Full time
    Work at office

    talentpluto

    San Francisco, CA
    7 days ago
  •  ...Description Job Description Bridge the gap between cutting-edge research and production systems. Build and implement research...  ...technical documentation Bridge communication between research and engineering teams What We're Looking For ~3+ years of experience in... 

    Engramme

    San Francisco, CA
    19 days ago
  • $125k - $400k

     ...Description Job Description About idler idler is a frontier data research lab. We build the evals and environments that the world's...  ...some of our work here: About the role As a Research Engineer at idler, you’ll build the systems and infrastructure that our... 
    Work at office
    Relocation package

    Idler

    San Francisco, CA
    6 days ago
  • $130k - $225k

     ...Job Description Job Description About the Role Join a research and engineering team building privacy and anonymization systems for sensitive data used in AI training. You will help protect personal and confidential information while preserving the structure and utility... 
    Visa sponsorship

    Clera

    San Francisco, CA
    5 days ago
  • $220k - $300k

     ...Catalyst, and Optum Ventures. We’re about 35 people, working in person in New York and San Francisco. About this role As a Research Engineer, Voice AI at Concurrence, you'll build and tune speech models for patient conversations and ambient clinical audio. You'll own... 
    Full time
    Flexible hours

    Concurrence

    San Francisco, CA
    1 day ago
  •  ...Research EngineerWe're reverse-engineering the origin of life — one of the great unsolved problems in science, and one we think AI finally makes tractable. We believe that understanding this transition, from geochemistry to biochemistry, will let us orchestrate molecular... 
    Visa sponsorship
    Shift work

    Dayhoff Labs

    San Francisco, CA
    1 day ago
  •  ...The role Gauntlet is looking for an AI Research Engineer to help improve how we build, evaluate and use AI agents across the business. We already have agents running in production, including Aria, our in-house generalist agent. They're used across research, engineering... 
    Work at office
    Remote work
    Work from home

    Remote Services Inc.

    San Francisco, CA
    4 days ago
  • $200k - $375k

     ...runtime that understands complex enterprise systems, the tooling experience developers use every day, and the analysis and planning engine that transforms legacy code. You will work directly with customers on high-leverage projects and help define our culture, our... 
    Visa sponsorship

    FlowGen Labs

    San Francisco, CA
    8 days ago
  •  ...the race to build frontier AI. The Impact You'll Make Our research team is expanding to keep pace with a wave of frontier-facing...  ...opportunities at the cutting edge of the field. As a Research Engineer, you'll take a research direction and run with it – finding the... 
    Full time

    SuperAnnotate AI

    San Francisco, CA
    27 days ago
  •  ...pipelines, and publishing results. You’ll develop Taste’s internal research, evaluation design, judges and reward models while...  ...purely classical ML Thinks like a researcher, moves like an engineer. Creative, scrappy, comfortable in ambiguity Startup experience... 

    Taste Labs

    San Francisco, CA
    3 days ago
  •  ...You’ll work alongside researchers to take experimental code beyond the initial prototype. You’ll build, test, and scale post-training...  ...tests, experiment tracking, and debugging tools, and check that engineering changes preserve the intended experimental behavior.... 
    Visa sponsorship
    Relocation package

    Seldon Technologies, Inc

    San Francisco, CA
    4 days ago
  •  ...A research engineer in this setting typically turns research ideas into working training and evaluation pipelines for long horizon tasks. A strong candidate brings solid coding, comfort with model training and experimentation, and the patience to run careful comparisons... 
    Shift work

    present of AI

    San Francisco, CA
    3 days ago
  •  ...software development, helping the world's largest enterprise engineering teams turn their organizations into autonomous software factories...  ...). About the Role Factory is seeking innovative Research Engineers to design and integrate advanced AI and ML capabilities... 
    Full time
    Work at office

    The San Francisco AI Factory

    San Francisco, CA
    4 days ago
  •  ...healthcare and prescriptions. Our team includes ex-founders and engineers who have built and scaled consumer apps to millions of users,...  ...and Stanford. Role Overview We are hiring a Founding Research Engineer to design, prototype, and ship the core reasoning and... 

    Lotus

    San Francisco, CA
    1 day ago
  •  ...large teams coordinating over long timescales. We are making agents that do that coordination directly. What you'll do The research that matters most to us comes straight out of deployment: getting agents to multi-task, learn, remember, and operate reliably over... 

    Orin Labs, Inc.

    San Francisco, CA
    1 day ago
  • $250k - $400k

     ...Research Engineer – Post-Training, Agents, Evals Fundamental AI Research Institute San Francisco Bay Area, USA (hybrid) $250,000 – $400,000 salary + bonus Come join one of the only research institutions globally with resources to compete with top AI companies... 
    Relocation package

    Storm3

    San Francisco, CA
    1 day ago
  •  ...review workflow, and then work with a team to integrate successful prototypes into production systems Stay on top of the latest research across LLMs, information retrieval, and developer tooling Qualifications B.S. in Computer Science or equivalent Research... 
    Work at office

    Greptile

    San Francisco, CA
    3 days ago
  • As a Member of Technical Staff you will: Design multimodal datasets that directly shape what frontier world models learn Run controlled training experiments to understand how data impacts model capabilities Build large-scale pipelines for synthetic data generation...

    Goliath Partners LP

    San Francisco, CA
    4 days ago
  •  ...training. About David AI David AI is the first audio data research company. We bring an R&D approach to data-developing datasets...  ...David AI was founded in 2024 by a team of former Scale AI engineers and operators. In less than a year, we’ve brought on most FAANG... 
    Work at office

    David AI Labs, Inc.

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer. Be the first to apply!