Research Engineer
$170k - $210kEntelligence
Research Engineer, Coding Agent Optimization Engine
San Francisco, in person · Full-time · Entelligence
Coding agents ship more code every week, and they fail in repeatable ways: the same wrong assumption, the same missed test, the same review comment on PR after PR. Our Coding Agent Optimization Engine closes that loop. It mines agent sessions and PR review comments for failures, traces them to where the harness went wrong, and feeds the lessons back so the next session does not repeat them. It also routes every turn to the most efficient model that can solve it. It runs on live traffic from Claude Code, Codex, Cursor and API clients. We want a research engineer to make it measurably better at both.
Key Focus Areas
- Failure mining. Captures coding-agent sessions and links them to the PRs they produced, then mines transcripts and review comments for errors, struggles and recurring root causes.
- Learning loop. Turns review findings into root-cause patterns and tested rules, and delivers them to the next agent session as guidance cards through CLI hooks.
- Pre-PR judge. A reviewer model checks an agent's change before the PR is opened, and the harness reports back what happened in each session.
- Cost-aware routing. Picks a difficulty tier per instruction turn and weights models by expected cost per solved task, with prompt-cache affinity, failover and per-org constraints.
What you will work on
- Failure attribution. Given a session transcript and the review comments on its PR, find where the harness went wrong: missing context, a bad tool loop, a skipped check, the wrong model.
- Prevention that measurably works. Decide which lessons become rules, cards or judge checks, and prove with held-out data that they cut repeat findings without flooding agents with noise.
- Evaluation. Own the benchmark harness of record: replay real agentic tasks headlessly against competing harness configs and routing policies, and measure quality vs. cost honestly.
- Engineering world model. Build the comprehensive data layer connecting sessions, PRs, projects, errors and incidents. Leverage the world model to catch issues from happening in future sessions.
- Cost and outcome modeling. Turn measured usage, cache shares, latency and review outcomes into continuously refreshed model and harness parameters.
Your Background
- 3+ years building ML or LLM systems that run in production, or equivalent research experience with shipped code.
- Strong Python and comfort reading a large production codebase.
- Experiment design you can defend: held-out sets, variance, confidence intervals, leakage checks.
- Hands-on experience with LLM APIs, agents or tool-use loops, and their failure modes.
- Work on agent evaluation, failure analysis, LLM-as-judge or automated code review.
- Work on routing, cascades, bandits or learning-to-defer.
- Experience with LLM inference economics: prompt caching, batching, token pricing.
- Built or maintained public evals (SWE-bench, Terminal-Bench style harnesses).
- Published research or well-known open-source work in ML systems or developer tools.
Compensation and benefits
Base salary: $170,000 - $210,000 plus meaningful equity. Final offer depends on level and experience. Healthcare and a generous compute budget for experiments.
#J-18808-Ljbffr- ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will be a core contributor on Zyphra’s Audio Team, building the next generation of open-source...SuggestedWork at officeRelocation package
- ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Agency and Reasoning , you will be a core contributor to Zyphra’s Agency and Reasoning Team. You will be involved with...SuggestedWork at officeRelocation package
- ...Job Description Job Description The Role: As a Research Engineer - Vision & Vision-Language Models , you will be a core contributor on Zyphra’s Vision Team, building the next generation of models for image understanding, computer use, and other agentic visual...SuggestedWork at officeRelocation package
- ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models , you will be a core contributor to Zyphra’s BCI work, building the next generation of open...SuggestedWork at officeRelocation package
$122k - $215k
...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer, you will be at the forefront of advancing and deploying artificial intelligence algorithms for our self-driving vehicles. You...SuggestedFull timeWork at officeWork from homeFlexible hours- ...Job Description Job Description We are Genmo, a research lab developing the world’s most sophisticated video world models to understand... .... About the Role We're seeking an exceptional Software Engineer to join our research team in advancing the frontiers of visual...Work at office
- ...In just months, we’ve gone from our first line of code to deploying real humanoid capabilities. The role As our VLA/WAM Research Engineer, you'll develop the foundation models that power our humanoid robots, spanning model architecture, large-scale pre-training, adaptation...Work at officeRelocation
- ...is a startup company developing technology on the frontier of engineering and biology. Our first product is a smart microinvasive needle... ...Ideal BS candidates are juniors or seniors with experience in a research lab and/or prior internships. Ideal MS candidates have prior...Summer workInternship
$155k - $269k
...autonomous-driving stack is powered by Waabi World, which delivers realistic, scalable, controllable, and efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and productionize the next generation of World Models that can reason...Full timeWork at officeWork from homeFlexible hours$134k - $235k
...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer in Neural Rendering, you will create the next generation of multi-sensor rendering systems for autonomous driving. You will...Full timeWork at officeWork from homeFlexible hours- ...robotic systems that increase the speed and capacity of buildout, starting with data centers. About the Role At Watney, research engineers decide what our models learn to do next, and a live fleet of robots is the only test that counts. The plan is a staged path...
$140k - $250k
...This is the company's top hiring priority and a genuinely hard research problem. Because data flows through a decentralized marketplace... ...scale is the single biggest bottleneck to growth. As a Research Engineer, you will build the automated systems that verify and assure...Full timeWork at office- ...Description Job Description Bridge the gap between cutting-edge research and production systems. Build and implement research... ...technical documentation Bridge communication between research and engineering teams What We're Looking For ~3+ years of experience in...
$125k - $400k
...Description Job Description About idler idler is a frontier data research lab. We build the evals and environments that the world's... ...some of our work here: About the role As a Research Engineer at idler, you’ll build the systems and infrastructure that our...Work at officeRelocation package$130k - $225k
...Job Description Job Description About the Role Join a research and engineering team building privacy and anonymization systems for sensitive data used in AI training. You will help protect personal and confidential information while preserving the structure and utility...Visa sponsorship$220k - $300k
...Catalyst, and Optum Ventures. We’re about 35 people, working in person in New York and San Francisco. About this role As a Research Engineer, Voice AI at Concurrence, you'll build and tune speech models for patient conversations and ambient clinical audio. You'll own...Full timeFlexible hours- ...Research EngineerWe're reverse-engineering the origin of life — one of the great unsolved problems in science, and one we think AI finally makes tractable. We believe that understanding this transition, from geochemistry to biochemistry, will let us orchestrate molecular...Visa sponsorshipShift work
- ...The role Gauntlet is looking for an AI Research Engineer to help improve how we build, evaluate and use AI agents across the business. We already have agents running in production, including Aria, our in-house generalist agent. They're used across research, engineering...Work at officeRemote workWork from home
$200k - $375k
...runtime that understands complex enterprise systems, the tooling experience developers use every day, and the analysis and planning engine that transforms legacy code. You will work directly with customers on high-leverage projects and help define our culture, our...Visa sponsorship- ...the race to build frontier AI. The Impact You'll Make Our research team is expanding to keep pace with a wave of frontier-facing... ...opportunities at the cutting edge of the field. As a Research Engineer, you'll take a research direction and run with it – finding the...Full time
- ...pipelines, and publishing results. You’ll develop Taste’s internal research, evaluation design, judges and reward models while... ...purely classical ML Thinks like a researcher, moves like an engineer. Creative, scrappy, comfortable in ambiguity Startup experience...
- ...You’ll work alongside researchers to take experimental code beyond the initial prototype. You’ll build, test, and scale post-training... ...tests, experiment tracking, and debugging tools, and check that engineering changes preserve the intended experimental behavior....Visa sponsorshipRelocation package
- ...A research engineer in this setting typically turns research ideas into working training and evaluation pipelines for long horizon tasks. A strong candidate brings solid coding, comfort with model training and experimentation, and the patience to run careful comparisons...Shift work
- ...software development, helping the world's largest enterprise engineering teams turn their organizations into autonomous software factories... ...). About the Role Factory is seeking innovative Research Engineers to design and integrate advanced AI and ML capabilities...Full timeWork at office
- ...healthcare and prescriptions. Our team includes ex-founders and engineers who have built and scaled consumer apps to millions of users,... ...and Stanford. Role Overview We are hiring a Founding Research Engineer to design, prototype, and ship the core reasoning and...
- ...large teams coordinating over long timescales. We are making agents that do that coordination directly. What you'll do The research that matters most to us comes straight out of deployment: getting agents to multi-task, learn, remember, and operate reliably over...
$250k - $400k
...Research Engineer – Post-Training, Agents, Evals Fundamental AI Research Institute San Francisco Bay Area, USA (hybrid) $250,000 – $400,000 salary + bonus Come join one of the only research institutions globally with resources to compete with top AI companies...Relocation package- ...review workflow, and then work with a team to integrate successful prototypes into production systems Stay on top of the latest research across LLMs, information retrieval, and developer tooling Qualifications B.S. in Computer Science or equivalent Research...Work at office
- As a Member of Technical Staff you will: Design multimodal datasets that directly shape what frontier world models learn Run controlled training experiments to understand how data impacts model capabilities Build large-scale pipelines for synthetic data generation...
- ...training. About David AI David AI is the first audio data research company. We bring an R&D approach to data-developing datasets... ...David AI was founded in 2024 by a team of former Scale AI engineers and operators. In less than a year, we’ve brought on most FAANG...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer. Be the first to apply!
- junior machine learning research engineer San Francisco, CA
- senior research engineer San Francisco, CA
- research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- research programmer San Francisco, CA
- research assistant engineering San Francisco, CA
- research software engineer San Francisco, CA
- ai research engineer San Francisco, CA
- research assistantship San Francisco, CA
- research writer San Francisco, CA


