Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer

$175k - $195k

Gauntlet

The role

Gauntlet is looking for an AI Research Engineer to help improve how we build, evaluate and use AI agents across the business.

We already have agents running in production, including Aria, our in‑house generalist agent. They're used across research, engineering and business workflows, and we've learned a lot from seeing how they perform in practice. Some tasks work extremely well; others produce inconsistent results, and changes to models or tooling can introduce unexpected problems. Today, much of that feedback is still subjective. We want to build a more systematic way of understanding what works, what doesn't and why.

A major part of this role will be building the evaluation frameworks that allow us to measure agent performance on real tasks. You'll work with our engineers, quantitative researchers and other teams to understand where agents struggle, turn those observations into measurable experiments, and use the results to improve the systems we're building.

You’ll also contribute directly to our existing agents and internal tooling. Initially, the work will be more engineering-focused as you get familiar with our systems, shipping improvements and integrations that teams can use. Over time, you’ll take on more open-ended research, helping us develop better approaches to evaluation, agent behaviour and infrastructure.

We're also thinking beyond individual agents. One of our longer-term goals is to build a shared system of knowledge and reusable skills that our agents can draw from and improve over time. You’ll play an important role in developing that infrastructure and how we evaluate its effectiveness.

This is an applied research role with a meaningful engineering component. We're looking for someone who enjoys investigating difficult problems, can design good experiments and is comfortable building and shipping the solutions that come out of them.

About Gauntlet

Gauntlet builds the financial systems of the future. While much of onchain finance is focused on point solutions, we operate across the entire stack to offer best-in-class vault products. Today we serve over $1.7B in client TVL across some of the largest fintechs/neobanks, protocols, exchanges, and capital allocators in crypto - and, increasingly, traditional asset management. Our team brings together traditional finance and crypto-native expertise to deliver durable, sophisticated products for institutional clients moving onchain.

Why this role is different

This is an opportunity to work at the intersection of AI, quantitative research and DeFi, tackling problems where advances in AI can have a direct impact on financial markets and onchain strategies.

You’ll go beyond building individual agents, helping define how they’re evaluated, how they learn from real-world tasks and how their capabilities scale across the business. With few established benchmarks in this space, you’ll have the freedom to explore new approaches and take your ideas from research through to production, working directly with the teams putting them to use.

What you’ll do;
  • Build evaluation frameworks for AI agents, including datasets, sandbox environments and metrics that measure performance on real-world tasks.
  • Design experiments to compare models, agent harnesses, tools and execution environments, identifying regressions and understanding the trade-offs between performance, reliability and cost.
  • Work with teams across Gauntlet to turn qualitative feedback about agent behaviour into concrete research questions, experiments and measurable outcomes.
  • Investigate agent failures, understand whether problems come from the model, harness, tooling or prompting, and develop ways to improve performance.
  • Build and improve agent harnesses, internal tools and integrations, including contributing to Aria and other agents used across the business.
  • Help develop shared knowledge and reusable skills across agents, creating systems that can learn from previous work and improve over time.
  • Work alongside Infrastructure and Security to ensure agents can operate reliably and safely within our production environment.
What we're looking for;
  • Hands‑on experience building, evaluating or improving LLM models or agents, whether through professional work, applied research, open‑source contributions or substantial personal projects.
  • Strong Python skills and good software engineering fundamentals. You’re comfortable writing production‑quality code and understand the importance of testing, maintainability and reliability.
  • Experience with applied research, machine learning or data science, including designing experiments, working with datasets and drawing conclusions from results.
  • A good understanding of how LLM agents work beyond prompting, including tool use, harnesses, context management and common failure modes.
  • The ability to take an open‑ended problem, break it down into testable questions and work independently towards a solution.
  • Experience building tools or systems that other people use, with an understanding of how to evaluate their effectiveness beyond technical benchmarks.
  • Comfort working across research and engineering, collaborating with different teams and adapting as priorities change.
  • Genuine interest in AI agents and how they can be made more capable, reliable and useful.
Nice to have;
  • Experience building LLM evaluation pipelines, benchmarks, reinforcement learning environments or model testing infrastructure.
  • Contributions to open‑source agent frameworks, harnesses, evaluation datasets or benchmarks.
  • Experience with agent frameworks such as Hermes, OpenClaw or similar tools.
  • Experience in applied ML research, model training, fine‑tuning or reinforcement learning.
  • An advanced degree or postgraduate research experience in computer science, mathematics, statistics, machine learning or a related field.
  • Experience in financial markets, quantitative research, DeFi or risk modelling.
  • Familiarity with AI security considerations, including access controls, prompt injection and data protection.

You don’t need prior experience in crypto or DeFi. Strong research and engineering fundamentals matter more, and you’ll work closely with people across Gauntlet who understand the financial systems and strategies our agents support.

We expect strong candidates to have experience working in a professional engineering or research environment, but we’re more interested in what you’ve built and how you approach problems than a specific number of years on your CV.

Benefits & Perks;
  • Remote first — work from anywhere in the United States
  • Regular in‑person company retreats and cross‑country "office visit" perk
  • 100% paid medical, dental, and vision premiums for employees
  • $1,000 WFH stipend
  • Monthly reimbursement for home internet, phone, and cellular data
  • Unlimited vacation
  • 100% paid parental leave of 12 weeks
  • Fertility benefits
  • Opportunity for incentive compensation

Please note at this time our hiring is reserved for potential employees who are able to work within the contiguous United States and Canada. Should you need alternative accommodations, please note that in your application.

The national pay range for this role is $175,000 - $195,000 base plus additional On Target Earnings potential by level and equity in the company. Our salary ranges are based on paying competitively for a company of our size and industry, and are one part of many compensation, benefits and other reward opportunities we provide. Individual pay rate decisions are based on a number of factors, including qualifications for the role, experience level, skill set, and balancing internal equity relative to peers at the company.

#LI-Remote

#J-18808-Ljbffr
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Research Engineer in San Francisco, CA vacancy
  •  ...In just months, we’ve gone from our first line of code to deploying real humanoid capabilities. The role As our VLA/WAM Research Engineer, you'll develop the foundation models that power our humanoid robots, spanning model architecture, large-scale pre-training, adaptation... 
    Suggested
    Work at office
    Relocation

    Flexion Robotics

    San Francisco, CA
    15 days ago
  •  ...is a startup company developing technology on the frontier of engineering and biology. Our first product is a smart microinvasive needle...  ...Ideal BS candidates are juniors or seniors with experience in a research lab and/or prior internships. Ideal MS candidates have prior... 
    Suggested
    Summer work
    Internship

    Current Surgical Inc.

    San Francisco, CA
    1 day ago
  • $155k - $269k

     ...autonomous-driving stack is powered by Waabi World, which delivers realistic, scalable, controllable, and efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and productionize the next generation of World Models that can reason... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    19 days ago
  • $134k - $235k

     ...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer in Neural Rendering, you will create the next generation of multi-sensor rendering systems for autonomous driving. You will... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    29 days ago
  •  ...robotic systems that increase the speed and capacity of buildout, starting with data centers. About the Role At Watney, research engineers decide what our models learn to do next, and a live fleet of robots is the only test that counts. The plan is a staged path... 
    Suggested

    Watney

    San Francisco, CA
    2 days ago
  •  ...Job Description Job Description We are Genmo, a research lab developing the world’s most sophisticated video world models to understand...  .... About the Role We're seeking an exceptional Software Engineer to join our research team in advancing the frontiers of visual... 
    Work at office

    Genmo

    San Francisco, CA
    23 days ago
  • $122k - $215k

     ...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer, you will be at the forefront of advancing and deploying artificial intelligence algorithms for our self-driving vehicles. You... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    5 days ago
  •  ...You’ll work alongside researchers to take experimental code beyond the initial prototype. You’ll build, test, and scale post-training...  ...tests, experiment tracking, and debugging tools, and check that engineering changes preserve the intended experimental behavior.... 
    Visa sponsorship
    Relocation package

    Seldon Technologies, Inc

    San Francisco, CA
    4 days ago
  •  ...pipelines, and publishing results. You’ll develop Taste’s internal research, evaluation design, judges and reward models while...  ...purely classical ML Thinks like a researcher, moves like an engineer. Creative, scrappy, comfortable in ambiguity Startup experience... 

    Taste Labs

    San Francisco, CA
    3 days ago
  • $170k - $210k

     ...Research Engineer, Coding Agent Optimization Engine San Francisco, in person · Full-time · Entelligence Coding agents ship more code every week, and they fail in repeatable ways: the same wrong assumption, the same missed test, the same review comment on PR after... 
    Full time

    Entelligence

    San Francisco, CA
    1 day ago
  • $130k - $225k

     ...Job Description Job Description About the Role Join a research and engineering team building privacy and anonymization systems for sensitive data used in AI training. You will help protect personal and confidential information while preserving the structure and utility... 
    Visa sponsorship

    Clera

    San Francisco, CA
    5 days ago
  • $220k - $300k

     ...Catalyst, and Optum Ventures. We’re about 35 people, working in person in New York and San Francisco. About this role As a Research Engineer, Voice AI at Concurrence, you'll build and tune speech models for patient conversations and ambient clinical audio. You'll own... 
    Full time
    Flexible hours

    Concurrence

    San Francisco, CA
    1 day ago
  • $140k - $250k

     ...This is the company's top hiring priority and a genuinely hard research problem. Because data flows through a decentralized marketplace...  ...scale is the single biggest bottleneck to growth. As a Research Engineer, you will build the automated systems that verify and assure... 
    Full time
    Work at office

    talentpluto

    San Francisco, CA
    7 days ago
  • $125k - $400k

     ...Description Job Description About idler idler is a frontier data research lab. We build the evals and environments that the world's...  ...some of our work here: About the role As a Research Engineer at idler, you’ll build the systems and infrastructure that our... 
    Work at office
    Relocation package

    Idler

    San Francisco, CA
    6 days ago
  •  ...Description Job Description Bridge the gap between cutting-edge research and production systems. Build and implement research...  ...technical documentation Bridge communication between research and engineering teams What We're Looking For ~3+ years of experience in... 

    Engramme

    San Francisco, CA
    19 days ago
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Agency and Reasoning , you will be a core contributor to Zyphra’s Agency and Reasoning Team. You will be involved with... 
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    25 days ago
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models , you will be a core contributor to Zyphra’s BCI work, building the next generation of open... 
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    6 days ago
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will be a core contributor on Zyphra’s Audio Team, building the next generation of open-source... 
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    25 days ago
  •  ...Job Description Job Description The Role: As a Research Engineer - Vision & Vision-Language Models , you will be a core contributor on Zyphra’s Vision Team, building the next generation of models for image understanding, computer use, and other agentic visual... 
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    4 days ago
  • $200k - $375k

     ...runtime that understands complex enterprise systems, the tooling experience developers use every day, and the analysis and planning engine that transforms legacy code. You will work directly with customers on high-leverage projects and help define our culture, our... 
    Visa sponsorship

    FlowGen Labs

    San Francisco, CA
    8 days ago
  •  ...the race to build frontier AI. The Impact You'll Make Our research team is expanding to keep pace with a wave of frontier-facing...  ...opportunities at the cutting edge of the field. As a Research Engineer, you'll take a research direction and run with it – finding the... 
    Full time

    SuperAnnotate AI

    San Francisco, CA
    27 days ago
  •  ...software development, helping the world's largest enterprise engineering teams turn their organizations into autonomous software factories...  ...). About the Role Factory is seeking innovative Research Engineers to design and integrate advanced AI and ML capabilities... 
    Full time
    Work at office

    The San Francisco AI Factory

    San Francisco, CA
    4 days ago
  •  ...A research engineer in this setting typically turns research ideas into working training and evaluation pipelines for long horizon tasks. A strong candidate brings solid coding, comfort with model training and experimentation, and the patience to run careful comparisons... 
    Shift work

    present of AI

    San Francisco, CA
    3 days ago
  •  ...Research EngineerDatacurve provides the frontier coding data that powers the world's most advanced models. We absorb and standardize deeply...  ...knowledge to create the world's first autonomous data engine, allowing us to teach the next generation of models (big and small... 
    Shift work

    Datacurve

    San Francisco, CA
    4 days ago
  •  ...Research EngineerWe're reverse-engineering the origin of life — one of the great unsolved problems in science, and one we think AI finally makes tractable. We believe that understanding this transition, from geochemistry to biochemistry, will let us orchestrate molecular... 
    Visa sponsorship
    Shift work

    Dayhoff Labs

    San Francisco, CA
    1 day ago
  •  ...large teams coordinating over long timescales. We are making agents that do that coordination directly. What you'll do The research that matters most to us comes straight out of deployment: getting agents to multi-task, learn, remember, and operate reliably over... 

    Orin Labs, Inc.

    San Francisco, CA
    1 day ago
  •  ...healthcare and prescriptions. Our team includes ex-founders and engineers who have built and scaled consumer apps to millions of users,...  ...and Stanford. Role Overview We are hiring a Founding Research Engineer to design, prototype, and ship the core reasoning and... 

    Lotus

    San Francisco, CA
    1 day ago
  • $225k - $400k

     ...Research EngineerTitle of Role: Research EngineerLocation: San Francisco, onsiteCompany Stage of Funding: Venture-Backed — Software Development, AI, Devtools, Data, Enterprise, B2BOffice Type: OnsiteSalary: $225K–$400KCompany DescriptionWe're representing a dynamic venture... 

    Recruiting from Scratch

    San Francisco, CA
    1 day ago
  •  ...training. About David AI David AI is the first audio data research company. We bring an R&D approach to data-developing datasets...  ...David AI was founded in 2024 by a team of former Scale AI engineers and operators. In less than a year, we’ve brought on most FAANG... 
    Work at office

    David AI Labs, Inc.

    San Francisco, CA
    3 days ago
  • $120k - $200k

     ...Research Engineer Specializing In Machine Learning And AiWe are actively seeking a research engineer specializing in machine learning and AI to play a pivotal role in pioneering advanced solutions. In this role, you will lead end-to-end research projects and contribute... 
    Casual work
    Work at office

    Erth.AI Inc.

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer. Be the first to apply!