Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer

$175k - $195k

Gauntlet

The role

Gauntlet is looking for an AI Research Engineer to help improve how we build, evaluate and use AI agents across the business.

We already have agents running in production, including Aria, our in‑house generalist agent. They're used across research, engineering and business workflows, and we've learned a lot from seeing how they perform in practice. Some tasks work extremely well; others produce inconsistent results, and changes to models or tooling can introduce unexpected problems. Today, much of that feedback is still subjective. We want to build a more systematic way of understanding what works, what doesn't and why.

A major part of this role will be building the evaluation frameworks that allow us to measure agent performance on real tasks. You'll work with our engineers, quantitative researchers and other teams to understand where agents struggle, turn those observations into measurable experiments, and use the results to improve the systems we're building.

You’ll also contribute directly to our existing agents and internal tooling. Initially, the work will be more engineering-focused as you get familiar with our systems, shipping improvements and integrations that teams can use. Over time, you’ll take on more open-ended research, helping us develop better approaches to evaluation, agent behaviour and infrastructure.

We're also thinking beyond individual agents. One of our longer-term goals is to build a shared system of knowledge and reusable skills that our agents can draw from and improve over time. You’ll play an important role in developing that infrastructure and how we evaluate its effectiveness.

This is an applied research role with a meaningful engineering component. We're looking for someone who enjoys investigating difficult problems, can design good experiments and is comfortable building and shipping the solutions that come out of them.

About Gauntlet

Gauntlet builds the financial systems of the future. While much of onchain finance is focused on point solutions, we operate across the entire stack to offer best-in-class vault products. Today we serve over $1.7B in client TVL across some of the largest fintechs/neobanks, protocols, exchanges, and capital allocators in crypto - and, increasingly, traditional asset management. Our team brings together traditional finance and crypto-native expertise to deliver durable, sophisticated products for institutional clients moving onchain.

Why this role is different

This is an opportunity to work at the intersection of AI, quantitative research and DeFi, tackling problems where advances in AI can have a direct impact on financial markets and onchain strategies.

You’ll go beyond building individual agents, helping define how they’re evaluated, how they learn from real-world tasks and how their capabilities scale across the business. With few established benchmarks in this space, you’ll have the freedom to explore new approaches and take your ideas from research through to production, working directly with the teams putting them to use.

What you’ll do;
  • Build evaluation frameworks for AI agents, including datasets, sandbox environments and metrics that measure performance on real-world tasks.
  • Design experiments to compare models, agent harnesses, tools and execution environments, identifying regressions and understanding the trade-offs between performance, reliability and cost.
  • Work with teams across Gauntlet to turn qualitative feedback about agent behaviour into concrete research questions, experiments and measurable outcomes.
  • Investigate agent failures, understand whether problems come from the model, harness, tooling or prompting, and develop ways to improve performance.
  • Build and improve agent harnesses, internal tools and integrations, including contributing to Aria and other agents used across the business.
  • Help develop shared knowledge and reusable skills across agents, creating systems that can learn from previous work and improve over time.
  • Work alongside Infrastructure and Security to ensure agents can operate reliably and safely within our production environment.
What we're looking for;
  • Hands‑on experience building, evaluating or improving LLM models or agents, whether through professional work, applied research, open‑source contributions or substantial personal projects.
  • Strong Python skills and good software engineering fundamentals. You’re comfortable writing production‑quality code and understand the importance of testing, maintainability and reliability.
  • Experience with applied research, machine learning or data science, including designing experiments, working with datasets and drawing conclusions from results.
  • A good understanding of how LLM agents work beyond prompting, including tool use, harnesses, context management and common failure modes.
  • The ability to take an open‑ended problem, break it down into testable questions and work independently towards a solution.
  • Experience building tools or systems that other people use, with an understanding of how to evaluate their effectiveness beyond technical benchmarks.
  • Comfort working across research and engineering, collaborating with different teams and adapting as priorities change.
  • Genuine interest in AI agents and how they can be made more capable, reliable and useful.
Nice to have;
  • Experience building LLM evaluation pipelines, benchmarks, reinforcement learning environments or model testing infrastructure.
  • Contributions to open‑source agent frameworks, harnesses, evaluation datasets or benchmarks.
  • Experience with agent frameworks such as Hermes, OpenClaw or similar tools.
  • Experience in applied ML research, model training, fine‑tuning or reinforcement learning.
  • An advanced degree or postgraduate research experience in computer science, mathematics, statistics, machine learning or a related field.
  • Experience in financial markets, quantitative research, DeFi or risk modelling.
  • Familiarity with AI security considerations, including access controls, prompt injection and data protection.

You don’t need prior experience in crypto or DeFi. Strong research and engineering fundamentals matter more, and you’ll work closely with people across Gauntlet who understand the financial systems and strategies our agents support.

We expect strong candidates to have experience working in a professional engineering or research environment, but we’re more interested in what you’ve built and how you approach problems than a specific number of years on your CV.

Benefits & Perks;
  • Remote first — work from anywhere in the United States
  • Regular in‑person company retreats and cross‑country "office visit" perk
  • 100% paid medical, dental, and vision premiums for employees
  • $1,000 WFH stipend
  • Monthly reimbursement for home internet, phone, and cellular data
  • Unlimited vacation
  • 100% paid parental leave of 12 weeks
  • Fertility benefits
  • Opportunity for incentive compensation

Please note at this time our hiring is reserved for potential employees who are able to work within the contiguous United States and Canada. Should you need alternative accommodations, please note that in your application.

The national pay range for this role is $175,000 - $195,000 base plus additional On Target Earnings potential by level and equity in the company. Our salary ranges are based on paying competitively for a company of our size and industry, and are one part of many compensation, benefits and other reward opportunities we provide. Individual pay rate decisions are based on a number of factors, including qualifications for the role, experience level, skill set, and balancing internal equity relative to peers at the company.

#LI-Remote

#J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Engineer in New York, NY vacancy
  • $50 per hour

     ...organization spread across the U.S. and Canada. Sony AI is Sony's new research organization pursuing the mission to use AI to unleash human...  ...Summary We are seeking a motivated and passionate Research Engineer Intern to join our interdisciplinary team working at the... 
    Suggested
    Hourly pay
    Internship
    Local area
    Remote work
    Worldwide

    Sony

    New York, NY
    5 days ago
  • $200k - $400k

     ...Research Engineer | Applied AI | LLMs | Machine Learning | New York | $200k - $400k Fudo Partners is partnering with an ambitious, venture backed AI company to identify a Research Engineer who can take advanced machine learning research and turn it into powerful, production... 
    Suggested
    Full time

    Fudo Partners

    New York, NY
    2 days ago
  • $150k - $250k

     ...such as ABB, we’re redefining what’s possible in robotics and automation. Role Overview We’re looking for a Founding Research Engineer to join our core team and develop the intelligence behind robots that can learn and adapt to new tasks. You’ll work at the... 
    Suggested

    Mbodi AI

    New York, NY
    1 day ago
  •  ...Research Engineer / Quantitative Research Engineer A leading quantitative trading firm is seeking experienced Software and Research Engineers to join teams building the core technology that powers quantitative research and systematic trading. The focus is on solving... 
    Suggested
    Full time

    Acquire Me

    New York, NY
    3 days ago
  • $150k - $250k

     ...Founding Research Engineer Location: New York City — In Person Compensation: $150,000–$250,000 Base Salary + Equity Company Overview We are an early-stage quantitative investment firm building an AI-powered research system that transforms investment ideas into... 
    Suggested

    The Cypress Group

    New York, NY
    4 days ago
  •  ...We're a different kind of AI lab. Our research sits at the crossroads of database systems and interoperability, and it's shaped by real...  ...next. About the Role We're hiring a Founding Software Engineer to build products from the ground up and turn early stage research... 
    Full time
    Immediate start

    Mentor Talent Acquisition

    New York, NY
    3 days ago
  •  ...Research EngineerNew York - Hybrid; San Francisco Bay Area - HybridAbout InvisibleInvisible Technologies makes AI work. Our end-to-end...  ...environments for frontier labs and enterprise clients. As a Research Engineer, you'll work on how frontier models are measured, meaning the... 
    Full time
    Work at office
    Local area
    Remote work

    Invisible Technologies Inc. Defunct

    New York, NY
    1 day ago
  •  ...and In-Q-Tel.Role SummaryTwenty builds offensive cyber capabilities for the United States and its allies. We're looking for a Research Engineer who can turn an understanding of adversary behavior into software that works in operational environments.You'll investigate emerging... 
    Full time
    Flexible hours

    Twenty Inc.

    New York, NY
    3 days ago
  • $200k - $300k

     ...non-siloed, collaborative coding environment empowers talented engineers to make significant contributions and see their impact daily....  ...in the field. We are seeking highly motivated and skilled Research Engineers who will work very closely with our Algo Developer (... 
    Temporary work
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    1 day ago
  •  ...OpenAI, Cursor, and SKIMS, our company is positioned at the intersection of AI, technology, and culture.The RoleWe're looking for Research Engineers to help us build the next generation of our avatar and virtual try-on models. This role is in-person from our office in NYC.... 
    Work at office

    Doji

    New York, NY
    10 hours ago
  • $175k - $225k

     ...team that intimately collaborates with traders and quantitative researchers to implement, refine and deploy alpha signals, evaluate and...  ...that stand the test of time. About the Role As a Research Engineer , you will be an integral member of a systematic trading team... 
    Temporary work
    Flexible hours

    DRW

    New York, NY
    4 days ago
  •  ...Research EngineerAs a Research Engineer on our team, you will work on real production use cases of LLMs and other ML techniques to solve business problems and create groundbreaking AI applications. The role requires that you develop a deep understanding of our product... 
    Full time
    Work at office

    Forus

    New York, NY
    10 hours ago
  •  ...Research EngineerPercepta's mission is to transform critical institutions with applied AI. We care that industries that power the world...  .... We bring together:Forward-deployed expertise in engineering, product, and researchMosaic, our in-house toolkit for rapidly... 
    Work at office
    Flexible hours

    Percepta

    New York, NY
    3 days ago
  • $200k - $250k

     ...United States Industry: Trading Firm Posted: Contact: Ethan Hudson Email: Phone: Job Title Research Engineer Location New York, NY About the Opportunity We are seeking a disciplined and creative Research Engineer to... 
    Immediate start

    Objective Paradigm

    New York, NY
    1 day ago
  •  ...Research EngineerSesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in...  ...are needed to realize all of our product goals. As a Research engineer at Sesame, you are a research-oriented person with experience in... 
    Full time
    Contract work
    Shift work

    SESAME

    New York, NY
    10 hours ago
  •  ...Research Engineer As a Research Engineer on our team, you will work on real production use cases of LLMs and other ML techniques to solve business problems and create groundbreaking AI applications. The role requires that you develop a deep understanding of our product... 
    Full time
    Work at office

    Forus

    New York, NY
    1 day ago
  •  ...how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. As a  Research Engineer , you will be an integral member of a systematic research team comprised of experienced technologists, quantitative researchers... 
    Immediate start

    DRW Holdings, LLC

    New York, NY
    4 days ago
  •  ...improving the human condition through medical education, scientific research, and direct patient care. At NYU Langone Health, equity and...  ...We have an exciting opportunity to join our team as a Research Engineer. The successful applicant will join a team working on... 

    NYU Grossman School of Medicine

    New York, NY
    10 hours ago
  • $60k - $80k

     ...Description FULL TIME RESEARCH ENGINEER New York University Tandon School of Engineering The Visualization Imaging and Data Analysis Center (VIDA) at NYU's Tandon School of Engineering is a multidisciplinary research hub focused on developing innovative solutions... 
    Full time
    Immediate start

    New York University

    New York, NY
    10 hours ago
  • $4,500 - $5,800 per week

     ...Job Description At Citadel, Quantitative Research Engineers work closely with Quantitative Researchers to develop and implement automated trading system software solutions. These solutions utilize advanced statistical and quantitative techniques to tackle complex financial... 
    Internship
    Flexible hours

    Citadel

    New York, NY
    2 days ago
  •  ...team spanning robotics, machine learning, hardware and software engineering, the business is developing its technology in-house, from...  ...commercial progress, the company is now looking to expand its research capabilities with a senior technical hire who can help shape the... 
    Full time

    Insight Recruitment

    New York, NY
    3 days ago
  • $197.3k - $313.7k

     ...TeamSalesforce AI is looking for talented software and platform engineers to embed in our AI team to bridge the gap between frontier AI...  ...where your engineering skills directly enable world-class research and products used by millions?At Salesforce, we are driving the... 
    Full time

    Salesforce

    New York, NY
    2 days ago
  • $10k

     ...Ramp is the place to do it.About Ramp LabsRamp Labs is Ramp's AI research group. We post-train models on finance work, build the...  ...people used to make real decisionsStrong Python and software engineering; your eval code is reproducible and fastStatistical judgment:... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    1 day ago
  • $127k - $235k

     ...solutions for customers? Then come and apply your skills and passion for technology at Thomson Reuters Labs.We are seeking a Senior Research Engineer who will bring expertise in AI and ML and is interested in building data-driven capabilities that transform the way legal,... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Thomson Reuters

    New York, NY
    4 days ago
  • $175k - $250k

     ...FINRA, and other organizations.What you’ll doAs a Machine Learning Engineer - Applied Scientist you will play a critical role in developing...  ..., and time series analysis. You will manage all aspects of the research process including methodology selection, data collection and... 
    Work experience placement

    Point72

    New York, NY
    4 days ago
  • $174k - $253k

    Apply research ideas to high-impact problems by prototyping, curating datasets, and deploying optimized machine learning systems.Architect...  ...agent performance and achieve research objectives.Influence engineering best practices by championing code reviews, mentoring team... 
    Full time

    Google

    New York, NY
    3 days ago
  • $300k

     ...Jump Trading Group is committed to world class research. We empower exceptional talents in Mathematics, Physics, and Computer Science...  ...of a dynamic group of traders, quantitative researchers, and engineers who work together to examine the global markets, seeking to understand... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    1 day ago
  • $300k

     ...Jump Trading Group is committed to world class research. We empower exceptional talents in Mathematics, Physics, and Computer Science...  ...of a dynamic group of traders, quantitative researchers, and engineers who work together to examine the global markets, seeking to understand... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    1 day ago
  •  ...We’re looking for a Research Engineer to build the intelligent systems that power Antimetal. You’ll prototype new approaches, run experiments, and own the path from research to production. You’ll work closely with platform and product to shape agent capabilities and... 
    Full time
    Work at office
    Night shift

    antimetal

    New York, NY
    7 days ago
  • $170k - $300k

     ...resulting network enables biopharma companies to design better research, launch new drugs more effectively, and invest in harder-to-treat...  ...are in person in New York. About the role As a Research Engineer on our team, you will work on real production use cases of LLMs... 
    Full time
    Work at office

    Forus

    New York, NY
    16 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer. Be the first to apply!