Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer

Judgment Labs

The Role:

We are looking for Research Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback.

Your research will not live on a whiteboard. You'll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems.

What You'll Do:
  • Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals
  • Design and implement post-training and optimization workflows to improve agents, both internally and for customers
  • Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows
  • Build internal tools and infrastructure that support rapid experimentation, analysis, and training
  • Work closely with product to integrate agents into customer-facing workflows
  • Collaborate with external companies and research partners on frontier AI research
What We're Looking For

Every hire clears three bars, no exceptions:
  • Agency. You are intellectually curious, self-directed, and stay up to date with the latest research, blogs, trends, and ideas.
  • Depth of thought. You can reason clearly about abstract systems, and ideally have experience working on agents, RL, or the infrastructure that supports them.
  • Ownership. You own outcomes, not just tasks. You use freedom to experiment responsibly, make business-driven decisions, and focus first on work that moves the company forward.
More specifically, you should bring strength in at least one of the following areas:
  • Data quality, evaluation, benchmarking, and hands-on work with messy production data
  • Agent systems built or evaluated in real-world or production settings
  • Reinforcement learning, post-training, agents, or machine learning fundamentals
  • Infrastructure and systems work across training, data pipelines, evaluation, or model serving
  • Translating research into product while balancing customer constraints, technical tradeoffs, and business impact
  • Turning ambiguous problems into clear, well-designed plans
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Engineer in San Francisco, CA vacancy
  • $110.7k - $379.2k

    Position Summary Research Engineer — Post-Training & Small Language Models (SLMs), Healthcare AI Three hundred fifty million Americans rely on a healthcare system whose decision-making has become slow, costly, and adversarial — care delayed by prior authorization... 
    Suggested
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago
  • $197.3k - $313.7k

     ...TeamSalesforce AI is looking for talented software and platform engineers to embed in our AI team to bridge the gap between frontier AI...  ...where your engineering skills directly enable world-class research and products used by millions?At Salesforce, we are driving the... 
    Suggested
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • Factory is seeking innovative Research Engineers to design and integrate advanced AI and ML capabilities that revolutionize productivity and accelerate innovation within software organizations.What you will do and achieve:Design, develop, and deploy AI-driven agentic systems... 
    Suggested
    Work at office

    The San Francisco AI Factory

    San Francisco, CA
    4 days ago
  • $200k - $225k

    About AlembicAlembic is where top engineers are solving marketing's hardest problem: proving what actually works. If you're looking for...  ...teams and customers to leverage advanced analyticsDocument research and implementation decisions for reproducibility and knowledge... 
    Suggested

    Alembic

    San Francisco, CA
    4 days ago
  • $164.6k - $313.3k

     ...s Sound Design AI group (SODA) is looking for a driven Data/ML engineer to push the boundaries of audio GenAI. Join the team behind Firefly...  ...in Adobe products.We’re a small, collaborative and efficient research team looking for highly motivated candidates of all levels with... 
    Suggested
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    1 day ago
  •  ...and discovery. Ship models, not slide decks — partner with research and infra to prototype, train, and deploy state-of-the-art voice...  ...Qualifications: Expert-level PyTorch. Proven software engineer who loves ML; comfortable writing production code across the stack... 
    Full time
    Contract work
    Flexible hours
    Shift work

    SESAME

    San Francisco, CA
    2 days ago
  •  ...from two founding teammates (we've accomplished a lot as just one engineer and one designer!) to a clan of around eight, so you'll be...  ...Poly the "search engine for your life". Specifically, in an AI research engineer role, we are looking for the following concrete skills... 

    Poly

    San Francisco, CA
    4 days ago
  • $160k - $250k

     ...Join to apply for the Founding Research Engineer role at Adam Join to apply for the Founding Research Engineer role at Adam This range is provided by Adam. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range... 
    Full time

    adam.ai

    San Francisco, CA
    23 hours ago
  •  ...Research Engineer Lotus Health is a groundbreaking primary care app that integrates your medical records, AI, and real doctors to provide free, personalized healthcare and prescriptions. Our team includes ex-founders and engineers who have built and scaled consumer... 

    Lotus Health

    San Francisco, CA
    3 days ago
  • $200k - $350k

     ...agents, diffusion model training), second-time technical founders, engineers that made 100+ games for Voodoo, Supersonic, Sidemen and built...  ...monetize highly engaging games & 3D environments. Our current research spans: Distributed multi-agent orchestration systems for... 
    Visa sponsorship
    Relocation package

    ROAM

    San Francisco, CA
    4 days ago
  • $140k - $250k

     ...Research Engineer Location: Remote (United States) Work Model: Remote Industry: AI training data infrastructure Compensation: $140K-$250K base, plus equity About the Company Our partner is a YC-backed company building a new kind of marketplace in the... 
    Full time
    Work at office
    Remote work

    talentpluto

    San Francisco, CA
    2 days ago
  • $180k - $280k

     ...Research Engineer SuperAnnotate helps the world's leading AI teams build responsible, next-generation models powered by high-quality human data. We're a fast-growing Series B startup bridging the gap between advanced AI innovation and the data that drives it. Our global... 
    Full time

    SuperAnnotate AI

    San Francisco, CA
    3 days ago
  •  ...and the verifiers (how we can keep evaluating Aidan's performance in real scenarios). Making that feel human is one of the hardest engineering problems in AI, and our engineering team's unique ability to solve it is what makes Sable special. What you'll do... 

    Sable AI, Inc

    San Francisco, CA
    23 hours ago
  • $140k - $200k

     ...The Center for AI Safety (CAIS) is a leading research and advocacy organization focused on mitigating societal-scale risks from AI. We...  ...directly to senators and policymakers. About the role As a Research Engineer (RE) or Research Scientist (RS) at CAIS, you'll lead and... 
    Work at office
    Local area

    AI Safety, Inc

    San Francisco, CA
    4 days ago
  • $180k - $340k

     ...Research Engineer You'll own the quality of AI across everything Gamma creates. As our Research Engineer, you'll design evaluation frameworks that measure AI output quality, systematically improve production prompts, and fine-tune models to ensure millions of users... 
    Full time
    Work at office
    Work from home

    Gamma

    San Francisco, CA
    2 days ago
  • $225k

     ...believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more...  ...compute to achieve this goal. About the role As a Research Engineer, you'll work on training, evaluating, and serving large AI... 
    Relocation
    Visa sponsorship

    Magic AI Corp.

    San Francisco, CA
    2 days ago
  • $200k - $400k

     ...Research Engineer As a Research Engineer, you'll be responsible for building industry-leading conversational AI models that power Decagon's agent, and taking them all the way from idea to production. You'll own multi-quarter initiatives that push the agent's reliability... 
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago
  • $120k - $200k

     ...We are actively seeking a Research Engineer specializing in Machine Learning and AI to play a pivotal role in pioneering advanced solutions. In this role, you will lead end-to-end research projects and contribute technical expertise to build scalable systems, all within... 
    Casual work
    Work at office

    Erth.AI Inc.

    San Francisco, CA
    4 days ago
  •  ...their craft. We do not care about pedigree. We have a lot of work ahead of us. Join us. About the role We're hiring a Research Engineer to push Console's core agent loop from powerful to truly self-improving. As more customers rely on Console to automate critical... 
    Work at office

    Console Systems, Inc

    San Francisco, CA
    2 days ago
  •  ...About Human Archive Human Archive is a research lab backed by Y Combinator focused on modeling human embodied intelligence. Humans...  ...scale, join us. The Opportunity As a Research Engineer, you'll work on multimodal sensing systems and sensor fusion research... 
    Shift work

    Human Archive

    San Francisco, CA
    4 days ago
  •  ...Research Engineer We're reverse-engineering the origin of life — one of the great unsolved problems in science, and one we think AI finally makes tractable. We believe that understanding this transition, from geochemistry to biochemistry, will let us orchestrate molecular... 
    Visa sponsorship
    Shift work

    Dayhoff Labs

    San Francisco, CA
    2 days ago
  • $150k - $250k

     ...team includes International Olympiad medalists, serial AI startup founders, and researchers with publications at top venues (ICLR, NeurIPS, and similar). We're looking for Research Engineers to work across agent quality control automation, benchmarks, and synthetic data... 
    Visa sponsorship

    CLERA

    San Francisco, CA
    2 days ago
  • $225k - $400k

     ...Research Engineer Title of Role: Research Engineer Location: San Francisco, onsite Company Stage of Funding: Venture-Backed - Software Development, AI, Devtools, Data, Enterprise, B2B Office Type: Onsite Salary: $225K-$400K Company Description... 
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    3 days ago
  •  ...At Resolve, we’re building Agentic AI that empowers software engineers by automating production engineering and SRE workflows. Our models...  ...You’ll Do Develop AI‑powered workflows end‑to‑end, balancing research and engineering to create production‑ready AI models Build and... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Resolve AI

    San Francisco, CA
    23 hours ago
  •  ...reinventing life sciences the same way it reinvented software engineering, and Chai is at the forefront of this shift. Leading pharmaceutical...  ...the road ahead. About the role We are seeking an AI Research Engineer to help design, train, evaluate, and optimize Chai's... 
    Shift work

    Chai Discovery, Inc

    San Francisco, CA
    2 days ago
  • $120k - $250k

     ...Research Engineer London, England, United Kingdom; New York, New York, United States; San Francisco, California, United States; Seattle, Washington, United States Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end... 
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Lightning AI

    San Francisco, CA
    3 days ago
  •  ...Luma AI is seeking a Research Scientist/Engineer to advance multimodal agent models across research and product integrations. You will explore modeling, data, systems and evaluation to push state-of-the-art capabilities. Join a team driving large-scale training with PyTorch... 

    Luma AI

    San Francisco, CA
    4 days ago
  • $210k - $275k

     ...Research Engineer You'll build the evaluation systems that tell us whether Firecrawl actually works. That sounds simple. It isn't. Our core promise, convert any URL into clean, structured, LLM-ready data reliably, is hard to measure rigorously across millions of different... 
    Full time
    Temporary work
    For contractors
    Remote work
    Visa sponsorship
    Flexible hours

    Firecrawl

    San Francisco, CA
    2 days ago
  •  ...Research Engineer San Francisco, CA, USA • Full-time About ThirdLayer ThirdLayer is solving one of the hardest problems in deploying agents: AI models are generic, but people's work and processes are specific. Our product, Dex, embeds within your computer and... 
    Full time

    Thirdlayer (yc W25)

    San Francisco, CA
    2 days ago
  •  ...About Phonic Phonic is a product and research lab focused on powering the most realistic, human-like voice AI conversations. We've...  ...over $30M from tier 1 VCs. About The Role As a Research Engineer at Phonic, you'll sit at the intersection of cutting-edge ML research... 
    Work at office

    Phonic

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer. Be the first to apply!