Research Engineer
Judgment Labs
The Role: We are looking for Research Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback. Your research will not live on a whiteboard. You'll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems. What You'll Do:
- Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals
- Design and implement post-training and optimization workflows to improve agents, both internally and for customers
- Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows
- Build internal tools and infrastructure that support rapid experimentation, analysis, and training
- Work closely with product to integrate agents into customer-facing workflows
- Collaborate with external companies and research partners on frontier AI research
- Agency. You are intellectually curious, self-directed, and stay up to date with the latest research, blogs, trends, and ideas.
- Depth of thought. You can reason clearly about abstract systems, and ideally have experience working on agents, RL, or the infrastructure that supports them.
- Ownership. You own outcomes, not just tasks. You use freedom to experiment responsibly, make business-driven decisions, and focus first on work that moves the company forward.
- Data quality, evaluation, benchmarking, and hands-on work with messy production data
- Agent systems built or evaluated in real-world or production settings
- Reinforcement learning, post-training, agents, or machine learning fundamentals
- Infrastructure and systems work across training, data pipelines, evaluation, or model serving
- Translating research into product while balancing customer constraints, technical tradeoffs, and business impact
- Turning ambiguous problems into clear, well-designed plans
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Engineer in San Francisco, CA vacancy
$110.7k - $379.2k
Position Summary Research Engineer — Post-Training & Small Language Models (SLMs), Healthcare AI Three hundred fifty million Americans rely on a healthcare system whose decision-making has become slow, costly, and adversarial — care delayed by prior authorization...SuggestedLocal areaVisa sponsorship$197.3k - $313.7k
...TeamSalesforce AI is looking for talented software and platform engineers to embed in our AI team to bridge the gap between frontier AI... ...where your engineering skills directly enable world-class research and products used by millions?At Salesforce, we are driving the...SuggestedFull time- Factory is seeking innovative Research Engineers to design and integrate advanced AI and ML capabilities that revolutionize productivity and accelerate innovation within software organizations.What you will do and achieve:Design, develop, and deploy AI-driven agentic systems...SuggestedWork at office
$200k - $225k
About AlembicAlembic is where top engineers are solving marketing's hardest problem: proving what actually works. If you're looking for... ...teams and customers to leverage advanced analyticsDocument research and implementation decisions for reproducibility and knowledge...Suggested$164.6k - $313.3k
...s Sound Design AI group (SODA) is looking for a driven Data/ML engineer to push the boundaries of audio GenAI. Join the team behind Firefly... ...in Adobe products.We’re a small, collaborative and efficient research team looking for highly motivated candidates of all levels with...SuggestedFull timeTemporary workLocal areaWorldwide- ...and discovery. Ship models, not slide decks — partner with research and infra to prototype, train, and deploy state-of-the-art voice... ...Qualifications: Expert-level PyTorch. Proven software engineer who loves ML; comfortable writing production code across the stack...Full timeContract workFlexible hoursShift work
- ...from two founding teammates (we've accomplished a lot as just one engineer and one designer!) to a clan of around eight, so you'll be... ...Poly the "search engine for your life". Specifically, in an AI research engineer role, we are looking for the following concrete skills...
$160k - $250k
...Join to apply for the Founding Research Engineer role at Adam Join to apply for the Founding Research Engineer role at Adam This range is provided by Adam. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range...Full time- ...Research Engineer Lotus Health is a groundbreaking primary care app that integrates your medical records, AI, and real doctors to provide free, personalized healthcare and prescriptions. Our team includes ex-founders and engineers who have built and scaled consumer...
$200k - $350k
...agents, diffusion model training), second-time technical founders, engineers that made 100+ games for Voodoo, Supersonic, Sidemen and built... ...monetize highly engaging games & 3D environments. Our current research spans: Distributed multi-agent orchestration systems for...Visa sponsorshipRelocation package$140k - $250k
...Research Engineer Location: Remote (United States) Work Model: Remote Industry: AI training data infrastructure Compensation: $140K-$250K base, plus equity About the Company Our partner is a YC-backed company building a new kind of marketplace in the...Full timeWork at officeRemote work$180k - $280k
...Research Engineer SuperAnnotate helps the world's leading AI teams build responsible, next-generation models powered by high-quality human data. We're a fast-growing Series B startup bridging the gap between advanced AI innovation and the data that drives it. Our global...Full time- ...and the verifiers (how we can keep evaluating Aidan's performance in real scenarios). Making that feel human is one of the hardest engineering problems in AI, and our engineering team's unique ability to solve it is what makes Sable special. What you'll do...
$140k - $200k
...The Center for AI Safety (CAIS) is a leading research and advocacy organization focused on mitigating societal-scale risks from AI. We... ...directly to senators and policymakers. About the role As a Research Engineer (RE) or Research Scientist (RS) at CAIS, you'll lead and...Work at officeLocal area$180k - $340k
...Research Engineer You'll own the quality of AI across everything Gamma creates. As our Research Engineer, you'll design evaluation frameworks that measure AI output quality, systematically improve production prompts, and fine-tune models to ensure millions of users...Full timeWork at officeWork from home$225k
...believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more... ...compute to achieve this goal. About the role As a Research Engineer, you'll work on training, evaluating, and serving large AI...RelocationVisa sponsorship$200k - $400k
...Research Engineer As a Research Engineer, you'll be responsible for building industry-leading conversational AI models that power Decagon's agent, and taking them all the way from idea to production. You'll own multi-quarter initiatives that push the agent's reliability...Work at officeLocal area$120k - $200k
...We are actively seeking a Research Engineer specializing in Machine Learning and AI to play a pivotal role in pioneering advanced solutions. In this role, you will lead end-to-end research projects and contribute technical expertise to build scalable systems, all within...Casual workWork at office- ...their craft. We do not care about pedigree. We have a lot of work ahead of us. Join us. About the role We're hiring a Research Engineer to push Console's core agent loop from powerful to truly self-improving. As more customers rely on Console to automate critical...Work at office
- ...About Human Archive Human Archive is a research lab backed by Y Combinator focused on modeling human embodied intelligence. Humans... ...scale, join us. The Opportunity As a Research Engineer, you'll work on multimodal sensing systems and sensor fusion research...Shift work
- ...Research Engineer We're reverse-engineering the origin of life — one of the great unsolved problems in science, and one we think AI finally makes tractable. We believe that understanding this transition, from geochemistry to biochemistry, will let us orchestrate molecular...Visa sponsorshipShift work
$150k - $250k
...team includes International Olympiad medalists, serial AI startup founders, and researchers with publications at top venues (ICLR, NeurIPS, and similar). We're looking for Research Engineers to work across agent quality control automation, benchmarks, and synthetic data...Visa sponsorship$225k - $400k
...Research Engineer Title of Role: Research Engineer Location: San Francisco, onsite Company Stage of Funding: Venture-Backed - Software Development, AI, Devtools, Data, Enterprise, B2B Office Type: Onsite Salary: $225K-$400K Company Description...Work at office- ...At Resolve, we’re building Agentic AI that empowers software engineers by automating production engineering and SRE workflows. Our models... ...You’ll Do Develop AI‑powered workflows end‑to‑end, balancing research and engineering to create production‑ready AI models Build and...Full timeWork at officeVisa sponsorshipFlexible hours
- ...reinventing life sciences the same way it reinvented software engineering, and Chai is at the forefront of this shift. Leading pharmaceutical... ...the road ahead. About the role We are seeking an AI Research Engineer to help design, train, evaluate, and optimize Chai's...Shift work
$120k - $250k
...Research Engineer London, England, United Kingdom; New York, New York, United States; San Francisco, California, United States; Seattle, Washington, United States Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end...Work at officeWork from homeFlexible hours2 days per week- ...Luma AI is seeking a Research Scientist/Engineer to advance multimodal agent models across research and product integrations. You will explore modeling, data, systems and evaluation to push state-of-the-art capabilities. Join a team driving large-scale training with PyTorch...
$210k - $275k
...Research Engineer You'll build the evaluation systems that tell us whether Firecrawl actually works. That sounds simple. It isn't. Our core promise, convert any URL into clean, structured, LLM-ready data reliably, is hard to measure rigorously across millions of different...Full timeTemporary workFor contractorsRemote workVisa sponsorshipFlexible hours- ...Research Engineer San Francisco, CA, USA • Full-time About ThirdLayer ThirdLayer is solving one of the hardest problems in deploying agents: AI models are generic, but people's work and processes are specific. Our product, Dex, embeds within your computer and...Full time
- ...About Phonic Phonic is a product and research lab focused on powering the most realistic, human-like voice AI conversations. We've... ...over $30M from tier 1 VCs. About The Role As a Research Engineer at Phonic, you'll sit at the intersection of cutting-edge ML research...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer. Be the first to apply!
Related searches
- research engineer San Francisco, CA
- research programmer San Francisco, CA
- senior research engineer San Francisco, CA
- research software engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- ai research engineer San Francisco, CA
- research editor San Francisco, CA
- brain research San Francisco, CA
- research economist San Francisco, CA

