Japan Litigation Expert & AI Benchmark Reviewer
Dorado
Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Japanese law. We are hiring experienced litigation & disputes lawyers to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric. Requirements include 2+ years in a law firm focused on litigation or disputes, qualification to practise in Japan, and native to fluent Japanese. #J-18808-Ljbffr Dorado
- Mercor is partnering with a leading legal AI company to benchmark how AI systems answer real questions of Australian law. We are hiring experienced litigation & disputes lawyers to serve as expert reviewers, running the same prompts through two AI platforms, comparing...Litigation
- Mercor, partnering with a leading legal AI company, is seeking experienced litigation and disputes lawyers to act as expert reviewers. You will run prompts through two AI platforms, then compare results and score them against a standardized rubric. Requirements include...Litigation
- Mercor is seeking experienced litigation and disputes lawyers to act as expert reviewers for AI benchmarking against Spanish law. You will run prompts on two AI platforms, compare results side-by-side, and score them using a standardized rubric. Concise written feedback...Litigation
- ...role focuses on authoring and verifying challenging chemistry questions and establishing high-quality evaluation standards for AI benchmarks. Ideal candidates hold a PhD or are pursuing one, with strong knowledge of reaction mechanisms, materials chemistry, and quantitative...SuggestedRemote jobPart time
- Mercor is seeking independent contractors to work on a benchmarking dataset project evaluating AI models in the Applied Sciences, focusing on visual document understanding. This remote role offers flexible hours (approximately 15-20 hrs/week) and the opportunity to collaborate...SuggestedRemote jobFor contractorsFlexible hours
$50 per hour
A leading AI research accelerator is looking for remote PhD candidates in Chemistry, Chemical Engineering, or related fields. You will... ...to evaluate AI performance and collaborate with researchers on benchmarks. This role offers flexible hours and a pay rate of over $50/hour...Remote jobHourly payFlexible hours$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...Collaborate with subject matter experts to ensure consistency and relevance... ...@mercor.com PS: Our team reviews applications daily. Please...Contract workSummer workWork at officeRemote work- AuraOne seeks a GIS & Geospatial Expert to review AI outputs across geospatial reasoning, calculations, and research workflows. You will reproduce key derivations, check assumptions, and document the correct method so the modeling team can train on it. This remote contractor...Remote jobHourly payFor contractors10 hours per week
- AuraOne seeks a Biology AI Subject-Matter Expert to remotely review model outputs across biology reasoning and calculations. You will reproduce key results, document correct methods, and flag errors to help train the modeling team. Requirements include graduate-level biology...Remote job10 hours per week
- Overview Join our Law Expert Network to connect with leading AI labs and companies seeking your expertise. This is an open application for future... ...experience in legal research & writing, contract drafting & review, litigation & dispute resolution Strong communication skills...LitigationRemote jobContract work
- Turing Global India is seeking a Politics Domain Expert to evaluate and improve Large Language Models. You will design challenging prompts across political science, governance, elections, public policy and international relations, and assess factual accuracy and reasoning...For contractors
- Obsidian is offering a remote project role focused on evaluating AI models in the Applied Sciences domain, specifically in Physics, Chemistry, and Biology. The position requires expertise in creating complex tasks and can accommodate approximately 15-20 hours per week....Remote jobFor contractors
$65 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...Dorsey . Position: Legal Expert Type: Contract Compensation... ...Role Responsibilities Review and evaluate written content and...Contract workSummer workRemote work10 hours per week$100 per hour
...seeking PhDs in Physics or related fields for a fully remote contract position. The role involves designing physics problems to evaluate AI performance and collaborating with researchers on cutting-edge projects. Candidates should possess strong problem-solving skills and...Remote jobContract workFlexible hours$90 - $100 per hour
...technical talent with leading AI research labs. Headquartered... ...Francisco, our investors include Benchmark, General Catalyst, Peter... ...scenarios spanning civil rights litigation, environmental compliance and... ..., regulatory compliance review, impact litigation strategy)...LitigationContract workSummer workWork at officeRemote work- Join a leading AI lab's cutting-edge GenAI team to... ...a senior legal domain expert to work directly with a... ...of this role. You will review the quality of legal knowledge... ...like, and build the benchmarks that show whether the... ...and transactional, litigation and dispute resolution,...LitigationRemote jobFull timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package
$60 - $80 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...Collaborate with other subject matter experts to ensure consistency and... ...@mercor.com PS: Our team reviews applications daily. Please complete...Contract workSummer workRemote workWeekday work$20 - $22 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...Dorsey . Position: AI Safety Experts — English & Bengali Type:... ...****@*****.*** PS: Our team reviews applications daily. Please...Contract workSummer workRemote work- ...Mercor, we believe the safest AI is the one that’s already... ...for this project - human data experts who probe AI models with adversarial... .... This project involves reviewing AI outputs that touch on sensitive... ...: follow taxonomies, benchmarks, and playbooks to keep testing...Remote work
- Remote Mathematics Expert (AI/LLM) - 34877 Remote Mathematics Expert (AI/LLM) - 34877 1 week ago Be among the first 25 applicants Turing... ...symbolic manipulation). Contribute to defining new evaluation benchmarks based on Mathematics curricula spanning early undergraduate to...Remote jobHourly payContract workPart timeFor contractorsFreelanceInternshipAfternoon shift
- Obsidian seeks expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous MC questions... ..., and help establish gold-standard benchmarks used to advance AI capabilities. You will...Remote job
- We are seeking experienced AI Safety Red Teamers to identify vulnerabilities in frontier AI systems through adversarial testing.... ...sensitive domains. Document vulnerabilities and contribute to safety benchmarking and red-teaming reports. Collaborate with AI researchers to...
- Obsidian is seeking experienced AI Safety Red Teamers to identify vulnerabilities in frontier AI systems through adversarial testing... ...unsafe behaviours, and document weaknesses to inform safety benchmarks and red-teaming reports, collaborating with researchers to improve...
- micro1 is seeking a Physics Expert with deep knowledge in gravitation, cosmology, and astrophysics... ...remotely. You will work on training AI systems using domain knowledge to... ...input and contribute to frontier research benchmarks. Preferred candidates hold a PhD in physics...Remote jobFor contractors
- Obsidian is seeking expert biologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple... ...quality, and help establish gold-standard benchmarks used to advance AI capabilities. This fully...Remote job10 hours per weekFlexible hours
$60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam... ...superficial reasoning. Evaluate models by reviewing attempts and identifying immediate mistakes....Contract workSummer workImmediate startRemote work- ...is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who... ...problems in your area of expertise, contribute to benchmarking efforts, and help push the #J-18808-Ljbffr...Remote jobContract workImmediate startFlexible hours
- Expert Prompt Curators for Advanced AI Evaluation Dataset This description is a summary of our understanding... ...capabilities. The goal is to create a benchmark dataset that pushes the limits of... ...dataset organization. Collaborate with reviewers for expert validation and prompt...Hourly payContract workTemporary workFor contractorsRemote work
- Obsidian is seeking expert chemists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous MCQs across... ...domains and help establish gold-standard benchmarks for AI capabilities. You will work...Remote job10 hours per week
- .../medium projects for our Delay and/or Quantum experts involved in domestic and international arbitration and litigation. As a Vice President, you’ll work with projects... ...the tasks/workload of the project team and reviewing their work product to ensure quality standards...Litigation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Japan Litigation Expert & AI Benchmark Reviewer. Be the first to apply!
- sql expert New York, NY
- subject matter expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- technology expert New York, NY
- business litigation attorney New York, NY
- pre-litigation paralegal New York, NY
- civil litigation New York, NY
- litigation manager New York, NY
- litigation claims adjuster New York, NY


