Remote AI Legal Evaluator & Rubric Architect (Attorney)
$45 - $55 per hourConsilio LLC
- Remote job
Consilio LLC is seeking an AI Expert Contributor (Attorney) for a remote, part-time role in the United States. You will apply real attorney judgment to evaluate legal questions, refine rubrics, and ensure objective grading criteria for AI-generated legal work. Responsibilities include reviewing legal queries, validating citations, and maintaining confidentiality while leveraging online legal research and AI tools. Start ASAP, approx. 10 hours/week for one month+ with pay at $45–$55/hour (W2). #J-18808-Ljbffr Consilio LLC
- ...Attorney — AI Legal Evaluator is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory... ...advising on real matters. Comfort applying multi-page rubrics consistently across long batches. Clear written...Remote jobLegalHourly payFor contractors10 hours per week
- A leading AI consultancy firm is seeking legal consultants for project-based opportunities involving testing and improving AI systems. Candidates should... ...during active project phases. Opportunities are available remotely for qualified candidates. #J-18808-Ljbffr MindriftRemote workLegalPermanent employmentFreelance10 hours per week
- ...microbiology and neuroscience to craft and evaluate research-level AI tasks. You will write questions with... ...answers and assess model reasoning against rubrics, handling both physics and biology tracks as described. This is a remote, hourly contract with flexible part-time...Remote jobHourly payContract workPart timeFlexible hours
- AuraOne is seeking a Civil Rights Attorney to remotely review AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning... ...reviewing matters, and the ability to apply multi-page rubrics consistently across large batches. #J-18808-Ljbffr...Remote jobLegal
- AuraOne, Inc. seeks a Civil Rights Attorney (BigLaw Firms) for a remote reviewer role evaluating AI-generated legal outputs. You will assess citations, statutory reasoning... ...drafting or advising, and the ability to apply rubrics across long batches with clear, authority-...Remote jobLegal
- AuraOne, Inc. seeks a remote Military Law Attorney reviewer to assess AI outputs for citation accuracy, statutory reasoning... ...role requires active or recent legal review qualifications, hands-on... ...experience, and the ability to apply rubrics consistently. Strong written...Remote jobLegalFor contractorsFlexible hours
- AuraOne, Inc. is seeking a diligent remote contractor to evaluate at-work video recorder outputs against a versioned rubric. You will assign severity tags, write rationales, and help identify edge cases for quality control. Responsibilities include comparing responses,...Remote jobFor contractors
- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
- ...A leading AI research firm is seeking experienced legal professionals to contribute to projects that enhance AI systems. You will leverage your expertise... ...experience and a Juris Doctor degree. The position is fully remote, with strong compensation and a contractor assignment...Remote workLegalFor contractors
$60 per hour
A specialized legal consulting firm seeks legal consultants and attorneys familiar with US law for part-time, project-based roles. The position involves generating prompts for AI, evaluating AI solutions for correctness, and improving AI reasoning. Ideal candidates possess...LegalPart timeFreelance10 hours per weekFlexible hours$60 per hour
A tech consulting firm is seeking legal consultants to engage in project-based opportunities evaluating AI systems. Ideal candidates include those with a law degree and experience in US law, able to commit to part-time tasks of 10-20 hours a week. As contributors, you...LegalPart timeFreelance$60 per hour
A leading technology firm based in the United States is seeking legal consultants for project-based AI opportunities. The role involves generating prompts, evaluating AI solutions, and improving AI reasoning. Candidates should have a law degree and at least two years of...LegalFreelanceFlexible hours$60 per hour
A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law... ...organisation is growing, and we are hiring a Freelance US Law Attorney — AI Project Evaluator in New York, NY, United...LegalPermanent employmentPart timeFreelanceImmediate startFlexible hours$60 per hour
A specialized AI consultancy is seeking legal consultants for project-based roles evaluating AI systems. Ideal candidates will have a law degree and at least two years of legal practice experience within US jurisdiction. Responsibilities include generating prompts to challenge...LegalPart timeFreelance10 hours per week$60 per hour
A tech consulting firm is seeking legal consultants with US law experience for part-time, project-based opportunities. You will generate prompts for AI, evaluate solutions, and improve reasoning standards. Ideal candidates have a law degree and 2+ years of legal experience...LegalPart timeFreelance$60 per hour
A tech consultancy seeks legal consultants for part-time, project-based work in AI evaluation. The role involves generating challenges for AI, assessing legal validity of AI outputs, and ensuring solutions meet established standards. Ideal candidates have a legal degree...LegalPart timeFreelance10 hours per weekFlexible hours$60 per hour
A tech consulting firm is seeking legal consultants or attorneys experienced in US law to evaluate AI systems on a project basis. This role requires strong written English proficiency and a degree in law. Contributors will generate prompts, assess AI solutions, and improve...LegalHourly payFreelance10 hours per week$60 per hour
A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience in US law. Candidates must have strong written English skills and a stable...LegalPermanent employmentPart timeFreelanceFlexible hours$60 per hour
Mindrift in New York, NY is seeking a Freelance US Law Attorney — AI Project Evaluator. The role is part-time and non-permanent, focusing on evaluating AI systems and assessing legal risk in a dynamic consulting environment. The position requires a law degree, at least...LegalHourly payPermanent employmentPart timeFreelanceFlexible hours- ...A leading AI research accelerator is seeking a Licensed Attorney to enhance AI systems through legal expertise. Responsibilities include writing... ...legal analyses, evaluating AI responses, and collaborating... ...offers strong compensation, remote work, and project durations...Remote workLegalFreelance
- AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining...Remote jobFor contractors10 hours per week
$30 per hour
...technical talent with leading AI research labs. Headquartered in... ...: $30/hour Location: Remote Commitment: 10 hours/week Role... ...questions, and correcting errors. Evaluate the experience and deliverables... ...skills in English. Compensation & Legal Hourly contractor Paid...Remote jobLegalHourly payWeekly payContract workFor contractorsSummer work- ...digital delivery platforms ai-driven tools familiarity independent... ...agents. We provide frontier evaluations and reinforcement learning... ...high-value, specialized domains (legal, medical, finance, coding, etc... ...Type: Contractor Location: Remote micro1 is engaging Food Delivery...Remote workLegalFor contractorsShift work
- ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows... ...on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs... ...matters. Comfort applying multi-page rubrics consistently across long batches....Remote jobLegalHourly payFor contractors10 hours per week
- OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy and reasoning, and write feedback to improve models. This 100% remote, part-time freelance role requires...Remote jobLegalPart timeFreelance
- ...DecisionPoint seeks an AI/ML Architect to design artificial intelligence... ...supports experimentation, evaluation, and integration of AI/ML capabilities... .... This position is fully remote. Duties &... ...consistent with the contractor's legal duty to furnish information....Remote workLegalFor contractorsLocal area
$200k - $275k
...and cybersecurity to hire an AI Solutions Architect focused on Federal... ...opportunity offers: Fully remote work within the United States... ...into clearly scoped technical evaluations and proof-of-value engagements... ...are available at jobot.com/legal. By applying for this...Remote workLegalFor contractorsLocal areaHome officeFlexible hours- ...Government Benefits AI Evaluator is a remote evaluation track for reviewing government benefits ai evaluation... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs,... ...Government Benefits AI evaluation Legal reasoning Policy review Risk...Remote jobLegalHourly payFor contractors10 hours per week
- ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that... ...and red-flag handling on a structured rubric. Flag patient-safety issues with severity... ...writing Clinical review Legal reasoning Policy review Risk analysis...Remote jobLegalHourly payFor contractors10 hours per week
- ...Trust and Safety Policy AI Evaluator is a remote red-team track for stress-testing AI systems against... ...pair each successful jailbreak with the rubric clause it violated so the safety team... ...and Safety Policy AI evaluation Legal reasoning Policy review Risk analysis...Remote jobLegalHourly payFor contractors10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Legal Evaluator & Rubric Architect (Attorney). Be the first to apply!
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- nurse evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY

