Remote Brazilian Portuguese AI Evaluator & Rubric Specialist
AuraOne, Inc.
New York, NY
- Remote job
AuraOne, Inc. is seeking an independent contractor to review Portuguese generalist evaluation outputs. You will apply a versioned rubric to each pair of model responses, assign severity tags, and provide structured rationales for the best answer. The role emphasizes high attention to detail, robust written reasoning, and consistent rubric application across multi-page batches, with remote US eligibility and flexible weekly hours. #J-18808-Ljbffr AuraOne, Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote Brazilian Portuguese AI Evaluator & Rubric Specialist in New York, NY vacancy
- Brazilian Portuguese AI Evaluator is a remote evaluation track for reviewing portuguese generalist evaluation prompts... ...against AuraOne's quality rubric. Reviewers compare paired outputs,... ...US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR...Remote workBrazilian portugueseHourly payFor contractors10 hours per week
- YO AI Labs seeks a former U.S. Consular Officer or Passport Specialist to evaluate AI-generated guidance on passport and citizenship matters. This remote, contractor role asks for 20-30 hours per week and... ...reviewing questions, developing rubrics for complex cases, and...Remote jobFor contractors
- AuraOne, Inc. is seeking a remote AI data reviewer to evaluate agent evaluation outputs against a versioned rubric. You will label edge cases, provide rationales, and help calibrate review quality across long batches. Ideal candidates have prior evaluation or annotation...Remote jobFor contractorsFlexible hours
- AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining...Remote jobFor contractors10 hours per week
- ...connects elite creative and technical talent with leading AI research labs. The company is headquartered in San... ...a AI Safety Practitioner for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy, and policy...Remote jobContract workSummer work
- AuraOne seeks an experienced Senior Journalist / Writer for a remote evaluation track. You will review prompts and responses, compare paired outputs, label edge cases, and provide structured feedback for retraining. You’ll help turn outputs into auditable labels, rationales...Remote jobHourly payFor contractors
- ...Assessment Rubric AI Evaluator is a remote review track for evaluating AI outputs across assessment rubric ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...Humanities / arts / culture Evaluator Type: Contract Compensation... ...$80–$120/hour Location: Remote Role Responsibilities... ...against domain-specific quality rubrics. Identify factual,...Remote workContract workSummer workWork at office- ..., based in San Francisco, is seeking a Portuguese-speaking AI Analyst & Photographer contractor for a remote engagement to support AI evaluation materials. You will source authentic images... ...web research, and compile prompts, rubrics, and notes for evaluation packages. Role...Remote jobFor contractors
- AuraOne, Inc. is seeking a remote Helpfulness Ranking Reward Model Evaluator to assess paired model outputs against a versioned rubric. You will label edge cases, annotate severity, and generate structured feedback to help retrain the model. This contractor role requires...Remote jobFor contractors10 hours per week
- ...Visual Document Understanding contractor to support AI model evaluation in the real estate domain. This remote, 15-20 hours/week engagement emphasizes rigorous... ...You will review complex tasks, develop evaluation rubrics, and collaborate with subject matter experts to ensure...Remote jobFor contractors
- ...AMERICA in Cranford, NJ is seeking detail-oriented Remote K-12 Assessment Scorers and Rubric Evaluators to join our team on a part-time, flexible basis. This... ...nearing retirement, and certified assessment specialists looking for meaningful, flexible educational work without...Remote jobPart timeFlexible hours
- YO AI Labs seeks an AI Evaluation Specialist to assess enterprise AI outputs on a contractual, remote basis across the US, Canada, UK, Ireland, Australia, and New Zealand. You will apply rubrics, identify weaknesses, and provide concrete feedback to improve systems. The...Remote job
- AuraOne, Inc. is seeking a remote Rubric Ontology Data Specialist to evaluate prompts and responses against our quality rubric. Reviewers label edge cases, assign severity, and generate structured feedback to retrain our models. Your work ensures auditable labels, robust...Remote jobFor contractorsFlexible hours
- SaidGig is seeking a remote contractor to apply scientific expertise to improve AI systems through careful analysis of real-... ...accuracy and consistency, and evaluate dashboards and visualizations for... .... The role focuses on creating rubrics, interpreting complex...Remote jobFor contractors
- YO AI Labs is seeking an experienced AI Evaluation Specialist to remotely assess AI assistant outputs for an enterprise training project. The contractor will evaluate responses against detailed rubrics, identify issues, and provide actionable feedback to improve AI systems...Remote jobFor contractors
- Mercor connects elite creative and technical talent with leading AI research labs. The remote contract role evaluates AI-generated artifacts against domain-specific quality rubrics and provides clear, structured feedback to ensure accuracy and high presentation standards...Remote jobContract work
$30 - $40 per hour
OpenTrain AI, Inc. is seeking a Passport Application AI Evaluation Expert for a remote, short-term contract. You will review passport questions for realism, create rubrics for accurate answers, and define evaluation standards for identity documents, renewals, and minors...Remote jobHourly payTemporary work- ...Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and... ...decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have... ...You will assess artifacts against domain rubrics, identify errors, and provide structured...Remote jobHourly payWork at office
- ...task designer to help train future AI systems by creating expert-level evaluation tasks from authentic research... ...multi-step reasoning and rigorous rubrics, testing AI agents on real data and... ...scientific foundation matters most. Remote contract engagement with payment tied...Remote jobContract work
- AuraOne, Inc. is seeking a Management Consultant — AI Workflow Evaluator as a remote contractor to assess AI workflow evaluation outputs against a quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain models. The...Remote jobFor contractors
- Mercor is seeking a contract Evaluator in the humanities/arts domain to assess AI-generated artifacts against domain rubrics. Remote work arrangement allows asynchronous collaboration with researchers. You will identify factual, aesthetic, and presentation errors in documents...Remote jobContract work
- AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows and firm policies. You will grade... ...logic, and stakeholder fit using a structured rubric. Flexible US-based remote contractor role with at...Remote jobFor contractors10 hours per weekFlexible hours
$30 per hour
...Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language... ...autonomous agent systems using defined rubrics and quality standards. Review... ...experience in LLM evaluation, AI output analysis, QA/testing, UX...Remote jobHourly payContract work- OpenTrain AI, Inc. is seeking a remote contractor to evaluate language-model responses in social scenarios and provide structured feedback that helps improve... ...materials and model outputs, apply evaluation rubrics, document evidence, and explain decisions clearly in...Remote jobFor contractors
- AuraOne, Inc. is seeking an AI Data Reviewer for the Misinformation Context AI Evaluator track. This remote contractor role involves reviewing model outputs against AuraOne's rubric, labeling edge cases, and providing structured feedback to retrain prompts. You will compare...Remote jobFor contractors
- Mercor seeks a Humanities / arts / culture Evaluator for a remote contract role. You will assess AI-generated artifacts using domain rubrics, spot errors, and provide structured feedback to improve model outputs. Must have 5+ years in humanities or culture, native or professional...Remote jobContract workWork at office
- Obsidian is looking for expert Evaluators in People ops / recruiting to review AI-generated work products for accuracy and quality. This remote position requires at least 5 years of relevant... ...evaluating artifacts against quality rubrics and providing structured feedback....Remote jobWork at office
- Mercor seeks a Media / journalism / communications Evaluator to assess AI-generated artifacts against domain rubrics, drawing on a strong media background. This remote contract role requires clear, precise feedback and independent work to help improve model outputs. Responsibilities...Remote jobContract work
- AI Trainer Jobs seeks a remote independent contractor to review AI outputs for fintech operations evaluation. You will assess workflow adherence, tone, and escalation logic, assigning severity... ...and the ability to apply multi-page rubrics consistently. This contractor position...Remote jobHourly payFor contractorsFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Brazilian Portuguese AI Evaluator & Rubric Specialist. Be the first to apply!
Related searches