Remote AI Content Evaluator & Rubric Specialist
24-Mag Llc
Brooklyn, NY
- Remote job
24-MAG LLC seeks experienced Educator/ Assessor Writers for remote evaluation of AI-generated written responses. You will apply structured rubrics, assess clarity and relevance, and provide detailed rationales to ensure consistent quality judgments across tasks. Ideal candidates have a strong background in assessment, instructional design, and academic writing, with exceptional attention to detail and the ability to work independently in a remote setting. #J-18808-Ljbffr 24-Mag Llc
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Content Evaluator & Rubric Specialist in Brooklyn, NY vacancy
- AuraOne is seeking a Fluid Dynamics AI Reviewer to remotely evaluate prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and... ...per week. Prior experience in evaluation or content moderation is a plus. #J-18808-Ljbffr AI Trainer...Remote jobContentFor contractors10 hours per week
- ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing... ...against AuraOne's quality rubric. Reviewers compare paired... ...following failures, and unsafe content with structured tags.... ...model Remote · Independent specialist contractor Compensation...Remote workContentHourly payFor contractors10 hours per week
AI Trainer Jobs
New York, NY4 days ago - AuraOne is seeking a Children Safety Content AI Evaluator for a remote, contractor-based role. You will evaluate model outputs, compare responses, and... ...content with structured tags according to our quality rubric. Ideal candidates have prior evaluation/annotation experience...Remote jobContentFor contractors10 hours per week
- About the role Conversational AI Evaluator is a remote evaluation track for... ...against AuraOne's quality rubric. Reviewers compare paired outputs... ...failures, and unsafe content with structured tags. Capture... ...model Remote · Independent specialist contractor Compensation Hourly...Remote workContentHourly payFor contractors10 hours per week
- AI Trainer Jobs seeks a Brazilian Portuguese AI Evaluator for a remote evaluation track. Review prompts and responses against AuraOne's quality rubric, label edge cases, and write structured feedback for retraining... ...outputs, tagging unsafe content, and aligning judgments...Remote jobContentFor contractors
$20 - $160 per hour
...technical talent with leading AI research labs.... ...AI Conversation Quality Evaluation Type: Contract... ...0/hour Location: Remote Role Responsibilities... ...with applying a detailed rubric consistently. Reliable... ..., evaluation, or content review. Background in...Remote workContentContract workSummer workMercor
New York, NY8 days ago$20 - $80 per hour
...Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on... ...responses against defined rubrics and metrics across a range... ...reliability. Review content for relevance, coherence,...Remote workContentHourly payContract workFor contractorsSaidGig
United Statesmore than 2 months ago- AI Trainer Jobs is seeking an Independent contractor for a remote JavaScript and TypeScript AI Evaluator role. You will review prompts and responses against a rubric, label issues, and provide structured feedback to help retrain the model. Responsibilities include evaluating...Remote jobFor contractors
$11.5 per hour
...educational institution is offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and... ...community of contributors involved in AI advancements. #J-18808-Ljbffr...Remote workContentHourly payPart timeUniversity of Delaware
United States4 days ago$37.5 per hour
...a golden data set for AI generated ad copy for various... ...be responsible for evaluating advertising copy... ...the advertise brand and content.Responsibilities include... ...existing Amazon-provided rubric, while also providing feedback... ...TypeThis is a fully remote position.Application...Remote workContentContract workTemporary workTEKsystems
New York, NY15 hours ago$45 - $55 per hour
...technical talent with leading AI research labs.... ...5–$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in Econometrics to strengthen... ...performance. Develop evaluation rubrics and benchmarks for...Remote workContentContract workSummer workMercor
New York, NY8 days ago$45 - $70 per hour
...technical talent with leading AI research labs.... ...Expert, AI Safety and Model Evaluation Type: Contract... ...0/hour Location: Remote Commitment: 20–40... ...rationale. Develop rubrics and guidelines for balanced... ..., applied ethics, or content policy. Experience in...Remote workContentContract workSummer workWeekday workMercor
New York, NY3 days ago- Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global...Remote jobContentHourly payContract workFlexible hours
- MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote jobContentContract workTemporary workImmediate start
- YO AI Labs is seeking Content Writers & Editors to contribute to a customer project... ...on text quality and AI evaluation. You will apply your writing... ...skills are what matter. Work is remote with collaboration across project coordinators and specialists. #J-18808-Ljbffr YO AI...Remote jobContent
- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. You will apply... ...outputs and provide structured feedback. This is a remote, hourly engagement, with work delivered on your...Remote jobContentHourly payWork at office
- AI Trainer Jobs is seeking a remote Conversational AI Evaluator to review prompts and model outputs against a evolving rubric. You will compare paired responses, label errors, and provide structured feedback to support retraining efforts. The role emphasizes clear reasoning...Remote jobHourly payFor contractors10 hours per week
- Unknown is seeking a Polish Bilingual Expert (contractor) to evaluate Polish audio content for AI training. The role emphasizes nativeness, fluency, and... ...meticulous attention to detail and the ability to work remotely. No prior AI experience is required; candidates will...Remote jobContentFor contractors
- ...Procurement Compliance AI Evaluator is a remote review track for evaluating AI... ...role matters Compliance content is judged on precision. AuraOne... ...applying multi-page rubrics consistently across long batches... .... Remote · Independent specialist contractor. Employment type...Remote jobContentHourly payFor contractors10 hours per week
- ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in... ...role matters Privacy law content is judged on precision. AuraOne... ...applying multi-page rubrics consistently across long batches... .... Remote · Independent specialist contractor. Employment type...Remote jobContentHourly payFor contractors10 hours per week
$80 - $120 per hour
...Cybersecurity / IT GRC Evaluator is a remote evaluation track for... ...AuraOne's quality rubric. Reviewers compare paired... ...this role matters AI data reviewers help... ...failures, and unsafe content with structured tags.... ...Remote · Independent specialist contractor. Employment...Remote jobContentFor contractors10 hours per week- CNTXT AI is seeking a remote contractor to evaluate AI-generated financial content and develop test cases that probe analytical reasoning. You will help improve how AI models handle financial information with clear explanations and rigorous checks. Responsibilities include...Remote jobContentFor contractors
- AuraOne seeks an experienced Senior Journalist / Writer for a remote evaluation track. You will review prompts and responses, compare paired outputs... ...after the interview. Reliable weekly availability and strong written reasoning are essential. #J-18808-Ljbffr AI Trainer JobsRemote jobHourly payFor contractors
$109k - $145k
...our Chicago office as an Senior Specialist: IT Learning and Development.... ...design (LXD) mindset—creating content that is not only informative... ...readiness, and embed responsible AI practices into everyday... ...effectivenessProficiency delivering remote and hybrid learning via...Remote workContentContract workWork experience placementWork at officeMayer Brown
Chicago, IL2 days ago- ...Position Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a... ...Project scopes vary and may include: Content generation: writing high-quality... ...AI training datasets. LLM evaluation: reviewing AI-generated responses...Remote workContentHourly payFor contractorsFlexible hours
CNTXT AI
Brooklyn, NY5 days ago $50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... ...Edit, refine, or rewrite English content to meet high linguistic, stylistic,...Remote workContentContract workSummer workMercor
San Jose, CA8 days ago- YO AI Labs is seeking experienced Technical Writers / Editors to... ...a customer project focused on evaluating and improving advanced AI... ...You will review AI-generated content, assess clarity, tone, and instructional... ...with scores and rationales. Remote collaboration with project...Remote jobContentFor contractors
$70k - $85k
...families globally. Summary The Specialist is a key member of the SHRM... ...of engaging video and audio content. Leveraging both traditional and Generative AI methods, this role drives original... ...Position (3 Days In-Office, 2 Days Remote): ~ This position follows a...Remote workContentLive inWork at officeVisa sponsorshipWork visaMonday to FridayFlexible hoursNight shiftSociety for Human Resource Management
Alexandria, VA23 hours ago- YO AI Labs is seeking experienced Technical Writers / Editors to... ...a customer project focused on evaluating and improving advanced AI... ...You will review AI-generated content, assess clarity, tone, and usefulness... ...to work independently in a remote setting. No prior AI experience...Remote jobContent
$20 - $80 per hour
...train next-generation AI systems. Your work will... ...Key Responsibilities: Evaluate and score AI-generated... ...responses using well-defined rubrics and metrics across... ...to detail in reviewing content for relevance,... ...collaboratively in a fully remote environment. Preferred...Remote workContentHourly payContract workSaidGig
United States1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Content Evaluator & Rubric Specialist. Be the first to apply!
Related searches
- ai evaluator Brooklyn, NY
- education evaluator Brooklyn, NY
- work from home web search evaluator Brooklyn, NY
- evaluator Brooklyn, NY
- social media evaluator Brooklyn, NY
- quality evaluator Brooklyn, NY
- ai scientist Brooklyn, NY
- digital content specialist Brooklyn, NY
- digital marketing content specialist Brooklyn, NY
- social media and content marketing specialist Brooklyn, NY