Remote Data Annotator & AI Evaluation Specialist
Terac
New York, NY
- Remote job
Terac is assembling the world's largest pool of vetted human experts for AI. This remote role involves reviewing text or media samples, labeling them according to project guidelines, and evaluating AI-generated responses for clarity, safety, and factual accuracy. Work is performed independently on a flexible schedule via our remote platform, with rolling availability across diverse annotation assignments. Prior experience in data annotation or AI model evaluation is preferred, along with strong #J-18808-Ljbffr Terac
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Data Annotator & AI Evaluation Specialist in New York, NY vacancy
$20 per hour
A technology firm is seeking DataAnnotators to create diverse conversations and evaluate AI models. The role offers remote work and the flexibility to choose projects, allowing successful candidates to work between 5-40 hours per week. Applicants should be fluent in English...Remote jobHourly pay$23 per hour
...artificial intelligence. As an annotator, you may be invited to... ...projects such as rating AI-generated content, evaluating factual accuracy, or comparing... ...project-based, part-time, remote freelance role.... ...equivalent. #J-18808-Ljbffr Mindrift Data Annotation ProjectsRemote jobHourly payPart timeFreelance$23 per hour
...individuals with Generative AI projects from leading... ...of the world. As an annotator, you may be invited to... ...AI-generated content, evaluating factual accuracy, or comparing... ...review provided data (text, images, or videos... ...Take part in a part-time, remote, freelance project that...Remote workHourly payPart timeFreelance- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation guidelines compliance, content safety labeling, and...Remote jobFull time
- ...seeking online annotators to join AI-related projects, rating content, evaluating factual accuracy, and comparing responses... ...become available. This role is remote, part-time, freelance, and... ...are essential for success. #J-18808-Ljbffr Mindrift Data Annotation ProjectsRemote jobPart timeFreelance
- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
Prolific
Tucson, AZ2 days ago - ...A tech and AI-focused referral partner is seeking a SaaS Software Data Reviewer to analyze data from B2B tools and create prompts based on SaaS ticket content.... ...Jira and Slack, and attention to detail. This is a remote, hourly contract role offering flexibility in commitment...Remote workHourly payContract work
Crossing Hurdles
New York, NY1 day ago $30 - $90 per hour
...Role Overview Help improve enterprise AI assistants by evaluating their outputs, identifying weaknesses, and delivering feedback that strengthens... ...matter expertise and careful judgment are central to this remote contract role. Prior AI experience is not required. Key...Remote workHourly payContract workFor contractorsSaidGig
California27 days ago$20 per hour
A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing... ..., writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent...Remote workHourly payFlexible hoursSupportFinity
United States23 hours ago- Rex.zone is seeking a Senior Data Annotator to work remotely with our US-based Phoenix team. You will lead data labeling across NLP, LLM evaluation, and computer vision tasks, guiding RLHF workflows and QA checks to ensure high-quality training data. Sources emphasize...Remote jobFull time
$25 - $30 per hour
...Bilingual German AI Evaluation Specialist is a remote German specialist track for evaluating german evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale...Remote workFor contractors10 hours per weekAuraOne Human Data
Remotemore than 2 months ago- AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging...Remote job
- A leading research accelerator is seeking a Geospatial Expert to enhance AI systems through advanced geospatial analysis. This entry-level, remote role involves evaluating geospatial datasets and supporting tasks aligned with crisis management and agriculture. Candidates...Remote jobContract work
- A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities...Remote jobFor contractorsFlexible hours
- AI Trainer Jobs in the United States is seeking a remote HR Documents Specialist (Korean) to review prompts and responses against AuraOne's quality rubric. Reviewers compare... ...the model. You will help turn Korean evaluation outputs into auditable labels, rationales, and...Remote job
- AuraOne is seeking a remote Trust and Safety Policy AI Evaluator to stress-test AI systems against adversarial prompts. You will craft attack scenarios, document failures, and map each jailbreak to the violated rubric clause to help patch gaps. You will think like attackers...Remote jobHourly payFor contractors
- micro1 is seeking an AI Evaluation Specialist to assess AI outputs for an enterprise training initiative. You will evaluate responses against rubrics... ...help refine evaluation criteria to improve model quality. Remote contractor role with emphasis on independence and attention...Remote jobContract workFor contractors
- AI Trainer Jobs is seeking a Bilingual Portuguese AI Evaluation Specialist to remotely review Portuguese prompts and responses against AuraOne's quality rubric. Reviewers compare... ...the modeling team can use to retrain. AI data reviewers help turn Portuguese generalist evaluation...Remote job
- AI Trainer Jobs is seeking a Fraud Investigation AI Evaluator for a remote contractor role. You will review prompts and responses against AuraOne's quality rubric, assign severity tags, and label edge cases to help retrain the modeling team. Ideal candidates have prior...Remote jobFor contractors10 hours per week
- AuraOne is seeking a Hindi Localization AI Evaluator to remotely assess generalist evaluation prompts and responses against its quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback to retrain the model. The role is a contract...Remote jobHourly payContract work
$20 - $26 per hour
Prolific Academic Ltd is seeking Punjabi language evaluators for remote, contract-based work focused on assessing AI handling of Punjabi text and audio. Dubai-based or able to work from Dubai candidates are preferred, with flexible, micro-task style assignments. You will...Remote jobHourly payContract workFlexible hours- AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll...Remote jobFor contractors
- ...seeking a Dutch Bilingual Expert to remotely evaluate prompts and responses against its... ..., rationales, and regression cases for AuraOne Human Data. This role emphasizes rigor, multi-page rubric application, and clear written reasoning. #J-18808-Ljbffr AI Trainer JobsRemote jobFor contractors
$45 - $85 per hour
...platform for finding and building careers in AI training and data labeling. We connect experienced... ...helps shape how modern AI systems are evaluated and improved. Creating an OpenTrain... ...0 or more hours per week. The work is remote and asynchronous, with compensation ranging...Remote workHourly payPart timeFor contractorsFlexible hours$30 per hour
Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in... ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr ProlificRemote jobWork from home- Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote jobWork from homeFlexible hours
$60 per hour
...Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly... ...for paid tasks. Responsibilities include reviewing scientific data accuracy, validating citations, and assessing experimental logic...Remote jobHourly payWork from homeFlexible hours- AI Trainer Jobs is seeking a Linguist — AI Language Evaluator for remote, independent contractor work. You will review linguist AI language evaluation prompts and responses, compare outputs, and provide structured feedback to retrain models. You will label edge cases,...Remote jobFor contractorsFlexible hours
$80 per hour
...part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic... ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour...Remote jobPart timeFlexible hours- AI Trainer Jobs is seeking an Independent contractor for a remote JavaScript and TypeScript AI Evaluator role. You will review prompts and responses against a rubric, label issues, and provide structured feedback to help retrain the model. Responsibilities include evaluating...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Data Annotator & AI Evaluation Specialist. Be the first to apply!
Related searches
- data entry associate New York, NY
- data operations specialist New York, NY
- data migration specialist New York, NY
- data specialist New York, NY
- data science associate New York, NY
- data visualization specialist New York, NY
- oncology data specialist New York, NY
- data management associate New York, NY
- data integration specialist New York, NY
- data conversion specialist New York, NY