Adversarial AI Safety Red Team Evaluator
AI Trainer Jobs
AuraOne is seeking a Manipulation Risk Risk Evaluator for a remote, contractor role focused on stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document failures, and pair each jailbreak with the violated rubric clause so the safety team can patch gaps. Adversarial evaluation helps harden models before they ship to customers. Applicants should push on refusal boundaries, document rigorously, and score defenses across single-turn and multi-turn #J-18808-Ljbffr AI Trainer Jobs
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Adversarial AI Safety Red Team Evaluator in New York, NY vacancy
- AuraOne is seeking a Chemicals Safety Risk Evaluator in a remote, US-eligible red-team track to stress-test AI systems against adversarial prompts. Reviewers craft attack scenarios, document failures, and tie each successful jailbreak to the violated policy clause so the...SuggestedRemote jobFor contractors
$65 - $70 per hour
Trust and Safety Policy AI Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team...SuggestedHourly payFor contractorsRemote work10 hours per week$75 - $110 per hour
AI Trainer Jobs seeks a Nursing Triage Safety Evaluator to remotely review AI outputs that touch nursing. You will assess differential reasoning, dosing logic,... ...document corrected clinical reasoning so the modeling team can close the gap. This contractor role offers...SuggestedRemote jobHourly payFor contractors- AuraOne is seeking a Children Safety Content AI Evaluator for a remote, contractor-based role. You will evaluate model outputs, compare responses, and label content with structured tags according to our quality rubric. Ideal candidates have prior evaluation/annotation experience...SuggestedRemote jobFor contractors10 hours per week
$80 - $120 per hour
Public health communications Evaluator is a remote clinical-... ...track for evaluating AI outputs that touch clinical... ...adherence; flag patient-safety issues; and document the... ...so the modeling team can close the gap. Category... ...reasoning, dosing, and red-flag handling on a structured...SuggestedFor contractorsRemote work10 hours per week- About the role Hindi Localization AI Evaluator is a remote evaluation track for reviewing hindi... ...of structured feedback the modeling team can use to retrain. Category: Frontier Model... ..., content moderation, or trust & safety review. Experience with inter-rater agreement...Hourly payFor contractorsRemote work10 hours per week
- About the role JavaScript and TypeScript AI Evaluator is a remote evaluation track for... ...kind of structured feedback the modeling team can use to retrain. AI data reviewers help... ...linguistics, content moderation, or trust & safety review. Experience with inter-rater agreement...Hourly payFor contractorsRemote work10 hours per week
- ...LLC is recruiting a senior character animator to help shape evaluation standards for an AI-driven performance transfer model. The role focuses on... ...and placement at a leading AI lab. You’ll join an expert team, collaborate with reviewers, and come on-site in Playa Vista...Part time
- Turing is a leading AI company enabling the rapid deployment of advanced AI systems. We are seeking a contractor to evaluate chatbot responses across real-world small business scenarios... ...week project, collaborating with a global team to ensure high-quality evaluations and...Remote jobFor contractorsFreelance
- About the role PhD Mathematics AI Evaluator is a remote review track for evaluating AI outputs across mathematics reasoning, calculations,... ...reproduce key results, and document the correct method so the modeling team can train on it. Mathematics models live or die on whether...Hourly payFor contractorsRemote work10 hours per week
- AI Trainer Jobs is seeking a Lesson Plan AI Evaluator for a remote, contractor role. You will review prompts and responses against AuraOne's quality rubric, label... ...rubrics, and reporting discrepancies to the program team. Strong attention to detail and clear written...Remote jobFor contractors
- ...Management & Marketing to remotely review evaluation prompts and responses against the company... ...provide structured feedback the modeling team can use to retrain. As a contractor, you... ...detail, clear written reasoning, and reliable async #J-18808-Ljbffr AI Trainer JobsRemote jobFor contractors
- Surgical Planning Safety Evaluator is a remote evaluation track for reviewing surgical planning safety evaluation prompts and responses... ...and write the kind of structured feedback the modeling team can use to retrain. AI data reviewers help turn surgical planning safety...Remote job
$70k - $90k
...renewable energy across the United States. Our team is purpose-driven, harnessing the power... ..., and foster a culture of inclusion, safety, and growth. As an organization, we believe... ...employees and supervisors to observe and evaluate their knowledge, skills, and abilities to...Full timeTemporary workFor contractorsLocal areaRelocation$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $... ...reach out to: ****@*****.*** PS: Our team reviews applications daily. Please...Contract workSummer workRemote workMercor
New York, NY8 days ago$37.5 per hour
...looking to create a golden data set for AI generated ad copy for various advertisers... ...In this role you will be responsible for evaluating advertising copy generated by a large language... ...of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000...Contract workTemporary workRemote workTEKsystems
New York, NY8 hours ago- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
Obsidian
New York, NY1 day ago - YO AI Labs is seeking a Generalist contractor to support AI and data-focused projects remotely. You will review, annotate, and evaluate information across topics, ensuring accuracy and quality while... ...within distributed teams to meet deadlines. #J-18808-Ljbffr...Remote jobFor contractors
- AI Trainer Jobs is seeking a remote Management Consultant — AI Workflow Evaluator to review prompts and model outputs against AuraOne's quality rubric. You will compare paired... ..., and write structured feedback the modeling team can use to retrain. As a contractor, you will...Remote jobFor contractors
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong...Remote jobHourly pay- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks....Remote jobHourly payWork at office
- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. You will apply subject-matter expertise to grade outputs and provide structured feedback. This is a remote, hourly engagement...Remote jobHourly payWork at office
- Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate AI models via real-time voice conversations. You will compare two models, record your interactions, and provide structured evaluations across five criteria to determine the stronger overall conversational...
- AI Trainer Jobs is seeking licensed clinicians to remotely evaluate AI outputs in internal medicine clinical reviews. You will assess differential diagnoses, dosing logic, and guideline adherence, and document corrected reasoning for model training. Ideal candidates hold...Remote jobHourly pay10 hours per week
- Feedinkoo is seeking a Graphic Designer to help train and improve AI models focused on UI/UX design, visuals, and user experiences. You will critique AI outputs, provide feedback, and guide model improvements to better reflect aesthetics and usability for designers. The...Remote work
- YO AI Labs is seeking Content Writers & Editors to contribute to a customer project focused on text quality and AI evaluation. You will apply your writing and editing expertise to help train and evaluate next-generation AI systems through high-quality input. No prior AI...Remote job
- AI Trainer Jobs seeks a remote independent contractor to review AI outputs for fintech operations evaluation. You will assess workflow adherence, tone, and escalation logic, assigning severity tags and documenting next steps for model training. The role requires experience...Remote jobHourly payFor contractorsFlexible hours
- Prolific is seeking fluent Norwegian speakers to act as evaluators for AI training, performing side-by-side assessments of text and voice snippets to judge naturalness and authenticity. You will listen to audio clips and rate how naturally the AI speaks, providing detailed...Remote jobWork from homeFlexible hours
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate; Duration: up to...Immediate startFlexible hours
- Archangel Health AI is seeking Clinical AI Evaluators to review AI-generated clinical outputs, benchmark diagnostic reasoning, and refine responses to real-world medical queries. You will perform clinical accuracy auditing, RLHF ranking, error and harm identification,...Remote workFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Adversarial AI Safety Red Team Evaluator. Be the first to apply!
Related searches
- ai evaluator New York, NY
- education evaluator New York, NY
- work from home web search evaluator New York, NY
- evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- social media evaluator New York, NY
- quality evaluator New York, NY
- senior safety specialist New York, NY
- warehouse safety New York, NY