Remote AI Deception & Red-Teaming Evaluator
AuraOne Human Data
New York, NY
- Remote job
AuraOne, Inc. is seeking a remote Deception Behavior Risk Evaluator to stress-test AI systems with adversarial prompts. You will design jailbreak-like prompts, document failures with reproduction steps, and map each incident to the applicable policy clause to enable rapid patching by the safety team. This contractor role requires strong written communication, experience in red-team work, and comfort documenting policy-grey scenarios. #J-18808-Ljbffr AuraOne Human Data
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Deception & Red-Teaming Evaluator in New York, NY vacancy
- ...AI Safety and Red-Team Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team...Remote jobHourly payFor contractors10 hours per week
- Create challenging prompts and evaluate large language model responses for accuracy... ...writing, analytical thinking, and team management experience. 100% Remote Contract, part-time Engagement Remote... ...execution to assess how well AI handles management-related topics. Create...Remote workContract workPart timeFor contractorsWorldwide
$210k - $290k
...industry develops. As a remote co-located team, we're inspired by our values... ...Plan and run authorized red team operations across cloud... ...engagement. Build and maintain AI-assisted testing harnesses:... ...(tool use, orchestration, evaluation, guardrails), not just prompting...Remote workFull timeLocal areaWork from homeHome office- 10a Labs is seeking a Red Teaming Fellow to help evaluate the safety, security, and reliability of advanced AI systems. You will work with researchers and engineers to identify vulnerabilities and generate insights that help deploy AI systems more safely. This hands-on...Remote job
- 10a Labs is seeking a Red Teaming Fellow to evaluate the safety, security, and reliability of advanced AI systems. Fellows work alongside researchers, engineers, and subject-matter experts to identify vulnerabilities, uncover failure modes, and generate insights that help...Remote job
- Ideal candidates have red-teaming or adversarial ML experience, strong written reporting skills, and comfort working in policy-grey areas with clear documentation. This is a remote, US-eligible contractor position. #J-18808-Ljbffr AuraoneRemote workFor contractors
- 10a Labs is seeking a Red Teaming Fellow to help evaluate the safety, security, and reliability of frontier AI systems. You will work with researchers and engineers to identify... ...evaluation frameworks while collaborating remotely within the continental U.S. #J-18808-Ljbffr...Remote jobFlexible hours
- A progressive technology company is seeking a remote AI Red Teamer to assess conversational AI models and identify vulnerabilities through red teaming exercises. Candidates should be fluent in both English and Brazilian Portuguese, with a background in cybersecurity or...Remote jobHourly pay
- AI Trainer Jobs seeks an AI Safety Practitioner for remote engagement as a contractor. You will craft adversarial prompts to test AI systems, document failures... ...with severity, and maintaining libraries of attack patterns to evolve red-team rubrics. #J-18808-Ljbffr AuraoneRemote jobFor contractors
- ..., is hiring an analytical researcher and red-teaming specialist to build evidence-based benchmark... ...exposing weaknesses in state-of-the-art AI models. You will verify facts, draft... ...sources and results with primary evidence. Remote contractor role with PST overlap. Ideal candidates...Remote jobFor contractors
$32.25 per hour
A tech security company is seeking an AI Security Specialist fluent in English and Arabic to work remotely. Responsibilities include red teaming conversational AI models and identifying vulnerabilities in AI-generated content. Applicants should have experience in adversarial...Remote jobFlexible hours- AI Trainer Jobs is seeking a Bilingual Portuguese Generalist Expert — AI Safety for a remote red-team track that stress-tests AI systems against adversarial prompts. Reviewers craft attack scenarios, document failure modes, and tie each jailbreak to the rubric clause it...Remote jobFor contractors
- AuraOne is seeking a Biology Expert (PhD) for its remote AI Safety red-team track. You design adversarial prompts to probe known weaknesses, document each failure with reproduction steps, and tie it to policy clauses for patching. You will score model defenses across turns...Remote jobContract work10 hours per week
- AuraOne is seeking a Bilingual Dutch (Belgium) STEM Expert (PhD) to work remotely as a contractor on AI Safety red-teaming. You will craft adversarial prompts, document failures, and pair each jailbreak with the violated rubric clause so the safety team can patch gaps....Remote jobHourly payFor contractors
- AI Trainer Jobs is seeking a Bilingual Danish STEM Expert (PhD) for remote AI Safety red-team work. You will design adversarial prompts, document failures with reproducible steps, and map each jailbreak to a rubric clause to guide patching efforts. Responsibilities include...Remote jobHourly payFor contractors
$48 - $62 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Contract Compensation: $48–$62/hour Location: Remote Role Responsibilities Red team conversational AI models and agents to identify...Remote workContract workSummer work- AuraOne is seeking a Bilingual Polish STEM Expert (PhD) for a remote AI Safety red-team role. You will design adversarial prompts, document failures with precise reproduction steps, and rate defenses across turn-based conversations to harden AI models before release. Remote...Remote workFor contractors
$145.9k - $234.2k
...manufacturing environments with a focus on AI and the attack surface it exposes. You... ...infrastructure. This role reports to the Red Team Program Lead and works very deeply and closely... .... #LI-CK1-SummaryLocation: Cambridge, Massachusetts; Remote - US; DigitalType: Full timeRemote workPermanent employmentFull timeWork at officeWork from home$28.74 per hour
...Part-time) Compensation: $28.74/hour Location: Remote Role Responsibilities Red team conversational AI models and agents (jailbreaks, prompt injections,... ...on. Identify vulnerabilities missed by automated evaluation systems. Requirements Native-level fluency in English...Remote jobHourly payFull timeContract workPart time- ...Deception Behavior Red Team Specialist is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the... ...gap. Why this role matters Adversarial evaluation is how AuraOne hardens AI models before they...Remote jobHourly payFor contractors10 hours per week
$155k - $185k
...governments detect deepfakes and AI-generated media. Utilizing a... ...deepfake detection platform empowers teams and developers alike to... ...Most Innovative Startup The Red Team Role Reality Defender's... ...based at our NYC headquarters or remote within the U.S., reporting to VP...Remote workFull timeTemporary workWork at officeLocal area$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high... ...improving online search experiences? Join our team as a Web Search Evaluator and help... ...and achieve work-life balance. Remote Work: Enjoy the freedom of working from...Remote workBi-weekly payHourly payPart timeImmediate startWork from homeFlexible hours- ...human life on Mars. SECURITY ENGINEER (RED TEAM) SpaceX is looking for a Security... .../alerting workflows. Familiarity with AI/LLMs and MCPs. Familiarity with cloud... ...role requires you to be onsite. Hybrid or remote work will not be considered. ITAR REQUIREMENTS...Remote workWeekend work
- ...is seeking Mandarin-speaking experts for a 4-week remote language evaluation project. You will evaluate AI-generated Mandarin content, write and rewrite prompts... ...with a fully remote setup and the opportunity to engage with global teams on #J-18808-Ljbffr Welo GlobalRemote jobContract workFreelanceWork from homeFlexible hours
- ...United States is seeking an individual to evaluate AI model responses for personalization... ...multi-turn prompts, and collaborating with teams to enhance model performance. Ideal candidates... ...skills. Full-time availability with remote work options is required. This role...Remote jobFull time
- Inworld AI is seeking a voice evaluation specialist who will listen to paired or grouped speech samples, judge... ...real-time applications. This role is remote within the United States and involves structured reporting to engineering teams. You will evaluate pronunciation,...Remote job
- Remotebridge is seeking Cantonese Language Evaluators to join a remote contractor team. You will evaluate Cantonese text and speech to train AI systems, providing feedback and annotations to improve model outputs. No AI background required beyond domain expertise. You...Remote jobFor contractors
- Remotebridge seeks Bengali bilingual experts to join a remote language/AI training project. You will review Bengali audio, rate nativeness and... ...contractor role emphasizes accuracy, timely delivery, and clear communication across teams. #J-18808-Ljbffr Frontier AI LabRemote jobFor contractors
- ...Data is seeking Filipino-speaking experts for a freelance, remote role to evaluate AI-generated responses, improve language quality, and craft high... ...prompts in Filipino, and collaborate with international teams to enhance language models. This is a short-term project with...Remote jobTemporary workFreelanceFlexible hours
- Mercor is seeking a Procurement / Vendor Management Evaluator for a remote contract position. The role focuses on assessing AI-generated artifacts, identifying errors, and... ...outputs. You will collaborate with AI research teams to enhance output quality and work...Remote jobContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Deception & Red-Teaming Evaluator. Be the first to apply!
Related searches
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- nurse evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY


