Remote Defense Analyst - AI Scenario Evaluator

Zekai

Zekai is seeking experienced civilian defense analysts for a 100% remote contractor engagement on an AI development project focusing on military operations and defense-related decision-making. You will evaluate AI-generated scenarios, identify inaccuracies, and provide expert feedback to improve AI reasoning and reliability. The role requires deep knowledge of military operations, IHL, ROE, and risk assessment. #J-18808-Ljbffr

Apply

Vacancy posted 5 hours ago

Similar jobs that could be interesting for youBased on the Remote Defense Analyst - AI Scenario Evaluator in New York, NY vacancy

Remote Weapons Systems Operator & AI Scenario Evaluator
...Weapons Systems Operator contractor to evaluate AI-generated military scenarios and provide expert feedback to... ...firsthand operational experience with air defense and weapon systems to assess... ...instructor experience is a plus, with remote work possible for qualified #J-1880...
Remote work
For contractors
micro1
New York, NY
3 days ago
Remote Health Economics Expert AI Scenario Evaluator
$40 - $80 per hour
...seeking experienced Health Economics professionals to help train and evaluate AI systems with real-world domain judgment. This is a remote, project-based role: apply your hands-on expertise to review scenarios, label and evaluate domain-specific content, and provide clear...
Remote work
Hourly pay
Flexible hours
AfterQuery Experts
Boston, MA
7 hours ago
Remote Weapons Systems Scenario Evaluator (Contractor)
OpenTrain AI, Inc. is seeking a Military Weapons Systems Scenario Evaluator for remote, part-time contracting work. You will review AI-generated military scenarios in air defense, missile operations, naval systems, and tactical aviation for realism and compliance with...
Remote job
Part time
For contractors
OpenTrain AI, Inc.
New York, NY
22 hours ago
Remote AI Content Evaluator & Feedback Analyst
...Crossing Hurdles is seeking a Personal Account Generalist Raters for a remote contract position. The role involves reviewing AI prompts and responses in English, evaluating relevance, accuracy, and personalization, and providing clear ratings with feedback. Expected commitment...
Remote work
Contract work
For contractors
Flexible hours
Crossing Hurdles
United States
2 days ago
Remote IAM Analyst for AI Training and Security Scenarios
...an Identity & Access Management (IAM) Analyst to help train and evaluate AI models by working through realistic enterprise identity scenarios, access control failures, and privilege... ...paths. This hourly contract role offers remote work and requires 2+ years of hands-on...
Remote work
Hourly pay
Contract work
Alignerr Corp.
Denver, CO
2 days ago
Remote AI Safety Red-Team Evaluator: Adversarial Prompts
...AuraOne, Inc. is seeking a remote contractor to help stress-test AI systems by designing adversarial prompts and documenting failures with rigorous repro steps. You will score defenses in single-turn and multi-turn conversations, triage new attack vectors, and maintain...
Remote work
For contractors
AuraOne, Inc.
New York, NY
2 days ago
Senior Actuary: AI Model Evaluator - Remote, Flexible Hours
$50 - $60 per hour
...A leading AI solution provider is seeking a Senior Actuary to enhance AI models through rigorous evaluation and financial expertise. This role offers flexible hours, project selection, and competitive pay ranging from $50 to $60 per hour, with bonuses for exceptional work...
Remote work
Hourly pay
Flexible hours
DataAnnotation
Oregon, WI
22 hours ago
Classroom Scenario AI Evaluator
...Classroom Scenario AI Evaluator is a remote evaluation track for reviewing classroom scenario ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...
Remote job
Hourly pay
For contractors
10 hours per week
AuraOne Human Data
Remote
a month ago
Remote Federal Reporting Analyst for AI Training
...seeking a Federal Staff Reporting Analyst for a remote, US-only contract. You will contribute to training AI systems by producing high-quality military writing, evaluating reports, and helping develop... ...familiarity with Department of Defense procedures are required. The...
Remote work
Contract work
Softechub
United States
2 days ago
Fully Remote Spreadsheet Analyst | Data-Driven Evaluator
...Mercor seeks a Spreadsheet Analyst to evaluate domain-specific documents using MS Excel and Google Sheets. This fully remote contract role requires strong analytical skills and attention to detail to ensure quality and relevance across projects. The ideal candidate will...
Remote work
Contract work
Bazeta
United States
3 days ago
Financial Manager - AI Systems Evaluator
$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ...$70–$110/hour Location: Remote Duration: 4–6 weeks... ...week Role Responsibilities Evaluate AI-generated financial plans... ...analytical rigor. Review financial scenarios involving cash flow oversight,...
Remote work
Hourly pay
Contract work
Summer work
Work at office
Immediate start
Mercor
Abbeville, GA
20 days ago
Data Visualization Analyst - Power Platform
$93k - $158k
...seeking a Data Visualization Analyst - Power Platform to... ...experience supporting AI/ML, generative AI, or... ...collaboration, LMI serves the defense, space, healthcare, and... ...as solution adoption, evaluation results, quality,... ...skills, and security clearances. Job Locations US-Remote
Remote work
Contract work
LMI
Remote
5 days ago
Data Analyst
$80k - $145k
...LMI is seeking a Data Analyst to support Department of... ...analytical capacity across AI-enabled use cases,... ...analysis and solution evaluation by preparing evaluation... ...collaboration, LMI serves the defense, space, healthcare, and... ...clearances. Job Locations US-Remote...
Remote work
Full time
Contract work
LMI
Remote
13 days ago
Data Analyst - Power Platform
$70k - $118k
...LMI is seeking a Data Analyst to support a major office... ...and mission-ready AI to federal agencies at... ...collaboration, LMI serves the defense, space, healthcare, and... ...management, or program evaluation data. Exposure to UI/UX... ..., and security clearances. Job Locations US-Remote
Remote work
Contract work
Work at office
LMI
Remote
14 days ago
Remote Clinical Mental Health Evaluator for AI Interactions
...Mental Health Experts to support an AI research initiative evaluating the realism of simulated clinical conversations... .... This is a short-term, fully remote evaluation task designed for mental... ...to assess realistic conversational scenarios. The task will take up to 30...
Remote work
Temporary work
Softechub
United States
2 days ago
AI Safety Practitioner - Expert Evaluator
$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety... ...nuanced and policy-sensitive scenarios. Preferred Experience with...
Remote work
Contract work
Summer work
Mercor
Abbeville, GA
20 days ago
Ai Writing Evaluator - English Speaker (Remote)
...Outlier is an AI training platform owned and operated by Scale... ...generating training data to evaluating the performance of models.About... ...looked or sounded wrong, all remotely and on your own schedule.At... ...Responsibilities:Holding a live, scenario-based conversation in English...
Remote work
Contract work
For contractors
Freelance
Internship
Night shift
Scale AI
Ann Arbor, MI
1 day ago
Remote FP&A & AI Finance Evaluator
...DataAnnotation is seeking a Finance Expert to evaluate AI-built financial analyses on real corporate scenarios, trace the numbers, and write defensible judgments that teach models what... ...honest assumptions. This role is flexible, remote, and project-based with strong earning...
Remote work
Flexible hours
DataAnnotation
Clifton Park, NY
2 days ago
Data Analyst III (Remote)
...Ireland - Remote Spain - Remote Romania - Remote United Kingdom -... ...with the world’s most advanced AI-native platform. We work on large... ...is looking for a Data Analyst to join the Office of Adversary... ...solved with existing malware-based defenses. Founder George Kurtz realized...
Remote work
Full time
Work at office
Local area
CrowdStrike
Rome, NY
1 day ago
AI Image & Video Evaluator (Remote) (Hiring Immediately)
$15 per hour
...Outlier is an AI training platform owned and operated by Scale... ...generating training data to evaluating the performance of models.... ...looked or sounded wrong, all remotely and on your own schedule.... ...Responsibilities: Holding a live, scenario-based conversation in English...
Remote work
Hourly pay
Contract work
For contractors
Work experience placement
Freelance
Internship
Immediate start
Work from home
Night shift
Outlier
Omaha, TX
22 hours ago
Federal Staff Reporting Analyst - Remote
...Type: ContractorLocation: Remote (US Only)Required... ...| Report Generation & Evaluation | Grading Rubric Development... ...| Department of Defense Procedures | Compliance... ...Federal Staff Reporting Analysts to support a project focused... ...reporting examples for AI training.Provide structured...
Remote work
Work at office
YO AI Labs
Chicago, IL
3 days ago
AI Response Evaluator - Business & Finance (Remote)
$15 per hour
...per hour, paid weeklyLocation: Remote - CanadaSchedule: Flexible, no... ...contractorOutlier is an AI training platform owned and operated... ...generating training data to evaluating the performance of models.About... ...Responsibilities:Holding a live, scenario-based conversation in English...
Remote work
Hourly pay
Contract work
For contractors
Freelance
Internship
Flexible hours
Night shift
Outlier
Orlando, FL
4 days ago
AI Instruction Following Evaluator (Remote)
...Outlier is an AI training platform owned and operated by Scale... ...generating training data to evaluating the performance of models. About... ...looked or sounded wrong, all remotely and on your own schedule. At... ...: * Holding a live, scenario-based conversation in English...
Remote work
Work experience placement
Scale AI
Charleston, SC
1 day ago
AI Media Evaluator: Images & Video (Remote)
...is seeking detail-oriented English speakers to review AI-generated media entirely remotely on a flexible schedule. You will roleplay live conversations... .... Your work helps improve AI systems in real-world scenarios. Responsibilities include holding live conversations, ranking...
Remote work
Flexible hours
Outlier
Cary, NC
4 days ago
Federal Staff Reporting Analyst
...Federal Staff Reporting Analyst Remote - United States only military writing... ...report generation and evaluation grading rubric development written... ...communication department of defense procedures collaborative remote... ...help train next-generation AI systems. Your work will shape...
Remote work
Work at office
Remolity, Inc.
New York, NY
3 days ago
AI Media Evaluator: Remote & Flexible
...Outlier is seeking detail-oriented reviewers to evaluate AI-generated media from home on a flexible schedule. You will conduct live conversations... ...AI systems toward better reasoning and output in real-world scenarios. Ideal candidates are fluent English speakers with strong...
Remote work
Flexible hours
Outlier
Akron, OH
4 days ago
Freelance AI Content Evaluator (Remote) (Hiring Immediately)
$15 per hour
...Outlier is an AI training platform owned and operated by Scale... ...generating training data to evaluating the performance of models.... ...looked or sounded wrong, all remotely and on your own schedule.... ...Responsibilities: Holding a live, scenario-based conversation in English...
Remote work
Hourly pay
Contract work
For contractors
Work experience placement
Freelance
Internship
Immediate start
Work from home
Night shift
Outlier
Sioux Falls, SD
22 hours ago
AI Instruction Following Evaluator (Remote)
$15 per hour
...Outlier is an AI training platform owned and operated by Scale... ...generating training data to evaluating the performance of models.... ...looked or sounded wrong, all remotely and on your own schedule.... ...Responsibilities: Holding a live, scenario-based conversation in English...
Remote work
Hourly pay
Contract work
For contractors
Work experience placement
Freelance
Internship
Night shift
Scale AI
Winston Salem, NC
2 days ago
Remote AI Media Evaluator: Voice and Video
$18 per hour
...hiring detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will rate live AI voice... ...to $18 USD/hour. Responsibilities include live scenario-based conversations, evaluating fidelity to prompts, and producing concise written...
Remote work
Flexible hours
Outlier
Washington DC
4 days ago
Business / Data Analyst Level III
$85k - $120k
...is seeking a Business / Data Analyst at the Level III level to produce... ...platforms and mission-ready AI to federal agencies at commercial... ...collaboration, LMI serves the defense, space, healthcare, and energy... ..., skills, and security clearances. Job Locations US-Remote
Remote work
Contract work
Immediate start
LMI
Remote
7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Defense Analyst - AI Scenario Evaluator. Be the first to apply!