Remote Intelligence Analyst: AI Evaluation & Benchmarking
Zekai
Zekai is seeking an Intelligence Analyst for a 100% remote contract role. You will contribute to evaluating and advancing AI capabilities, training models through high-quality real-world input, and shaping how systems learn and reason. Experience in AI evaluation is helpful, but domain knowledge matters most. As a contractor, you will develop analytic cases, grade AI responses, and document edge cases while collaborating with project leads to refine evaluation procedures and standards on a #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote Intelligence Analyst: AI Evaluation & Benchmarking in New York, NY vacancy
- ...Recruiters / ESR Healthcare seeks an Intelligence Analyst for a remote contractor role. You will map analytic... ..., author test scenarios, and assess AI outputs across source handling, reasoning... ...rigor are essential to advance evaluation methodologies. The position emphasizes...Remote workFor contractors
Executive Staff Recruiters / ESR Healthcare
New York, NY16 hours ago - ...Synthires is seeking experienced Signals Intelligence (SIGINT) professionals for a remote, contractor-based engagement to support AI training and evaluation tasks. Responsibilities include developing unclassified SIGINT scenarios, evaluating AI-generated intelligence...Remote workFor contractors
Synthires
United States17 hours ago - ...micro1 is a data lab that helps AI labs and Enterprises train foundational... ...and agents, offering frontier evaluations and reinforcement learning... ...agents in enterprise settings. Role: Intelligence Analyst (Contractor) | Location: Remote.No prior AI experience required;...Remote workFor contractors
micro1
United States3 days ago $187.2k
...to build robust performance benchmarks. This work directly supports... ...of more accurate diagnostic evaluation tools by establishing reliable... ...How It Works During this remote study, you will review a series... ...of vetted human experts for AI. Researchers, AI labs, and product...Remote workContract work$218.4k
...high-quality clinical reference benchmarks. This work directly supports... ...Your input will ensure these evaluations are grounded in rigorous,... ...clinical cases through a secure remote platform. For each case, you... ...of vetted human experts for AI. Researchers, AI labs, and product...Remote workContract work- ...building a human-grounded layer to teach AI to work in the real world and stay... ...research-focused expert to design rubrics, benchmarks, and evaluation methods using real-world data from... ...product development. This role offers a remote-first environment, a strong...Remote work
$180k - $230k
...AI & Machine Learning Generative Systems Hybrid · San Francisco... ...models maintain the highest benchmarked accuracy in the industry by... ...testing frameworks, and LLM evaluation tooling. ~ Strong knowledge... ...Meaningful Equity Ownership Remote-First Setup Stipend ($2,500)...Remote workFull timeFlexible hoursThemeframer
San Francisco, CA3 days ago- ...Alignerr Corp. is seeking a Threat Intelligence Analyst (AI Training) for a remote hourly contract. You will analyze threat reports, assess attacker behavior, and curate data used to train and benchmark AI cybersecurity outputs. Requirements include 2+ years in threat...Remote workHourly payContract workFlexible hours
Alignerr Corp.
Boston, MA4 days ago - ...Alignerr is seeking a Chemistry Subject Matter Expert to help evaluate and improve AI systems that reason through advanced chemical problems. This is a fully remote, hourly contract role suitable for candidates with a strong chemistry background who can articulate clear...Remote workHourly payContract work
Alignerr Corp.
New York, NY3 days ago - ...Role Title: Intelligence Analyst Role Type: Contractor Location: Remote our partner is engaging Intelligence... ...project focused on evaluating and advancing artificial... ...train next-generation AI systems. Your work will... ...overall quality of AI system benchmarks. Preferred...Remote workContract workFor contractorsWorldwide
Confidential
New York, NY3 days ago $30 - $80 per hour
...Evaluate AI-generated intelligence responses, test source handling and analytic reasoning, and document model limits. This remote, part-time contractor role pays $30 to $80 per hour and requires... ...analytic standards and AI evaluation benchmarks.What It Pays And Takes This is...Remote workHourly payContract workPart timeFor contractorsFlexible hoursOpenTrain AI
New York, NY3 days ago- ...Alignerr Corp. is seeking a Threat Intelligence Analyst (AI Training) to contribute threat analytics... ...training and validating AI models. This remote, hourly contract role emphasizes real-... ...cybersecurity threats. You will evaluate IOCs, TTPs, and kill chains, while ensuring...Remote workHourly payContract work
Alignerr Corp.
Denver, CO4 days ago $201.3k - $352.3k
.... Today, ServiceNow is the AI control tower for business... ...innovation group building intelligent software and smart user experiences... ...Manager, Agentic & GenAI Benchmarking and Evaluations to establish and lead AI... .... Work personas (flexible, remote, or required in office) are...Remote workWork experience placementWork at officeImmediate startFlexible hoursShift workServiceNow
Santa Clara, CA4 days ago$86.8k - $198k
...Cyber Intelligence Analyst The Opportunity: As a cyber intelligence analyst,... ...assessments by researching, evaluating, and integrating all source... ...and prevent fraud. Candidate AI Usage Policy AI is a part of... ...cameras on during meetings. Remote: If this position is listed...Remote workFull timeContract workPart timeWork at officeLocal areaBooz Allen Hamilton
Washington DC2 days ago- Alignerr is seeking a Threat Intelligence Analyst to help train AI systems by validating real-world cyber threat data and performance. This remote, hourly contract offers flexible scheduling... .... You'll analyze threat reports, evaluate IOCs and TTPs, and apply MITRE ATT&...Remote jobHourly payContract workFlexible hours
$151.6k - $252.6k
...Lead Information Security Analyst to strengthen our cyber threat intelligence capabilities. This role... ...reporting ~ Leverage AI to guide investigations... ...analysts on tradecraft, source evaluation, and production... ...business needs. Hybrid or remote work arrangements may be...Remote workShift workMCKESSON
Alpharetta, GA1 day ago$86.8k - $198k
Cyber Intelligence AnalystThe Opportunity:As a cyber intelligence analyst, you know that detailed threat analysis... ...by researching, evaluating, and integrating all source... ...prevent fraud.Candidate AI Usage PolicyAI is a... ...cameras on during meetings.Remote: If this position is...Remote workFull timeContract workPart timeWork at officeLocal areaBooz Allen Hamilton
Washington DC4 days ago$120 per hour
...technical talent with leading AI research labs. Headquartered... ..., our investors include Benchmark , General Catalyst , Peter... ...research / competitive intelligence Evaluator Type: Contract Compensation... ...0–$120/hour Location: Remote Role Responsibilities...Remote workContract workSummer workWork at officeMercor
Abbeville, GA20 days ago- ...Virologist to design and execute rigorous evaluations of advanced AI systems, including LLMs, for... ...implications. The role focuses on developing benchmarks, conducting red-teaming, and... ...capabilities and potential misuse risks in a remote United States setting, with in-person...Remote workContract work
10a Labs
New York, NY2 days ago $20 - $160 per hour
...technical talent with leading AI research labs. Headquartered... ...Francisco, our investors include Benchmark , General Catalyst ,... ...Health AI Conversation Quality Evaluation Type: Contract... ...20–$160/hour Location: Remote Role Responsibilities Evaluate...Remote workContract workSummer workMercor
Abbeville, GA20 days ago- ...delivers critical all‑source intelligence on foreign military... ...‑Source Intelligence Analyst The Cyber All‑Source... ..., propaganda) Evaluating the full range of foreign... ...doctrine, intent, and both remote and physical cyber... ...everything we do. Growth: AI-powered career tool...Remote work
$90 per hour
...cases Complete structured scoring rubrics for each evaluation Establish reference evaluations for diagnostic benchmarks Who Should Apply Currently enrolled in a... ...as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule...Remote workContract workFor contractorsTerac
San Francisco, CA18 days ago- ...Video & Audio Annotation and AI Prompt Evaluation - English RWS Group is looking for Data Specialists... ...looking for freelance, part-time, remote, work-from-home jobs where you can set... ...You will contribute to building a new benchmark dataset that will evaluate a model’s...Remote workPart timeFreelanceImmediate startWork from homeFlexible hours
RWS Group
San Antonio, TX16 hours ago - ...-MAG LLC is seeking experienced researchers to lead the evaluation of healthcare-focused AI systems. The role focuses on clinical reasoning, evidence synthesis, benchmarking, and reliability analysis, with remote collaboration across clinicians and engineers. Ideal candidates...Remote work
24-MAG LLC
New York, NY2 days ago - ...to help define how frontier AI models reason about physics.... ...reference solutions, and design benchmarks that challenge current... ...hourly contract position, fully remote within the United States. As... ...researcher, you will calibrate evaluation criteria with colleagues, share...Remote workHourly payContract work
Benture
United States2 days ago $30 per hour
...Prolific is seeking Customer Support Representatives to join its Expert Network to train and evaluate AI models using real service expertise. You may complete a short test and, if successful, join as a participant to be paid for AI training and evaluation work. You’...Remote workHourly payWork from homeProlific Academic Ltd
United States3 days ago$65 - $90 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark , General Catalyst ,... ...0/hour Location: Remote Commitment: 35 hours... ...financial practice. Evaluate AI model outputs against... ...progression (e.g., Analyst → Associate → VP/Director...Remote workContract workSummer workWeekday workMercor
Abbeville, GA20 days ago$90 per hour
...and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel... ...Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of AI-...Remote workContract workSummer workMercor
Abbeville, GA20 days ago$8 - $65 per hour
...Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote workHourly payWork from homeFlexible hoursProlific
United States1 day ago$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered... ...Francisco, our investors include Benchmark , General Catalyst ,... ...Machine Learning Engineer — Model Evaluation & Experimentation Type:... ...$60–$90/hour Location: Remote Commitment: 35 hours/...Remote workContract workSummer workMercor
Abbeville, GA20 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Intelligence Analyst: AI Evaluation & Benchmarking. Be the first to apply!
Related searches
- criminal intelligence analyst New York, NY
- intelligence analyst New York, NY
- open source intelligence analyst New York, NY
- military intelligence analyst New York, NY
- all-source intelligence analyst New York, NY
- competitive intelligence analyst New York, NY
- market intelligence analyst New York, NY
- military intelligence officer New York, NY
- support specialist remote New York, NY
- quality manager remote New York, NY