AI Response Evaluation Specialist
Obsidian
Obsidian is seeking a detail-oriented evaluator to review AI-generated responses and provide structured written feedback. You will assess accuracy, identify gaps in reasoning, and document findings following our established evaluation guidelines. Ideal candidates demonstrate native English fluency, strong analytical writing, and the ability to work independently without AI writing tools. This role supports high-impact AI research initiatives and requires careful, precise judgment. #J-18808-Ljbffr Obsidian
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Response Evaluation Specialist in New York, NY vacancy
- Dorado is seeking a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems, probe model... ...errors, and provide expert critique of AI responses while working with project #J-18808-Ljbffr DoradoSuggestedRemote job
$24 - $30 per hour
Mercor is seeking a Moonlight MCQA - Arabic Generalist to draft Arabic MCQs for an AI evaluation dataset. This contract role offers remote work with flexible hours and a process including AI interview based on your resume. Must hold a master's or PhD, 2-6 years of experience...SuggestedRemote jobHourly payContract workFreelanceFlexible hours- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...SuggestedRemote jobContract workImmediate startFlexible hours
$10k
...of Education and the Department of Health and Mental Hygiene responsible for promoting the health of the 1.3 million school children enrolled... ...Health and analyze the training needs of the program. Evaluate the effectiveness of the asthma case management program, develop...SuggestedPermanent employmentFull timeWork at officeWork from home2 days per weekCity of New York
New York, NY1 day ago$153.6k - $207.8k
...AWS is seeking a Sr. Database Specialist Solutions Architect to serve... ...business outcomes.Key job responsibilities- Design and architect end-to... ...applying technical judgment to evaluate trade-offs in scalability,... ...right workload.- Generative AI fluency: Understanding of...SuggestedWork at officeFlexible hours$20 - $23 per hour
...NJ 08009Position Type: Full TimeEducation Level: 4 Year DegreeSalary Range: $20.00 - $23.00 Hourly Crisis Response Specialists will be responsible for evaluating consumers and deciding if additional psychological, psychiatric, or clinical services are needed. If this is...Hourly payFull timeShift work$20 - $23 per hour
Legacy Treatment Services is hiring an Entry Level Crisis Response Specialist in Berlin, NJ. You will evaluate consumers, determine the need for further clinical services, and coordinate with an on-call Master’s Level Clinician for support. This is a full-time role with...Hourly payFull timeShift workNight shift$176.6k - $239k
...grow.Are you passionate about Generative AI, Agentic AI, and Machine Learning? Are... ...workflows, model customization strategies, responsible AI implementations, and production-scale... ...frameworks, prompt engineering, model evaluation, fine-tuning) is required. A strong mathematics...Local areaWorldwideFlexible hoursDay shift$8 - $65 per hour
...Korean-Japanese Bilingual Specialist - Freelance AI Trainer Project World Wide - Remote Are you... ...’ll work with cutting‑edge AI tools, evaluate translations and conversations... ...translations, annotate errors, assess responses for naturalness and context, and collaborate...Hourly payContract workFor contractorsFreelanceRemote workWorldwideMeridial
New York, NY1 day ago- Tutoring Specialist - Freelance AI Trainer Project Job Summary World Wide - Remote Are you an experienced... ...who know the work firsthand. Responsibilities Engage the model on complex... ...reflects best‑in‑class teaching practice. Evaluate AI outputs for clarity and...Hourly payContract workFor contractorsFreelanceRemote work
- Politics & Government Specialist - Freelance AI Trainer Project World Wide - Remote Are you a politics... ...power the next generation of AI. Responsibilities On a typical day, you will engage... ...structured feedback to improve prompts, evaluation standards, and analytical depth. You...Hourly payFor contractorsFreelanceRemote work
- ...skilled Audacity users to support AI research through flexible,... ..., or voice‑over recording to evaluate AI‑generated content and... ...Editor or Audio Post‑Production Specialist Podcast Producer Voice‑Over... ...questions and review AI‑generated responses for accuracy and relevance to...Hourly payFull timeContract workFor contractorsFreelanceRemote workFlexible hours
$11 - $30.65 per hour
Spanish Audio Specialist - Freelance AI Trainer Project World Wide - Remote A project dedicated to... .... The program’s mission is to evaluate and optimize model performance for real... ...-world customer support use cases. Responsibilities Create and execute role-play-based...Hourly payContract workFor contractorsFreelanceRemote work- ...skilled ParaView users to support AI research through flexible,... ...or large dataset analysis to evaluate AI-generated content and... ...or Applied Mathematician HPC Specialist or Computational Scientist You... ...questions and review AI-generated responses for accuracy and relevance to...Hourly payFull timeContract workFor contractorsFreelanceRemote workFlexible hours
$8 - $65 per hour
Coding Specialist (Fluent in Japanese) - Freelance AI Trainer Project World Wide - Remote Are you a coding expert... ...the next generation of AI. Responsibilities Design and develop coding tasks... ...improvements to prompt engineering and evaluation metrics. Qualifications...Hourly payContract workFreelanceRemote work$8 - $65 per hour
Science Specialist (Fluent in German) - Freelance AI Trainer Project World Wide - Remote Are you a science specialist... ...the next generation of AI. Responsibilities Challenge advanced language... ...to prompt engineering and evaluation metrics. Qualifications Bachelor...Hourly payContract workFor contractorsFreelanceImmediate startRemote work$24 per hour
Geospatial Reasoning Specialist (Senior) - Freelance AI Trainer Project World Wide - Remote Are you an experienced... ...reasoning agent focused on Crisis Response—helping AI systems understand,... ...will guide model development and evaluation, laying the foundation for future...Hourly payContract workFor contractorsFreelanceRemote work$140k - $200k
...and sophisticated Artificial Intelligence (AI) solutions, while embracing enterprise... ...access certification campaigns and audit responses by validating access rights, producing evidence... ...the enterpriseMentor team members and evaluate emerging capabilities to continuously...Work experience placement- Religion Specialist - Freelance AI Trainer Project World Wide - Remote Overview Large‑scale language... ..., and cultural context accuracy. Responsibilities Engage the model with religious or... ...questions, and cultural context tasks. Evaluate accuracy, neutrality, and logical...Hourly payContract workFreelanceRemote work
$207k - $275k
CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave... ...services need a market-maker. As a Solution Specialist for AI Runtime Services, you open new... ...manage complex, multi-stakeholder technical evaluations without losing momentum.Why CoreWeave?At...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- DescriptionThe Dialysis Equipment Specialist (DES) is responsible for the maintenance, upkeep, and operation of all Hemodialysis and Peritoneal dialysis... ...unit.Responsibilities1. Maintains, calibrates, and evaluates dialysis machines and other related equipment used for dialysis...Hourly payTraineeshipLocal areaWeekend work
$99.5k - $214.4k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...Salesforce.This is a unique Specialist Account Executive role within... ...Enterprise Account Executives, with responsibilities and deal scope aligned to... ...our recruiters assess and evaluate candidates’ resumes and...Full time$162.7k - $220.2k
...strategic and data-driven businesses? Join the Generative AI specialist team as a Business Development Specialist!Within the Worldwide... ...implement scalable GenAI solutions to solve them. Key job responsibilities - Lead Amazon Bedrock AgentCore GTM to orchestrate sales...Local areaWorldwideFlexible hours$162.7k - $220.2k
...driving meaningful business changes with Agentic AI? The Agentic Development & Developing Agents (ADDA) organization is responsible for building tools and services that enable... ...as a Sr. Technical Business Development Specialist, Agentic AI for Application ModernizationThe...Immediate startWorldwideFlexible hours$77.7k - $146.9k
...Role OverviewThe Technology Risk Advisory - AI Risk Senior Associate will play a key... ...and governance of AI and GenAI systems, evaluate cloud and data controls, and contribute to... ...lifecycle controls, data governance, and responsible AI considerations.Technology & Cloud Compliance...Full timeWork experience placementInternshipLocal area- ...modern LLM-based methods where appropriate), evaluate performance with rigorous metrics, and... ...operational workflows.As an Applied AI/ML Senior Associate in our AI for Operations... ...next-best-action recommendations.Job Responsibilities Apply deep natural language processing (...Work experience placement
$162.7k - $220.2k
The AWS AI Partner GTM team supports the world's most innovative partners - from... ...AI systems. The Senior WW Partner GTM Specialist for Agentic AI, ISV GTM will be the driving... ...the future.Key job responsibilitiesKey Responsibilities:• Collaborate with AWS GenAI partners,...Local areaWorldwideFlexible hours- ...Chemistry Specialist – AI Trainer, New Grad (Remote) Join to apply for the Chemistry Specialist... ...data for advanced language models. Responsibilities: • Converse with the model on lab... ...improvements to our prompt engineering and evaluation metrics Qualifications: Required: •...Full timeContract workFreelanceRemote workWorldwide
jobright.com
New York, NY1 day ago $176.6k - $239k
...the data platform is headed next? As a Specialist Solutions Architect for Aurora PostgreSQL... ...engagements worldwide.Key job responsibilities• Serve as the technical advisor for AWS... ...(Python, Java, etc.), and fluency with AI tooling (Kiro, Claude Code, Codex, etc....Local areaWorldwideFlexible hours$176.6k - $239k
...to Market (GTM) at AWS using generative AI (GenAI) and agentic coding tools like... ...development workflows? Become an AWS GenAI specialist SA! AWS is looking for a Generative AI... ...software development lifecycle.Key job responsibilities- Interact with customers directly to...Local areaWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Response Evaluation Specialist. Be the first to apply!
