Remote QA Analyst: Chatbot Evaluation & AI Quality
Benture
New York, NY
- Remote job
Turing, an AI company, is seeking a meticulous Quality Analyst for a 16-week contract to evaluate and compare chatbot responses. You will review outputs against guidelines, identify inaccuracies, and provide a clear final assessment for each task. Join a remote US-based project team to collaborate with quality and project groups, meet productivity targets, and escalate complex cases when needed. This role focuses on data-quality and AI tool usage throughout the evaluation process. #J-18808-Ljbffr Benture
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote QA Analyst: Chatbot Evaluation & AI Quality in New York, NY vacancy
$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity... ...Responsibilities include reviewing evaluation tasks, identifying inconsistencies,... ...up to $80/hour, this flexible remote position allows candidates to influence...Remote jobQualityFlexible hours$80 per hour
...thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent... ...to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects...Remote workFlexible hoursMind Rift
New York, NY13 hours ago- AuraOne Human Data is seeking a Quality Analyst for AI Annotation Audit & Label Consistency Review. This remote contractor role evaluates AI outputs across workflows, grades workflow correctness, policy adherence, and stakeholder fit, and documents next steps to train the...Remote jobQualityFor contractors10 hours per week
$60 per hour
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors...Remote jobFreelance- ...currently seeking a Senior QA/QC Data Analyst with AI/ML testing to join our team... ...collaborative environment. • Evaluate data across various... ...and integrity. • Establish quality criteria for data accuracy,... ...While many positions offer remote or hybrid work options, these...Remote workQualityWork experience placementWork at officeFlexible hours
NTT DATA, Inc.
Indianamore than 2 months ago - KaiCalls is seeking a meticulous QA reviewer to sample and review real calls under privacy rules and to maintain rubrics... ..., and partner with engineering on remediation. This remote role supports evaluating calls across verticals and languages with emphasis on evidence...Remote jobQuality
- micro1 seeks a Data Analyst to evaluate AI-related data quality for a customer project. This contract role emphasizes applying domain knowledge to ensure accurate, guideline-conformant data as input for next-gen models. No AI-specific background required beyond strong analytical...Remote jobQualityContract work
$40 - $120 per hour
...AI Chatbot Tester $40-120/hr Remote Freelance GENERAL About the Role What if your curiosity and critical... ...complex or creative scenarios Evaluate chatbot responses for helpfulness,... ...Able to evaluate response quality objectively and articulate your reasoning...Remote workQualityHourly payContract workFreelanceWorldwideFlexible hoursAlignerr
United States2 days ago- ...instincts could help shape the AI tools millions of... ...? We're looking for AI Chatbot Testers to engage... ...Hourly Contract Location: Remote Commitment: 10–40 hours... ...and complex scenarios Evaluate chatbot responses for helpfulness... ...eye for clarity and quality Comfortable working in...Remote workQualityHourly payContract workFreelanceFlexible hours
Alignerr Corp.
New York, NY3 days ago $89k - $148.4k
...and services that make quality care more accessible... ...remaining days worked remotely. Specific in-office days... ...Quality Assurance (QA) Analyst, you will ensure the quality... ...and emerging AI-assisted testing capabilities... ..., regular job market evaluations, and geographical...Remote workQualityFull timeH1bWork at office2 days per weekMcKesson
Atlanta, GA13 hours ago- ...management platform part of Fluent Software Group, seeks a QA Analyst to own quality across the product. You will plan and run testing—... ...the Product Manager to catch issues early. This remote-first role is hands-on, with AI tools like Claude or GitHub Copilot integral to...Remote jobQuality
$35 - $40 per hour
A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations... ...and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This...Remote jobQualityContract workFlexible hours$55k - $65k
...stakeholders. Use approved AI-assisted tools, where appropriate... ...continuous improvement of QA processes, testing standards... ...the Mobile Team Lead, the Quality Assurance Analyst’s key responsibilities will... ...and work independently in a remote team environment. Preferred...Remote jobQualityWork at office- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You...Remote jobQualityFull time
$80 per hour
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical... ...defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while...Remote jobPart timeFlexible hours- OpenTrain AI, Inc. is seeking a remote contractor to evaluate AI-generated SQL queries, database designs, and data-processing logic, focusing on correctness... ...SQL and data tasks, rating AI responses for accuracy and reasoning quality. #J-18808-Ljbffr OpenTrain AI, Inc.Remote jobQualityFor contractors
$80 per hour
...contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks... ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up...Remote jobQualityPart timeFlexible hours- ...Inc. in the United States is hiring a Principal Quality Automation Engineer to shape evaluation frameworks for Generative AI and agentic AI systems. You will own the end-... ...with DS, engineering, and product teams. Remote options within the United States are available...Remote jobQuality
- Volga Partners is seeking an AI Language Quality Evaluator fluent in Greek and English to assess localization accuracy across UI texts and app screens. This freelance, task-based role offers flexible remote engagement with on-demand tasks and no guaranteed hours. As part...Remote jobQualityFreelanceFlexible hours
- Turing is seeking a detail-oriented Business Analyst to support a project evaluating multiple chatbot responses. You will gather and document business requirements... ...stakeholders to deliver clear specifications. This remote freelance assignment runs for 16 weeks with a five-...Remote jobFreelanceWeekend work
- ...connects elite creative and technical talent with leading AI research labs. We seek a contract Product Management / Roadmap / PRD Evaluator who can work remotely and autonomously to assess AI outputs against high-quality rubrics. Required are 5+ years in product management,...Remote jobQualityContract workWork at office
$80 - $150 per hour
Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks... ...include reviewing AI responses for accuracy and quality, and providing structured feedback. Ideal candidates have verified...Remote jobQualityWork from home$30 - $50 per hour
...data annotators to support US-based AI/ML projects across NLP, LLM evaluation, RLHF, content safety, and computer... .... You will produce and review high-quality labeled data, ensuring strict... ...model performance improvement. Fully remote role aligned with Miami job-search...Remote jobQualityHourly pay- micro1 is seeking a QA Engineer for a remote contractor role focused on AI training data quality. You will design and execute tests to validate AI outputs, annotate datasets to improve model training, and evaluate predictions for errors and patterns. Collaboration with...Remote jobQualityFor contractors
- ...AI Chatbot Tester MCI is one of the fastest-growing tech... ...by both on-site and remote agents, leveraging advanced... ...AI Chatbot Tester to evaluate, validate, and improve... ...key role in maintaining quality standards and enhancing... ...in software testing, QA, customer experience, or...Remote workQualityTemporary workWork at officeLocal area
AI Support Positions
United States4 days ago - mpathic is seeking a Senior Clinical QA Lead to oversee clinical quality across AI safety evaluations, data annotation, labeling, and red-teaming projects. You’ll... ...standards and rigorous documentation. This full-time remote role offers a unique opportunity to shape QA...Remote workQualityFull time
- ...is seeking a Senior Data Annotator to work remotely with our US-based Phoenix team. You will lead data labeling across NLP, LLM evaluation, and computer vision tasks, guiding RLHF workflows and QA checks to ensure high-quality training data. Sources emphasize strong attention...Remote jobQualityFull time
- ...fluent Gujarati speakers to act as evaluators for side-by-side evaluations... ...will assess how naturally the AI captures Gujarati speech and... ...culturally mismatched. This remote freelance role offers flexible... ..., and have a quiet setup with quality headphones. #J-18808-Ljbffr ProlificRemote jobQualityFreelanceWork from homeFlexible hours
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workQualityContract workTemporary workImmediate start
MERIT Beauty
United States2 days ago - ...Science Specialists to join its Expert Network to help train and evaluate AI models. You’ll take a brief skills test and, if successful, become a paid participant working from home to support high‑quality data collection. You will rank AI outputs, review CS research papers...Remote jobQualityWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote QA Analyst: Chatbot Evaluation & AI Quality. Be the first to apply!
Related searches
- quality assurance analyst New York, NY
- qa analyst - remote New York, NY
- qa analyst New York, NY
- software engineering manager remote New York, NY
- remote recruitment consultant New York, NY
- remote data manager New York, NY
- business intelligence analyst remote New York, NY
- benefits specialist remote New York, NY
- junior angular developer remote New York, NY
- remote video game New York, NY