AI Quality Analyst
Virtual Vocations Inc
To enhance personalized AI experiences, the full-time English AI Quality Analyst will design and run multi-turn prompts, compare AI responses for quality, and provide evidence-based rationales while working remotely. Key responsibilities
Design and execute short, multi-turn prompts that require meaningful personalization Assess and compare AI responses for grounding, integration, and helpfulness Write clear rationales referencing specific conversational turns and maintain evaluation records Required qualifications Strong English reading and writing ability Willingness to use a personal Google account for work purposes Bachelor's degree or equivalent practical experience in an analytical field Ability to work independently on a remote team with a reliable computer and internet connection Excellent analytical judgment and concise written communication skillsVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Quality Analyst in New York, NY vacancy
- ...organize and synthesize private conversations into source-backed knowledge a firm can build on. \n \n We are now hiring an AI Quality Analyst, based in New York. \n \n You will review what our AI produces, identify where it falls short and build the examples our...SuggestedImmediate start
Syntrace
New York, NY4 days ago - ...MANDATORY - MUST HAVE: software automation testing and quality assurance experience Java 17 experience. Jmeter expertise in test... ...Scrum environment Experience in Java programming/scripting Experience using AI to develop and execute automated test cases...Suggested
3B Staffing LLC
New York, NY1 day ago $20 per hour
SupportFinity™ is seeking a Social Media Content Manager to help train AI models. This role involves evaluating chatbot outputs and ensuring the quality of AI generated content. Candidates should have expertise in writing, editing, and language. The position offers flexibility...SuggestedRemote jobHourly payFull timePart time$20 - $50 per hour
Quality Analyst --- AI Annotation Audit & Label Consistency Review is a remote review track for evaluating AI outputs across quality analyst specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk...SuggestedFor contractorsWork experience placementRemote work10 hours per week- eDataBae in the United States is seeking Chinese-speaking professionals for a short-term AI quality evaluation project. You will create conversational prompts, evaluate AI responses, and provide structured feedback on relevance, accuracy, and personalization. Responsibilities...SuggestedRemote jobTemporary work
$38 per hour
...experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality —... ..., but done right. You'll work closely with both people and AI systems — auditing outputs, supporting day-to-day execution, and...Full timeContract workRemote workVisa sponsorshipWelo Data
New York, NYmore than 2 months ago- ...Job Description Data Quality Analyst needed! \n \n We have an opportunity for a client in the Flatiron district of NYC for a Data Quality... ...: data quality. This is not a data-entry role. You'll work AI-first, using Clay, ZoomInfo, LinkedIn Sales Navigator, and AI...Contract workLocal area
Milestone Technologies, Inc.
New York, NY26 days ago - ...evaluation, and project-based workstreams. We are seeking an experienced Data Analyst to review large business datasets, ensure privacy and data quality, and deliver clear recommendations that support AI training and evaluation in a fully remote setting. This independent...Remote jobHourly payFor contractorsFlexible hours
- AI Trainer Jobs seeks a Valuation Research Analyst to remotely review AI outputs across valuation workflows. You will grade calculations, narrative reasoning, and policy adherence, flag compliance issues, and document corrected treatment so the modeling team can train...Remote job
- AuraOne Human Data is seeking a Quality Analyst for AI Annotation Audit & Label Consistency Review. This remote contractor role evaluates AI outputs across workflows, grades workflow correctness, policy adherence, and stakeholder fit, and documents next steps to train...Remote jobFor contractors10 hours per week
- AI Trainer Jobs is seeking a SQL Support Analyst for a remote contractor role focused on evaluating AI outputs within sql support analyst specialist operations workflows. Reviewers assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk...Remote jobFor contractors
- A leading technology company in Canada is seeking an experienced UX evaluator to design evaluation rubrics for AI model outputs and assess user experience. The candidate will execute product validation tasks, analyze AI outputs for usability issues, and collaborate across...Remote job
- inHance, a division of Harris, seeks a Quality Assurance Analyst with 3+ years of QA experience to lead testing for biotech software. The role emphasizes planning, automation scripting for web and desktop, and leveraging TestComplete/ReadyAPI, with travel up to 5% and remote...Remote job
$80 per hour
A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies...Remote jobFlexible hours$35 per hour
A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing media...Remote job10 hours per week$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for those with strong analytical and detail-oriented skills. Responsibilities include reviewing evaluation tasks, identifying inconsistencies, and...Remote jobFlexible hours- ...and contributing to standardised clinical practices. You will collaborate with teams in Australia and the Philippines, supported by AI-driven tools, while maintaining rigorous accuracy and timely communication. A remote, international setup offers growth and impact....Remote job
$60 - $120 per hour
AI Trainer Jobs is seeking a Management Analyst for a remote review role evaluating AI outputs across operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps for the modeling team to train on....Remote jobHourly payFor contractors- AuraOne is seeking a Computer Systems Analyst to remotely review AI outputs across specialist operations. You will evaluate workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps to train the modeling team. This contractor role...Remote jobFor contractors10 hours per week
$50 - $60 per hour
Manual QA Analyst (Property & Casualty Insurance)OverviewWe are seeking a detail-oriented... ...exposure to test automation (10%), ensuring the quality, reliability, and performance of business... ....Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI)...Contract workTemporary workTEKsystems
New York, NY1 day ago- AuraOne is seeking Analysts/Insights Experts to remotely review AI outputs across specialist operations. You will grade workflow correctness, policy adherence, and stakeholder fit, flag operational risk, and document the next steps for training the modeling team. The role...Remote jobFor contractorsFlexible hours
- ..., and test review meetings. Coordinate UAT with stakeholders and provide go/no-go recommendations for production releases. Use AI tools like ChatGPT or Copilot to generate test scenarios, identify edge cases, and speed up test documentation. What We're Looking...Remote work
Sprintsynergy
New York, NY20 hours ago $38 per hour
...Description The Bridge Between Human Judgment and AI Excellence — NYC | WA | CAAre you an experienced QA professional who knows... ...a high bar for data integrity? Welo Data is seeking Data Quality Analysts for Project Perseus. This isn't just about labeling; you are...Hourly payFull timeWork at officeShift work$38 per hour
...Description Join the Human Intelligence Behind the World’s Leading AI – California Are you sharp, curious, and obsessed with the details? Welo Data is looking for Data Quality Analysts who can go beyond simple labels to help define how AI should behave in the real world...Full timeWork at office- ...We are seeking a Freelance Apparel Quality Analyst / Data Analyst to support product quality strategy within a fast-paced retail environment. This role will focus on data collection, customer insights, quality analytics, reporting, and cross-functional coordination. The...Hourly payContract workTemporary workFreelanceWork at officeImmediate start3 days per week
Solomon Page
New York, NYa month ago $128.04k - $173.23k
Data Quality Analyst role is fully remote in the United States, open to US-based candidates, with annual compensation between $128,039 and $173,229. The position emphasizes defining data quality rules, collaborating with stakeholders, and maintaining strong data governance...Remote jobHome office- A leading recruitment firm is seeking a Data Quality Analyst for a contract position. This remote role involves communicating with experts to enhance data management processes and performing root cause analysis on data issues. The ideal candidate should possess strong data...Remote jobContract work
$21.4 - $27 per hour
TELUS Digital is seeking an Ads Quality Analyst for a remote role, primarily working from California, Oklahoma, or New York. You'll collaborate with engineers to enhance advertising quality through data monitoring, administrative tasks, and problem resolution. This position...Remote jobPermanent employmentTemporary work- An environmental consulting firm is looking for Environmental Scientists and Specialists to provide expertise in refining AI systems. This role involves analyzing various environmental datasets, contributing to risk assessments, and collaborating with technical teams....Remote jobFlexible hours
- OU Health is seeking a Quality Data Analyst to support quality improvement through advanced data preparation, analysis, and reporting. The role emphasizes data integrity, dashboard development, and collaboration with quality and operations leaders to translate data into...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Quality Analyst. Be the first to apply!
Related searches
- quality improvement analyst New York, NY
- quality analyst New York, NY
- remote call center quality analyst New York, NY
- quality tech New York, NY
- quality inspection New York, NY
- quality lead New York, NY
- air quality New York, NY
- quality New York, NY
- quality environment health safety manager New York, NY
- quality advocate New York, NY