LLM AI Quality Analysts
$15 per hourDonato Technologies Inc
IMMEDIATE HIRING | LLM / AI QUALITY ANALYST
We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity.
Rate: $15/hr USD
Start Date: Immediately
Availability: 30–40 hours/week
PST Overlap: 4 hours required
Engagement: Contractor
Education: Bachelor’s or Master’s degree in IT or any IT-related field
Approved States:
Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, Wyoming.
Requirements
• Strong English reading and writing skills
• Strong analytical and attention-to-detail skills
• AI evaluation, data annotation, content moderation, or related experience preferred
• Ability to work independently in a remote environment
• Laptop/Desktop with reliable internet
• Willingness to use a primary personal Google account and enable personal data sources for the assessment
What You’ll Do
• Evaluate personalized AI/Gemini responses
• Create and test multi-turn prompts
• Assess AI responses for Grounding, Integration, and Helpfulness
• Compare model responses side-by-side
• Identify incorrect personalization, poor inferences, and hallucinations
• Provide detailed feedback and rationales
Interested?
Please send your updated resume + current location + availability to:
View email address on click.appcast.io This is a remote position.
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the LLM AI Quality Analysts in Remote vacancy
$15 per hour
...IMMEDIATE HIRING | LLM / AI QUALITY ANALYST We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity. Rate: $15/hr USD Start Date: Immediately Availability: 30–40 hours/week PST Overlap: 4 hours required...SuggestedContract workFor contractorsImmediate startRemote work- ...Job Description We are seeking an experienced MDM Data Quality Analyst to support Master Data Management services for the Health... ...modernization initiatives. · Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering for development, testing,...SuggestedRemote work
- ...of the MDM Technical Lead, you'll perform the data analysis, quality assessment, testing, and validation work that keeps MDM... .../ ETL modernization initiatives. Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering for development, testing, documentation...SuggestedRemote work
- DescriptionKeeper is hiring a talented Senior QA Analyst to join our AI & Threat Analytics team. This is a 100% remote position... ...focuses on validating the behavior, reliability, and quality of AI systems, including LLM-based summarization, classification, autofill, and...SuggestedTemporary workRemote work
- ...To enhance personalized AI experiences, the full-time English AI Quality Analyst will design and evaluate multi-turn prompts, assess AI responses for relevance and helpfulness, and provide evidence-based rationales, all while working remotely. Key responsibilities Design...SuggestedFull timeRemote work
- ...A leading AI research accelerator seeks an AI Quality Analyst in Honolulu. You will evaluate a new personalization feature for AI, requiring Japanese proficiency and strong analytical skills. Your role involves designing prompts, assessing model responses, and providing...For contractorsRemote work
$38 per hour
...experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality —... ..., but done right. You'll work closely with both people and AI systems — auditing outputs, supporting day-to-day execution, and...Full timeContract workRemote workVisa sponsorship$80.2k - $90k
Systems/Quality Analyst II-III (EDI Enrollment) Hybrid role (3 days/week in office) at our Burlington, Renton, Spokane, Vancouver, Portland,... ...methodologies.Able to contribute to a QA strategy.Experience with AI tools and technologies to enhance productivity and decision-...Full timeWork at officeImmediate startWork from homeRelocationFlexible hours3 days per week- An environmental consulting firm is looking for Environmental Scientists and Specialists to provide expertise in refining AI systems. This role involves analyzing various environmental datasets, contributing to risk assessments, and collaborating with technical teams....Remote workFlexible hours
$60k - $72k
...Clinical Data Quality Analyst Syracuse NY HealtheConnections, a respected national leader in providing health information exchange (HIE... ...is reviewed by a member of our team. We do not rely on AI to determine which candidates are considered for our opportunities...Minimum wageRemote workFlexible hours- ...leading research accelerator for frontier AI labs and a trusted partner for global... ...accelerating frontier research with high-quality data, advanced training pipelines, plus top... ...the P&L. Role Overview As an AI Quality Analyst, you will evaluate a new personalization...Remote jobFull timeFor contractorsLocal area
$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for those with strong analytical and detail-oriented skills. Responsibilities include reviewing evaluation tasks, identifying inconsistencies, and...Remote workFlexible hours$77k - $112k
...Data Quality Analyst Putting people first, every day BDO is a firm built on a foundation of positive relationships with our people and... ...able to learn and adopt new data quality tools such as Soda, AI-powered data quality platforms, as well as native data quality...Work experience placementWork at officeLocal areaRemote workFlexible hours$122.8k - $184.2k
...skills toward causes you care about—locally and globally. Come make an impact every day at Zebra. What We're Looking For The AI Quality Analyst is a critical role responsible for ensuring the performance, safety, and reliability of our cutting‑edge AI/ML models. You...Summer workLocal areaFlexible hours- YO AI Labs is seeking an English Language Expert to support an AI training and evaluation project in a remote, hourly contractor role... ...responses, craft expert language content, evaluate reasoning quality, and provide precise feedback to improve model accuracy. The ideal...Remote jobHourly payFor contractors
- ...Develop, update, and maintain testingstandards and procedures. Use AI-driven tooling to improve testcoverage, defect detection, and... ...with other QA\'s and architects to develop and establish quality assurance standards and best practices Performs and coordinates...Contract workLocal areaRemote work
- micro1 is seeking Data Analysts to support a customer project focused on business data analysis, document review, privacy, and quality assurance for AI training. No prior AI experience is required. Remote contractor role.Responsibilities include analyzing datasets, reviewing...Remote jobFor contractors
$80 per hour
A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies...Remote jobFlexible hours$35 per hour
A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing media...Remote job10 hours per week$153k - $179k
Senior Data Quality AnalystNew York, NYWe Breathe Life Into DataAt Komodo Health, our mission... ...Komodo's Data Products.Our data quality analysts support, investigate, and solve tangible... ...such as Git/GitHubExpectations Of AI Use In This Role (Required):Ability to leverage...For contractorsWork experience placementWork at officeLocal areaRemote workFlexible hours- Title: Software Quality and Testing Analyst II Position Type: Right to Hire Location: Rockville, MD, United States Onsite Flexibility: 50% Remote... ...Maintain a basic understanding of Artificial Intelligence (AI) and Machine Learning (ML) concepts and utilize AI-assisted...Full timeContract workRemote workMonday to Friday
- Get AI-powered advice on this job and more exclusive features. Squadware Inc is hiring a Software Quality Assurance Analyst for a consulting position with one of our clients on the north side of Indianapolis. This role is full time and can be a 1099 contract or w-2 position...Full timeContract workRemote workRelocation
$76.23k - $106.37k
Citi is looking for a Quality Assurance Engineer who will build and execute automated test solutions that directly protect the quality of... ...Beneficial skills & qualifications Hands‑on experience testing AI or machine learning model outputs, including evaluating the accuracy...Full timeWork at officeRemote work$33 - $38 per hour
...applications and next steps. Our partner is looking for a Quality Assurance Data Analyst based in the United States. This remote contract role focuses... ...initiatives. How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed...Hourly payFull timeContract workTemporary workWork at officeRemote work$86.6k - $130k
...project managers. We are looking for a UX Quality specialist to help shape the future of... ...into the in-vehicle experience. Leverage AI (LLMs) to categorize multiple databases of... ...concept validation experience ~2+ years LLM prompt engineering ~2+ years UX prototyping...Work at officeImmediate startFlexible hours$60 per hour
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors...Remote jobFreelance- A leading AI research accelerator is looking for a detail-oriented Business Analyst to support evaluation and annotation workflows. The role involves performing evaluations, fact-checking, and providing structured justifications based on established guidelines. Ideal candidates...Remote jobFlexible hours
- ..., apply now. We are currently seeking a Senior QA/QC Data Analyst with AI/ML testing to join our team in Bangalore, Karnātaka (IN-KA),... ...validity, timeliness, uniqueness, and integrity. • Establish quality criteria for data accuracy, completeness, consistency, validity...Work experience placementWork at officeRemote workFlexible hours
- ...Are you interested in working with the World’s leading AI-powered Quality Engineering Company? Ready to advance your career, team up with... ...every day? Join us at QualityAI!We are looking for a QA Test Analyst (Manual & Data Testing) to join our growing team in Argentina...Local areaRemote work
$80 per hour
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying...Remote jobPart timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM AI Quality Analysts. Be the first to apply!


