Remote AI QA Trainer: LLM Evaluation & Reliability
Invisible Expert Marketplace
- Remote job
A technology consulting firm in Canada seeks an AI QA Trainer for LLM Evaluation. This remote role involves evaluating large-scale language models through testing and improvement processes. The ideal candidate will have experience in QA for ML systems, strong programming skills, and a solid educational background in computer science or a related field. Pay ranges from $6–$65 per hour, depending on experience. #J-18808-Ljbffr Invisible Expert Marketplace
- AI QA Trainer - LLM Evaluation Are you an AI QA expert eager to shape the future of AI? Large-scale language... ...to harden model reasoning and reliability. Responsibilities On a typical day... ...Employment Type Contract Workplace Remote Seniority Level Mid‑Senior Level #J...Remote workHourly payContract workFor contractorsFreelance
- A leading AI evaluation firm in the United Kingdom is seeking an AI QA Trainer to enhance the reliability of large-scale language models. This mid-senior level contractor role involves designing and executing test plans while ensuring factual accuracy in model assessments...Remote jobHourly payFor contractors
- Driverai is seeking an Applied Data Scientist with expertise in LLM evaluation to join its innovative team in Austin, TX. This role focuses on building the evaluation function from scratch and requires a strong background in statistics and machine learning. The successful...Remote job
$175k - $275k
Full-Time in Austin, TX Remote (any location) - Senior - Product & Engineering - $175k - $275k Applied Data Scientist, LLM Evaluation Introduction At Driver, we’re building systems that turn... ...the context layer for employees and AI agents alike to use in developing software...Remote jobFull timeFlexible hours$50 - $60 per hour
...committed to creating high-quality AI. We are looking for a Sales &... ...enjoying the flexibility of remote work and the freedom to set... ...version of the AI smarter and more reliable. To succeed in this... ...diverse and complex problems and evaluate their outputs Evaluate the...Remote workHourly payFull timeContract workPart timeWork experience placementFlexible hours- ...Supporting AI data and language projects, the hourly contractor AI Trainer and Evaluator will work remotely on a flexible basis, focusing on content generation, data annotation,... ...in fact-checking localized content using reliable sources Reliable, self-directed, and able...Remote workHourly payFor contractorsFlexible hours
$140k
...a leading foundational model AI lab. You are a good fit if you... ...positions. $15.00 hourly Remote Part‑time +1 Product Testers... ...0 hourly Remote Part‑time +1 Evaluators in Finance Operations / Audit... ...and slide decks) for accuracy, reliability, and compliance. $100,000.00...Remote workHourly payFull timePart timeFor contractorsWork from home- ...Background** Datatricks AI specializes in building... ...Large Language Model (LLM) training. Our global network... ...to technical spatial evaluation. **Roles and... ...complex instructions. * A reliable high-speed internet connection... .... **Applicant’s Location** Remote United States...Remote workHourly payLong term contractContract workFreelanceFlexible hours
$50 per hour
...seeking a Basque Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading... ...Quality Assurance Participate in QA and review cycles to ensure tasks... ...quality bar. Maintain consistency and reliability before datasets are integrated...Remote jobHourly payTemporary work10 hours per week$30 per hour
...Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in... ...home with competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr...Remote workWork from home- ...is seeking a qualified candidate for a role focused on improving answer quality across Perplexity's products. You will architect evaluation pipelines, design methods to measure tool impact on answers, and develop visual evaluation solutions. Ideal candidates should possess...
- ...Summary This is a fully remote, hourly contractor role supporting AI data and language... ...AI training datasets. LLM evaluation: reviewing AI-generated... ...appropriateness. Localization QA: ensuring terminology,... ..., names, dates) using reliable sources and consistent...Remote workHourly payTemporary workFor contractorsFlexible hours
$40 per hour
DataAnnotation is seeking a Physics AI Training Specialist in Maryland to train AI models by measuring their progress and evaluating logic. This role allows you to work from home on your own schedule, with hourly pay starting at $40+. A strong understanding of physics...Remote jobHourly payWork from home$30 per hour
...A prominent AI data company is seeking Advanced Mandarin Speakers for evaluating AI models and completing training tasks. This remote role offers competitive pay of $30/hr for tasks requiring one hour of focused work. Candidates should be fluent in Mandarin with the ability...Remote workWork from homeFlexible hours$40 per hour
DataAnnotation is seeking a Biology Instructor to train AI models while working from home. This role requires deep expertise in biology, with responsibilities including evaluating the logic of AI chatbots and assessing the quality of their outputs. You can choose your projects...Remote jobHourly payWork from homeFlexible hours$90 per hour
...technical talent with leading AI research labs.... ...0/hour Location: Remote Role Responsibilities... ...feedback. Apply consistent evaluation standards across a... ...ensure consistency and reliability. Contribute to... ...grading, tutoring, or QA. Application Process...Remote workContract workSummer work$180k
...professionals towards their dream careers AI Evaluation Engineer $180,000 Remote (US-based) Are you passionate... ...shaping how AI is deployed safely, reliably, and at scale? This is a rare... ...and guardrails that make advanced LLM features safe to ship. You’ll collaborate...Remote workFull time$20 per hour
...technology company is seeking a Customer Support Specialist to train AI models and evaluate chatbot outputs. The ideal candidate will have native-level... ...$20 per hour, with bonuses for high-quality work. This is a REMOTE position open only to applicants in the United States. #J-18...Remote workHourly payFlexible hours$40 per hour
...for a Biology Expert to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the... ...Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects...Remote workHourly payFull timeContract workPart time$141.8k - $258.6k
...multimodal capabilities. You will design and manage data annotation processes, work with ML Engineers, and develop LLM auto-judges for AI model evaluation. The ideal candidate has a BA/Master’s in a relevant field and at least 2 years of experience in survey design and...$40 per hour
A technology company specializing in AI training is looking for a Biology Expert based... ...providing complex biology questions and evaluating their maturity and performance. Candidates... .... This flexible position is offered remotely with project-based hourly pay starting at...Remote workHourly payFlexible hours- ...Prolific is seeking Registered Nurses for the role of AI Trainer. In this capacity, you will evaluate AI-generated clinical responses for accuracy and appropriateness. Candidates should possess a valid nursing license, clinical experience, and the ability to focus on complex...Remote workWork from homeFlexible hours
$60 per hour
Prolific is looking for Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly from home, earning up to $60 per hour for paid tasks. Responsibilities include reviewing scientific data accuracy...Remote jobHourly payWork from homeFlexible hours$60 per hour
A leading AI development firm is currently seeking experienced quantitative professionals to join their team. This fully remote position allows you to evaluate AI-generated quantitative analyses and solve complex problems while enjoying a flexible schedule. Ideal candidates...Remote workFlexible hours$80 - $120 per hour
...Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain‑specific quality rubrics. Identify factual, aesthetic, and presentation errors in documents...Remote workContract workWork at office- DataAnnotation is seeking an experienced Biology Instructor to help train AI models by evaluating their logic and outputs. This role allows you to work independently on your own schedule from anywhere in the United States. Ideal candidates will have a background in Biology...Remote jobHourly payFlexible hours
$60 per hour
...A leading technology platform in the United States seeks proficient programmers for remote work in AI development. You'll design coding problems, write high-quality code, and evaluate AI-generated projects. Preferred qualifications include fluency in English, experience...Remote work$60 per hour
...A cutting-edge AI development firm is looking for proficient programmers to work remotely on AI projects with flexible scheduling. As a member of this dynamic coding... ...coding problems, write high-quality code, and evaluate AI-generated outputs. Ideal candidates will be...Remote workFlexible hours$60 per hour
A leading AI development firm is seeking experienced quantitative professionals to assist in advancing AI development. This remote role involves evaluating AI-generated analyses and providing critical feedback to shape future models. Ideal candidates have over 2 years of...Remote workFlexible hours- ...A tech-driven AI development firm is looking for proficient programmers to join their virtual coding team. You'll work on diverse... ...challenges related to AI, including mobile app development and code evaluations. This position offers competitive pay, a flexible schedule, and...Remote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI QA Trainer: LLM Evaluation & Reliability. Be the first to apply!
- ai trainer New York, NY
- program coordinator remote New York, NY
- research coordinator remote New York, NY
- automation engineer remote New York, NY
- remote ui developer New York, NY
- remote customer service advisor New York, NY
- it manager remote New York, NY
- remote financial planning New York, NY
- junior angular developer remote New York, NY
- project manager remote europe New York, NY


