Generalist Expert for AI Model Evaluation
$50 - $70 per hourSaidGig
Role Overview
Help improve frontier AI models by evaluating the quality of real-world professional materials and AI-generated work. You will apply careful judgment across documents, presentations, spreadsheets, and other written content, providing feedback that helps strengthen AI reasoning and output quality.
Key Responsibilities
- Review documents, slides, spreadsheets, and similar materials for quality, accuracy, clarity, completeness, and correctness.
- Provide clear written feedback and ratings supported by sound reasoning.
- Compare and rank AI-generated outputs using defined evaluation criteria.
- Identify errors, inconsistencies, reasoning gaps, and formatting issues.
Qualifications
- Bachelor''s degree required.
- Excellent English reading comprehension and written communication skills.
- Strong attention to detail and sound judgment across varied subject areas.
- Comfort working independently with common productivity tools, including documents, presentations, and spreadsheets.
- No prior AI or machine-learning experience is required. Guidelines and context will be provided.
Work Terms
- Remote, hourly engagement.
- Applicants must be based in the United States or Canada.
Compensation
- $50 to $70 per hour.
Eligibility
- Open to candidates located in the United States or Canada.
$80 - $160 per hour
...Apply advanced statistical physics and biophysics methods to model bacterial population growth with stochastic two-state... ...produce high-quality, reproducible outputs that train and evaluate next-generation AI systems. No prior AI experience is required; domain expertise...SuggestedHourly payFor contractorsRemote work$100 per hour
...finance expertise to improve AI-driven financial applications... ..., and you will help shape how models learn and perform in real-world... ...standards. Develop, refine, and evaluate prompts related to financial... ...applications by providing expert reviews, annotations, and feedback...SuggestedHourly payPart timeFor contractorsRemote work$80 - $150 per hour
...Role Overview Apply deep physics expertise to evaluate, verify, and improve scientific reasoning used to train next-generation AI systems. This contractor role focuses on... ...SymPy, Python, and Jupyter for theoretical modeling and computational validation. Demonstrated...SuggestedHourly payFor contractorsRemote work$100 per hour
...deep domain knowledge to help train and evaluate next-generation AI systems by reviewing, refining,... ...ensuring accuracy, clarity, and relevance of model outputs through rubric-based... ...asynchronously with project leads and other domain experts to share insights and best practices....SuggestedHourly payContract workPart timeFor contractorsRemote work$80 - $160 per hour
...Role Overview Model stochastic bacterial population dynamics to derive asymptotic growth rates, analyze effects of growth-rate switching... ...clear, reproducible methodological documentation to train and evaluate AI systems. Key Responsibilities Analyze and model...SuggestedRemote jobHourly payFor contractors$40 - $65 per hour
...scenarios that probe frontier language models, then evaluate and document model behavior so engineering... .... Preferred experience with AI human data environments such as RLHF, SFT... ...This engagement is output-based, with experts paid per completed task that meets project...Remote jobHourly payFor contractorsImmediate start$100 per hour
...Role Overview Help train and evaluate next-generation AI by creating and assessing senior-level marketing... ...deliverables used to teach frontier models how to produce professional business documents... ..., or product launch materials. Expert-level mastery of strategic marketing...Remote jobHourly payFor contractors$100 per hour
...Help train and refine advanced AI systems by applying deep software engineering expertise to evaluate, edit, and produce high‑... ...role focuses on improving how models learn and reason by providing... ...with project leads and other experts to deliver work that meets established...Remote jobHourly payContract workPart timeFor contractors$30 - $55 per hour
...world expertise to training next-generation AI systems. This remote contractor role... ...domain-specific feedback that improves AI model behavior. Prior AI experience is not required... ...to enhance AI model learning and evaluation. Work Terms Role type: Contractor....Hourly payFor contractorsWork at officeRemote work$50 - $120 per hour
...digital manufacturing expertise to an AI training project that evaluates CAM, CNC, and fabrication workflows.... ...evaluation rubrics, and improve how models understand and assess real-world... ...Key Responsibilities Provide expert feedback on manufacturing processes...Hourly payFor contractorsRemote work$20 - $40 per hour
...biology expertise to improve AI-driven solutions in the life sciences... ...materials, and guiding model understanding through high-quality... ...content. Author, evaluate, and edit laboratory reports,... ...generated outputs, and provide expert corrections and explanations....Hourly payContract workFor contractorsRemote workVisa sponsorship$40 - $100 per hour
...Role Overview Produce, refine, and validate parametric CAD models in FreeCAD to build high-quality datasets that train and evaluate next-generation AI systems. This role focuses on geometric accuracy, engineering best practices, and reproducible documentation to support...Hourly payFor contractorsRemote work$80 - $100 per hour
...produce detailed, real-world walkthroughs that demonstrate how AI coding agents solve advanced computational problems. Your... ...example artifacts and technical feedback that improve model training and evaluation. Communicate findings accurately and effectively in both...Hourly payFor contractorsRemote work$40 - $50 per hour
...Role Overview Provide expert electrical and field-operations knowledge to analyze, clarify... ...will be used to train next-generation AI systems. This remote contractor opportunity... ...reports, and operational procedures. Evaluate electrical troubleshooting scenarios and...Hourly payFor contractorsRemote work$80 - $160 per hour
...Role Overview Provide expert condensed matter and magnetism analysis to a research program focused on magnetic space... ...generate high quality, real-world content that trains and evaluates next generation AI models. No prior experience in AI is required. Key Responsibilities...Hourly payFor contractorsRemote work- ...to shape how next-generation AI systems understand and reason... ...this contractor role you will evaluate biochemical data, refine use cases... ...domain feedback that improves model performance. No prior AI... ...protocols to provide accurate, expert-level annotation and validation...Hourly payFor contractorsRemote work
$50 - $100 per hour
...infrastructure environments used to train and evaluate reinforcement learning models. You will create reproducible... ...defective variants to validate AI agent behavior. No prior AI experience... ...evaluations for frontier AI models. Experts contribute subject matter knowledge...Hourly payFor contractorsRemote work- ...accurate, and explainable medical AI decision-support tools. This... ...data, and case notes for AI model training, identifying medical... ...medical soundness. Provide expert input on annotation guidelines... ...improve clinical coverage. Evaluate AI-generated recommendations and...Hourly pay
$20 - $40 per hour
...Role Overview Provide original, expert-authored legal materials and... ...used to train next-generation AI systems. This role contributes... ..., helping improve how models learn and perform. No prior AI... ...will be used for training and evaluating AI systems. Materials must...Remote jobHourly payContract workFor contractors$100 per hour
...Apply deep financial domain expertise to improve AI-driven financial applications by reviewing, annotating, and refining model outputs and prompts. You will shape how next-... ..., and relevance. Develop, refine, and evaluate prompts related to financial analysis, valuation...Remote jobHourly payPart timeFor contractors$20 - $60 per hour
...Help improve how large language models create, understand, and modify... ...XML documents by applying expert-level Excel, Word, and PowerPoint... ...scenarios, produce and evaluate complex .xlsx, .docx, and .pptx... ...model improvements. No prior AI experience is required. Key...Remote jobHourly payFor contractorsWork at office$40 - $50 per hour
...Role Overview Apply your linguistics expertise to evaluate large language model outputs and help train next-generation AI systems. You will analyze model-human conversations for linguistic precision, assess adherence to instructions, and deliver clear, actionable feedback...Remote jobHourly payFor contractorsImmediate start$50 - $120 per hour
...360, CAM, and CNC domain expertise to evaluate and refine AI outputs for manufacturing and digital fabrication... .... Key Responsibilities Provide expert feedback on manufacturing processes and... ...to training tasks that improve model reasoning and performance, with the aim...Remote jobHourly payFor contractors$50 - $90 per hour
...for young people. As a Child & Online Safety Expert, you will play a crucial role in shaping the development of next-generation AI systems by providing high-quality, real-... ...help create a robust mental health safety evaluation framework for vulnerable youth online, leveraging...Remote jobHourly payFor contractors$80 - $130 per hour
...used to train next-generation AI systems. This contractor role... ...and review for AI training and evaluation. Key Responsibilities Analyze... ...materials to improve AI model learning and reasoning. Perform... ...with other subject matter experts to align on technical standards...Remote jobHourly payFor contractors$50 - $90 per hour
...Role Overview Help shape how AI systems evaluate chemical safety by applying your toxicology, hazardous-... ...chemical safety evaluation frameworks through expert review, annotation, and guidance used to train next-generation models. No prior AI experience is required. Key...Remote jobHourly payFor contractors$70 - $126 per hour
...Overview Apply your technical domain expertise to shape how agentic AI performs in real engineering workflows. In this contractor role... ...complex software and technical processes, provide detailed evaluations of AI-generated code, and help produce reproducible best...Remote jobHourly payFor contractorsLocal areaVisa sponsorship$70 - $80 per hour
...review complex safety reports and to provide structured, expert feedback that will help train next-generation AI systems for pharmacovigilance. This contractor role is fully remote and focuses on high-quality evaluation of DSURs, PSURs/PBRERs, aggregate safety data, and...Remote jobHourly payFor contractors$80 - $100 per hour
...to shape how next-generation AI systems learn and reason. You... ...computational physics tasks, influence model training data, and improve... ...improve AI model training and evaluation. Communicate findings and... ...required to begin contributing expert inputs and evaluations....Remote jobHourly payFor contractors$40 - $100 per hour
...Create, edit, and validate parametric FreeCAD models that form high-quality training data for next-generation AI systems, ensuring geometric accuracy,... ...uses an AI-assisted recruiter to identify and evaluate qualified experts. Selected applicants will be contacted with...Remote jobHourly payFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Generalist Expert for AI Model Evaluation. Be the first to apply!


