Linguist for AI Model Evaluation [Remote]
$40 - $50 per hourSaidGig
- Remote job
Apply your linguistics expertise to evaluate large language model outputs and help train next-generation AI systems. You will analyze model-human conversations for linguistic precision, assess adherence to instructions, and deliver clear, actionable feedback that guides model improvement.
Key Responsibilities- Carefully review and analyze conversations between humans and large language models for accuracy, clarity, and completeness.
- Assess LLM responses against defined instruction-following guidelines and rubrics.
- Provide detailed, constructive written feedback and, when requested, verbal insights about model output quality.
- Identify subtle errors and inconsistencies in grammar, usage, and context to ensure linguistic precision.
- Deliver concise, actionable recommendations that emphasize accuracy over creativity.
- Document findings and suggested improvements in clear, organized reports.
- Collaborate with project coordinators to clarify guidelines and resolve ambiguities in evaluation tasks.
- Required skills: linguistics analysis, grammar and usage evaluation, strong written communication, attention to detail, and experience with guideline-based evaluation.
- Native proficiency in U.S. English is required for this engagement.
- Advanced academic training or extensive professional experience in linguistics, language analysis, or a closely related field is preferred.
- Proven ability to produce nuanced linguistic assessments and clear written reports.
- Ability to provide professional written and verbal feedback in English.
- Experience with rubric- or guideline-based evaluation is preferred but not required.
- Availability to begin contributing immediately upon selection.
- Engagement type: Contractor, independent contractor relationship.
- Location: Remote, applicants must be located in the United States or Western Europe.
- Work focuses on language model evaluation tasks; no prior AI experience is required.
- Pay: $40.00 to $50.00 per hour.
- Must be a native U.S. English speaker for this project.
- Must be located in the United States or Western Europe.
- Must be available to start immediately if selected.
$100 per hour
...Role Overview Apply deep domain knowledge to help train and evaluate next-generation AI systems by reviewing, refining, annotating, and validating... ...focuses on ensuring accuracy, clarity, and relevance of model outputs through rubric-based evaluation, prompt refinement,...SuggestedHourly payContract workPart timeFor contractorsRemote work$40 - $65 per hour
...conversations and task scenarios that probe frontier language models, then evaluate and document model behavior so engineering teams can improve... ...strong organizational structure. Preferred experience with AI human data environments such as RLHF, SFT, evaluations,...SuggestedRemote jobHourly payFor contractorsImmediate start$100 per hour
...Role Overview Help train and evaluate next-generation AI by creating and assessing senior-level marketing deliverables used to teach frontier models how to produce professional business documents. You will design realistic marketing tasks, author gold-standard materials...SuggestedRemote jobHourly payFor contractors$100 per hour
...Apply deep financial domain expertise to improve AI-driven financial applications by reviewing, annotating, and refining model outputs and prompts. You will shape how next-... ..., and relevance. Develop, refine, and evaluate prompts related to financial analysis, valuation...SuggestedRemote jobHourly payPart timeFor contractors$20 - $35 per hour
...entry and validation work to help train next-generation AI systems by designing realistic evaluation tasks and curating complex datasets. This remote... ...Engagement type: contractor, remote work. Compensation model is output-based, experts are paid per task that meets...SuggestedRemote jobHourly payFor contractors$80 - $150 per hour
...Role Overview Apply your physics expertise to evaluate and improve scientific reasoning that will train next generation AI systems supporting a customer in the science... ...LaTeX, SymPy, Python, and Jupyter for theoretical modeling and computational validation. Demonstrated...Remote jobHourly payFor contractors$100 per hour
...Role Overview Help train and refine advanced AI systems by applying deep software engineering expertise to evaluate, edit, and produce high‑quality technical content... ...part‑time contractor role focuses on improving how models learn and reason by providing precise, domain‑...Remote jobHourly payContract workPart timeFor contractors$100 - $130 per hour
...expertise to help train next-generation AI systems by creating realistic code examples... ...customer-facing project that shapes how models learn, reason, and perform. No prior AI experience... ...into high-quality training data, evaluations, and feedback for frontier models. Key...Hourly payFor contractorsRemote work$50 - $100 per hour
...Role Overview Design and build realistic Reinforcement Learning environments that train and evaluate AI models on production-grade cloud infrastructure tasks. Your work will create reproducible scenarios that test AI systems on design, deployment, troubleshooting, security...Hourly payFor contractorsRemote work$50 - $150 per hour
...and golden reference solutions that test AI systems on complex software engineering challenges... ...work will help train next-generation models by supplying high-quality, real-world... ...Reinforcement Learning environments that evaluate an AI model''s ability to solve realistic...Hourly payFor contractorsImmediate startRemote work$80 - $100 per hour
...Overview Apply your STEM domain expertise to help train and evaluate next-generation AI systems by demonstrating how AI coding agents solve real,... ...debugging, and producing clear written deliverables that improve model reasoning and problem solving. Key Responsibilities...Hourly payFor contractorsRemote work- ...2017, Wayve is the leading developer of Embodied AI technology. Our advanced AI software and foundation models enable vehicles to perceive, understand, and navigate... ...third-party datasets to enhance pretraining and evaluation Manage and mentor a team of engineers and data...Full timeWork at officeRemote workWork from homeVisa sponsorshipRelocation packageFlexible hours
$45 - $95 per hour
...quality Kiembu language data and linguistic analysis to help train next-generation AI systems. You will transcribe and... ...verbal feedback that improves how models learn and perform. No prior experience... ...across multimedia content. Evaluate and annotate grammar usage,...Remote jobHourly payFor contractors$65 - $98 per hour
...Role Overview Provide bilingual Korean-English linguistic expertise to help train next-generation AI systems. You will evaluate, generate, and localize Korean content,... ...culturally informed feedback that shapes how models learn, reason, and perform. This is a remote...Remote jobHourly payFor contractors$20 - $40 per hour
...that will be used to train next-generation AI systems. This role contributes... ...world legal reasoning, helping improve how models learn and perform. No prior AI experience... ...contributions will be used for training and evaluating AI systems. Materials must be original...Remote jobHourly payContract workFor contractors$80 - $90 per hour
...benchmark answers that help next-generation AI systems learn, reason, and perform. This... ...will contribute authoritative explanations, evaluate chemistry content for scientific accuracy,... ...and produce exemplar responses that guide model behavior. Key Responsibilities...Remote jobHourly payFor contractors$60 - $80 per hour
...deep neuroscience expertise to improve how next-generation AI systems learn and reason. You will review and refine... ...shape realistic, scientifically accurate training data and evaluation materials for AI models. No previous AI experience is required; domain knowledge is...Remote jobHourly payFor contractors$80 - $140 per hour
...Role Overview Help shape how AI systems understand and produce litigation-level legal... ...your courtroom and appellate experience to evaluate, correct, and improve AI-generated legal outputs... ...practice-tested legal judgment and draft model responses that teach systems to reason and...Remote jobHourly payFor contractors$50 - $101 per hour
...expertise to help train next-generation AI systems. In this remote, contractor role... ...and nutrition content that improves how models learn and reason. No prior AI experience... ...general wellness guidance. Create and evaluate sample fitness programs and nutrition plans...Hourly payFor contractorsRemote work$30 - $55 per hour
...dispatch expertise to shape how next-generation AI systems interpret and support emergency... ...formats for use in AI training. Evaluate, critique, and suggest improvements to protocols... ...or automated responses produced by AI models. Collaborate with project coordinators...Remote jobHourly payContract workFor contractors$90 - $120 per hour
...statistical expertise to produce high-quality training data and evaluations that improve how next-generation AI systems learn, reason, and perform. You will create... ...explanations, and benchmark responses that guide model behavior and support interpretability. Key...Remote jobHourly payFor contractors$80 - $130 per hour
...domain input used to train next-generation AI systems. This contractor role is fully... ...actionable content and review for AI training and evaluation. Key Responsibilities Analyze and... ...and technical materials to improve AI model learning and reasoning. Perform...Remote jobHourly payFor contractors$80 - $160 per hour
...expertise to a research-focused project that benchmarks and models quantum optical systems. The work centers on cascaded... ...grade explanations and analyses that can be used to train and evaluate next-generation AI systems, no prior AI experience required....Remote jobHourly payFor contractorsWork at office$80 - $100 per hour
...technical documentation, real-world examples, and evaluations that help train and benchmark next-generation AI systems. You will capture advanced workflows that... ...addressing GIS and geospatial data challenges for AI model development. Document advanced technical...Remote jobHourly payFor contractors$60 - $100 per hour
...in shaping the future of next-generation AI systems. This remote position allows you... ...cybersecurity skills to influence how AI models learn and perform by providing high-quality... ...Act as a senior reviewer, critically evaluating the quality and depth of red-teaming exercises...Remote jobHourly payFor contractors$140 per hour
...matter expertise to improve how next-generation AI systems learn, reason, and perform. As an AI Domain Expert you will evaluate AI outputs, create challenging prompts,... ...feedback that helps train and validate advanced models. This is a remote, part-time contractor role...Remote jobHourly payPart timeFor contractorsVisa sponsorshipWork visaFree visa$70 - $90 per hour
...quality, domain-specific expertise that helps train next-generation AI systems. This remote contractor role supports a leading customer... ...ensure reproducibility and scientific integrity. Critically evaluate experimental outcomes and propose improvements or new...Remote jobHourly payFor contractors$80 - $90 per hour
...answers that train and improve next-generation AI systems. This remote contractor role... ...golden responses" that set standards for model outputs. No prior AI experience is... ...real-world knowledge into training data, evaluations, and feedback loops. Contributions support...Remote jobHourly payFor contractors$140 per hour
...Apply your legal expertise to generate high-quality inputs and evaluations that train next-generation AI systems. This remote contractor role focuses on producing accurate, well-reasoned legal content and structured feedback across a range of US law topics. No prior AI...Remote jobHourly payFor contractors$30 - $55 per hour
...world expertise to training next-generation AI systems. This remote contractor role... ...domain-specific feedback that improves AI model behavior. Prior AI experience is not required... ...to enhance AI model learning and evaluation. Work Terms Role type: Contractor....Remote jobHourly payFor contractorsWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Linguist for AI Model Evaluation [Remote]. Be the first to apply!
- content designer remote Indiana
- remote design intern Indiana
- remote accounts receivable Indiana
- remote b2b sales Indiana
- immediate hire remote Indiana
- remote senior business analyst Indiana
- remote insurance Indiana
- remote customer service chat Indiana
- junior designer remote Indiana
- remote data analyst intern Indiana



