Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Model Evaluator — Computer Science Expert (Remote, Paid)

$60 per hour

prolificacademicltd

New York, NY
  • Remote job

Prolific Academic Ltd is offering paid, project-based tasks that utilize your computer science expertise to train and evaluate AI models. After a brief skills assessment, you can join a participant network and select available assignments, often paying up to $60 per hour. Tasks may include validating technical explanations, reviewing research summaries, and verifying generated code and diagrams. The role supports remote work with flexible hours. #J-18808-Ljbffr prolificacademicltd

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Model Evaluator — Computer Science Expert (Remote, Paid) in New York, NY vacancy
  • $40 per hour

     ...Researching We are running a paid project focused on...  ...intelligence models. This ongoing initiative...  ...You will log into our remote platform to access a queue...  ...specific entities, or evaluate AI-generated responses for...  ...largest pool of vetted human experts for AI. Researchers, AI... 
    Remote job
    Hourly pay
    Contract work
    Freelance

    terac

    United States
    4 days ago
  • $30 per hour

    Prolific Academic Ltd offers remote paid tasks to help improve AI systems by evaluating automated support conversations and reviewing generated content for accuracy and tone. Participants complete a brief skills test before being invited to join. Ideal contributors have... 
    Remote job
    Hourly pay

    prolificacademicltd

    New York, NY
    3 days ago
  • $80 per hour

     ...and technical talent with leading AI research labs. Headquartered in...  ...Compensation: $80/hour Location: Remote Role Responsibilities...  ...AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    13 days ago
  • $143.32k - $273.93k

     ...USAA roles may offer remote or hybrid flexibility...  ...knowledge to build analytical modeling solutions using...  ...modeling, analytics, and computer science tasks. Participates...  ...building and scoring AI/ML models. ~ Proven...  ...competitive. You are paid within the salary range... 
    Remote work
    Full time
    H1b
    Work at office

    USAA

    Remote
    8 days ago
  • AI Trainer Jobs is seeking remote contractors to review Application Users - Photoshop on Windows - Generalist prompts and responses, evaluating them against AuraOne's quality rubric. Reviewers compare paired...  ...feedback to retrain the model. As a reviewer, you will flag... 
    Remote job
    For contractors

    Auraone

    New York, NY
    1 day ago
  • $25 per hour

     ...world’s fastest-growing AI companies, accelerating...  ...be at the forefront of evaluating how LLMs interact with...  ...Work in a fully remote environment. Opportunity...  ...assignment (no medical/paid leave) Duration of...  ...next week] Payment model: $25 per approved task... 
    Remote work
    Contract work
    For contractors
    Freelance

    Turing

    Remote
    8 days ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Compensation: $85/hour Location: Remote Role Responsibilities Use...  ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    4 days ago
  • $50 - $60 per hour

     ...technology firm is seeking an Underwriting Manager to contribute to AI training by utilizing finance expertise. This role offers flexibility, allowing candidates to work part-time or full-time remotely. Key responsibilities include reviewing AI assistant outputs on financial... 
    Remote job
    Hourly pay
    Full time
    Part time

    DataAnnotation

    Sioux Falls, SD
    1 day ago
  • $219k - $351k

     ...business. As models scale past what...  ...context, MoE expert weights spill...  ...product of AI inference, not...  ...Work policy; remote/hybrid option...  ...Bring BS in Computer/Electrical/Electronic...  ...or Computer Science, and 10+...  ...4+ weeks of paid time off a...  ...candidate is evaluated fairly and holistically... 
    Remote work
    Work at office
    Flexible hours

    Samsung Semiconductor

    San Jose, CA
    9 days ago
  • $40 per hour

     ...Apply accurate labels and categorizations to diverse data sets Evaluate AI-generated responses for clarity, safety, and factual accuracy...  ...follow complex guidelines Comfortable working independently on a remote basis Familiarity with evaluating AI outputs or machine... 
    Remote work
    Contract work
    For contractors

    Terac

    San Francisco, CA
    a month ago
  • $50 - $60 per hour

    A technology company specializing in AI and finance is seeking a Wealth Advisor to help train AI models. In this independent contract role, you will measure the effectiveness...  .... This position offers flexibility to work remotely and competitive hourly pay starting at $50-$60... 
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $50 - $60 per hour

    A leading AI solution provider is seeking a Senior Actuary to enhance AI models through rigorous evaluation and financial expertise. This role offers flexible hours, project selection, and competitive pay ranging from $50 to $60 per hour, with bonuses for exceptional work... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Oregon, WI
    2 days ago
  • $20 - $40 per hour

     ...$40/hourpay Role Title: Computer Science Subject Matter Expert (AI Training) Role Type: Contractor Location: Remote We are seeking a Computer...  ...this role, you will analyze, evaluate, and create high-quality...  ...accuracy, and performance of AI models. Prior experience in... 
    Remote work
    For contractors
    Weekday work

    Weekday AI

    New York, NY
    1 day ago
  • $15 - $40 per hour

    Computer Science Expert Python Validation Use Python to validate AI-generated computer science solutions, assess multi-step reasoning...  ...and is open worldwide. 100% Remote Hourly · $15-$40/hr $15-$40/hr...  ...real professional practice and evaluate AI-generated solutions. Your reviews... 
    Remote work
    Hourly pay
    Contract work
    Temporary work
    Part time
    For contractors
    Worldwide
    10 hours per week

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • Role overview A remote opportunity is open for computer science specialists to review and verify AI-generated graphical abstracts of scientific...  ...accurately large language models summarise dense technical...  ...to navigate and critically evaluate dense scientific literature... 
    Remote job
    Work from home
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • Role overview A fully remote opportunity is available for computer science experts to verify AI-generated graphical abstracts of academic...  ...whether large language models produce summaries that are factually...  ...across a queue of assigned evaluation tasks Requirements Master's... 
    Remote job
    Work from home
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • Role overview Computer science researchers are invited to join an AI evaluation project as remote reviewers of machine-generated graphical abstracts. The role centres on comparing...  ...to AI training data work, annotation, or model evaluation Background in scientific... 
    Remote job
    Work from home
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • $60 - $90 per hour

     ...talent with leading AI research labs. Headquartered...  ...Learning Engineer — Model Evaluation & Experimentation...  ...hour Location: Remote Commitment: 35...  ...with researchers and experts to maintain task consistency...  ...machine learning , computer science , or a related STEM... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    9 days ago
  • TELUS Digital seeks data scientists to join its AI community as independent contractors. You will evaluate model performance, diagnose biases, and push AI quality forward from a distributed, remote setup with a global team. Responsibilities include data wrangling for LLM... 
    Remote job
    For contractors

    Island Jobs

    New York, NY
    1 day ago
  • Role overview A fully remote contract role invites computer science specialists to evaluate graphical abstracts produced by large language models for a scientific accuracy project. Reviewers compare AI-generated summaries against the original research papers, judging how... 
    Remote job
    Contract work
    Work from home
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • $200k - $320k

     ...Technical Staff, Model Training (infra...  ...Location : Remote The Role...  ...deploy specialized AI systems efficiently...  ..., reward computation, and simulation...  ...Strong computer science fundamentals, particularly...  ...-scale agent evaluation systems....  ...insurance premiums, paid time off, a 401... 
    Remote work
    Full time
    Local area

    micro1

    United States
    8 days ago
  • Soul Ai is seeking a Biology expert with an MSc to work remotely on data annotation and model refinement for AI using RLHF and SFT techniques. The role offers flexible hours and contributes to advancing AI through rigorous biology expertise. You will annotate biology data... 
    Remote job
    Flexible hours

    Soul Ai

    New York, NY
    4 days ago
  • $15 - $30 per hour

    Crossing Hurdles is seeking a contractor to perform realistic digital tasks using AI assistant tools from a remote location. You will follow standardized workflows, give clear instructions to AI, and verify outputs for accuracy, with a strong emphasis on attention to detail... 
    Remote job
    For contractors
    Flexible hours

    Crossing Hurdles

    New York, NY
    23 hours ago
  •  ...Constitutional AI Reward Model Evaluator is a remote evaluation track for reviewing constitutional ai reward model evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • Role overview Computer science specialists are needed to evaluate AI-generated graphical abstracts against original research...  ...project-based opportunity where expert judgement directly shapes how AI...  ...Benefits and work setup Fully remote with flexible hours and ad hoc project... 
    Remote job
    Flexible hours

    prolificacademicltd

    New York, NY
    3 days ago
  • $40 - $125 per hour

     ...Data Scientist, AI Trainer (Remote, Flexible Hours)1...  ...when you want. Get paid for what you...  ...AI trainers and evaluate how frontier AI models handle real data science work: an analysis...  ...Applied NLP or computer vision with shipped...  ...experience, with expert review and written... 
    Remote work
    Hourly pay
    Full time
    Contract work
    Part time
    Freelance
    Work from home
    10 hours per week
    Flexible hours
    Afternoon shift

    Crucial Recruiting

    Remote
    1 day ago
  •  ...human data platform is recruiting computer science specialists to evaluate AI-generated graphical abstracts...  ...is a flexible, ad hoc, fully remote engagement where expert judgement shapes how AI summarises...  ...produced by a large language model. Compare each abstract against... 
    Remote job
    Hourly pay
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • CNTXT AI is seeking a senior Hindi localization specialist for a fully remote, hourly contractor role. You will apply localization judgment to data annotation, evaluation, and content generation tasks, ensuring tone, terminology, and cultural nuance are accurate across... 
    Remote job
    Hourly pay
    For contractors

    CNTXT AI

    New York, NY
    4 days ago
  • This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible...  ...support AI training datasets. LLM evaluation: reviewing AI-generated responses...  ...writing high-quality prompts and model responses, or recording high-... 
    Remote work
    Hourly pay
    For contractors
    Flexible hours

    CNTXT AI

    New York, NY
    4 days ago
  •  ...Rise Data Labs is a leading AI training and data...  ...to improve machine learning models through expert human annotation and validation...  ...economics, finance, psychology, computer science, business, mathematics,...  ...intelligence. Our flexible, remote-first approach allows experts... 
    Remote work
    Flexible hours

    Rise Data Labs

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Model Evaluator — Computer Science Expert (Remote, Paid). Be the first to apply!