Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Evaluation Specialist (PhD / Researcher / Professor)

Temporary

micro1

Role Title: Research Evaluation Specialist (PhD / Researcher / Professor)

Role Type: Contractor

Location: Remote

micro1 is engaging Research Evaluation Specialists (PhD / Researcher / Professor) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer's project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required, your domain knowledge is what matters.

Scope of Work

  • Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
  • Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
  • Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
  • Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
  • Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
  • Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.

Preferred Qualifications

  • PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, or professor in your domain.
  • Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.
  • Exceptional analytical thinking, close attention to detail, and strong written communication skills in English.
  • Experience sourcing and triangulating information from authoritative references.
  • Proven self-direction and reliability in delivering expert-level work independently within remote engagements.
  • Skill in composing challenging, original, and methodologically sound questions.
  • Experience in AI training or evaluation is advantageous but not required.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24 to 48 hours of completing onboarding.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Research Evaluation Specialist (PhD / Researcher / Professor) in Remote vacancy
  •  ...Research Evaluation Specialist (PhD / Researcher / Professor) is a remote review track for evaluating AI outputs across research evaluation research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results... 
    For phd
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    22 days ago
  •  ...About the role Research Evaluation Specialist (PhD / Researcher / Professor) is a remote review track for evaluating AI outputs across research evaluation research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions,... 
    For phd
    Hourly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    16 days ago
  •  ...support energy and utility projects, the California Licensed Evaluation Researcher will analyze quantitative and qualitative data, contribute to...  ...instruments and conducting qualitative research Master's or PhD in behavioral or social sciences, economics, public policy, or... 
    For phd
    Remote work

    Virtual Vocations Inc

    New York, NY
    3 days ago
  • micro1 is seeking a Member of Technical Staff, Law Research, to lead the development of evaluation frameworks for AI-enabled legal reasoning. You will design...  ...The role requires advanced legal training (JD/LLM/SJD/PhD in Law) and a track record in legal research, with... 
    For phd
    Remote job

    micro1

    New York, NY
    2 days ago
  •  ...Consulting at .Job DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE0122121] for Program Support on a...  ...preferred.Education / Experience Requirements / QualificationsMS/PhD Materials/Chemical Engineering.8-12+ years glass/... 
    For phd
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    1 day ago
  •  ...ProSidian website at DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE0148147] for Program Support on a...  ....Education / Experience Requirements / QualificationsMS/PhD Materials/Chemical Engineering.8-12+ years glass/... 
    For phd
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    1 day ago
  •  ...Each benchmark pairs you with an in-house researcher who owns that harm area, and you get a...  ...labs weekly. Requirements Requirements PhD or Masters in computer science, machine...  ...building and running safety or security evaluations for language models in production, at an... 
    For phd
    Freelance
    Work at office

    Alice

    New York, NY
    3 days ago
  • $40 - $90 per hour

     ...expertise to develop rigorous evaluation material that helps train...  ..., challenging, real-world research tasks across disciplines...  ...Completed PhD, active PhD candidacy, or...  ...research experience as a specialist, researcher, or professor in your field. Demonstrated... 
    For phd
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    a month ago
  •  ...trading firm is building out its post-training research. The mandate is to take large pretrained...  ...for domain-specific tasks Build evaluation that measures what matters, not what is easy...  ...to work in the US PREFERRED: A PhD or Master's in machine learning, computer... 
    For phd
    Full time
    Contract work
    Remote work
    Shift work

    Thurn Partners

    Miami, FL
    3 days ago
  • $80 - $150 per hour

     ...ML Research Expert Position: ML Research Expert Type: Contract Compensation...  ...with leading AI research organizations to evaluate and improve frontier AI systems. We are seeking...  ...a closely related field. Master's or PhD in Machine Learning, Computer Science,... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Synthires

    United States
    1 day ago
  • $65 - $100 per hour

     ...Postdoctoral Researcher – STEM Position: Postdoctoral Researcher...  ...and STEM Research Specialists with advanced expertise in...  ...to advanced AI research and evaluation projects . In this role,...  ...Required Qualifications PhD in a STEM discipline , including... 
    For phd
    Weekly pay
    Contract work
    For contractors
    Remote work

    Synthires

    United States
    3 days ago
  •  ...Role Overview Apply research-grade expertise to help evaluate and improve AI reasoning across technical and humanities disciplines, including STEM, English...  ...standards for AI systems. Qualifications PhD from a reputable university in a technical field, English... 
    For phd
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    12 days ago
  •  ...AI Experiences and HCI & Visualization research groups, you and your mentor(s) will arrive...  ..., ethnographic studies, heuristic evaluations, task analyses, structured interviews and...  ...internallyMinimum QualificationsCurrently enrolled in a PhD program in Computer Science or related... 
    For phd
    Full time
    Internship
    Work at office
    Remote work
    Flexible hours

    Autodesk

    San Francisco, CA
    1 day ago
  • $76.6k - $126.4k

    Posting TitlePost-doctoral Researcher - Statistical Learning and Modeling.LocationCO - Golden...  ...non-linear phenomena. The candidate will evaluate and communicate results through written research...  .... .Basic QualificationsMust be a recent PhD graduate within the last three years.*... 
    For phd
    Full time
    Temporary work
    Fixed term contract
    Local area
    Immediate start
    Remote work
    Relocation

    National Renewable Energy Laboratory

    Golden, CO
    4 days ago
  • $47.84k - $95.68k

     ...#26WD101374 Position Overview As a Research intern at Autodesk Research, you will explore...  ...and human perception, you’ll develop and evaluate methods that interconnect different...  ...Qualifications Currently pursuing a PhD in Computer Science, Machine Learning, Computer... 
    For phd
    Internship
    Work at office
    Remote work
    Flexible hours

    Autodesk

    Remote
    3 days ago
  • $22 - $23.5 per hour

     ...and weight the distribution of various evaluation categories. Ensures that the content...  ...credit hours in the subject being taught. PHD Preferred. Applicants must upload...  ...AI practices. Pay : Visiting Professor pay is based on level, credit hours taught... 
    For phd
    Hourly pay
    Part time
    Local area
    Remote work
    Flexible hours

    DeVry University

    Ontario, CA
    5 days ago
  •  ...unique combination of education, research, and clinical programs that...  ...of Job Duties: The Professor will focus on building a successful...  .... Qualifications: MD, PhD, MD/PhD, or equivalent required...  ...Any criminal history will be evaluated in relationship to job... 
    For phd
    Work at office
    Remote work
    Visa sponsorship
    Shift work

    University of Arkansas System

    United States
    1 day ago
  • $70 - $80 per hour

     ...frontier large language models. Clinical Researchers with STEM PhDs will leverage their...  ...regulatory information. Create detailed evaluation rubrics to assess AI agent performance....  ...extension. Who You Are You hold a PhD from a top institution in the U.S., Canada... 
    For phd
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Remote work
    Flexible hours

    Keystone Recruitment

    United States
    5 days ago
  •  ...Academic Researcher 50 openings $20 - $55/hr Required Skills: Academic research, document...  ...tailored for Fortune 500 standards. Evaluate and synthesize academic literature, legal...  ...healthcare, or related sectors. Master's degree, PhD, or JD from a recognized institution.... 
    For phd
    For contractors
    Remote work

    ESR Healthcare

    Palo Alto, CA
    5 days ago
  •  ...Applied Researcher - All Levels Come, Innovate, Build, Disrupt &...  ...teams, and content processing specialists to develop scalable, high-performance...  ...Design, develop, and evaluate algorithms for spatial data optimization...  ...Master's degree or PhD in Computer Science, Electrical... 
    For phd
    Remote work

    Kesta IT

    United States
    4 days ago
  • $80 - $110 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...Research Collaborator - Professors & PhDs Type: Contract Compensation...  ...robust task execution. Evaluate the target model's...  ...Current or retired professor, or PhD student , in STEM or professional... 
    For phd
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor Inc

    United States
    1 day ago
  • $118k - $309.8k

    Educational Research Scientist Department of Surgery and the Center for Faculty Educators:...  ...studies to advance education scholarship and evaluate the effectiveness of educational...  ...Surgical Education Research Fellows, MA and PhD students. Along with the other education... 
    For phd
    Full time
    Work at office

    University of California, San Francisco

    San Francisco, CA
    1 day ago
  •  ...degree to teach graduate-level Human Resources courses online and on campus. The candidate will use Canvas LMS to facilitate learning, evaluate coursework, and maintain accurate student records. Fluency in English and Spanish is required, with US work authorization.... 
    For phd
    Flexible hours

    UNIR

    Miami, FL
    1 day ago
  •  ...Applications are invited for one postdoctoral researcher position at Florida Gulf Coast University...  .... Postdoctoral applicants must have a PhD by the start of the appointment. The...  ...analysis, and machine learning modeling to evaluate the effects of agricultural nutrient... 
    For phd
    Remote work

    Florida Gulf Coast University

    Fort Myers, FL
    5 days ago
  •  ...Job Profile: Associate Professor Job Summary: The Department...  ...and maintain a successful research program, teach at the...  ...success. Education: PhD in Psychology or related field...  ...note that applicants will be evaluated based upon submitted application... 
    For phd
    Immediate start

    University of Wisconsin

    Madison, WI
    3 days ago
  • $80 per hour

     ...foundational AI lab to find experienced professors and lecturers at accredited universities...  ...record of lecture material design to create, evaluate, and refine AI-generated presentations...  ...Start date: ASAP Qualifications: PhD (or terminal degree) with 4+ years teaching... 
    For phd
    Temporary work
    Immediate start
    Remote work
    Flexible hours

    Ethos

    United Kingdom
    4 days ago
  • $63.5k - $194.8k

    Research Specialist: Kidney Genetics, Genomics, and Advanced Models Laboratory DESCRIPTIONThe Kidney...  ...will report to Gabriel Loeb, MD, PhD, the Principal Investigator of the Kidney...  ...Demonstrated ability to organize, interpret, evaluate, and present research findings in a... 
    For phd

    University of California, San Francisco

    San Francisco, CA
    1 day ago
  •  ...motivated faculty- level Clinical Informatics Researcher to join our dynamic clinical informatics...  ...: Contribute to the development and evaluation of innovative health IT tools and...  ...Successful applicants must hold an MD, PhD, and/or equivalent doctoral level degree... 
    For phd
    Work at office
    Remote work

    Nature Careers

    Memphis, TN
    1 day ago
  • $123.05k

     ...ML Computational Biologist - Postdoctoral Researcher Full-time Organization: Physical...  ...and transfer learning. Train, adapt and evaluate self-supervised and foundation models for...  ...Information section below for details. PhD in Computational Biology, Bioinformatics,... 
    For phd
    Permanent employment
    Full time
    Temporary work
    For contractors
    Flexible hours

    LLNL

    Livermore, CA
    4 days ago
  • $40 - $90 per hour

     ...Role Overview Apply advanced research expertise to help train and evaluate next-generation AI systems by...  ...Qualifications Completed PhD, active PhD candidacy, or equivalent...  ...research experience as a specialist, researcher, or professor in your field. Demonstrated... 
    For phd
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Evaluation Specialist (PhD / Researcher / Professor). Be the first to apply!