Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine learning researcher (PhD): evaluation design and red-teaming

$150 per hour
Temporary

HUMXN

Pay: $150–$250/hr

The work

Design evaluation tasks that distinguish genuine capability from pattern matching; write adversarial and edge-case prompts in your specialism; review model-generated research code, experiments and claimed results; grade reasoning on systems, theory and algorithms problems.

Who it suits

  • PhD in computer science, statistics or a related field with publications in machine learning, NLP, systems or theory.
  • Strong engineering skills; experience training or evaluating large models a plus.

How it works

  • Apply with your CV and the hours you can give. 5 to 20 hours a week suits most people; the work is remote and on your own schedule.
  • We verify your credentials, licence or degree and your identity before any paid work. Every piece of work traces to a named, verified expert.
  • A paid calibration task on the project's own guidelines comes first.
  • You are paid at the rate on this page for every hour of work that passes review. Rates rise with the difficulty of the project and your track record.

HUMXN is a new expert network (launched 2026). Payouts go through Stripe after identity and tax verification. Never pay to apply.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Machine learning researcher (PhD): evaluation design and red-teaming in Remote vacancy
  • AuraOne is seeking a Bilingual Dutch (Belgium) STEM Expert (PhD) to work remotely as a contractor on AI Safety red-teaming. You will craft adversarial prompts, document failures, and pair each jailbreak with the violated rubric clause so the safety team can patch gaps.... 
    For phd
    Remote job
    Hourly pay
    For contractors

    AuraOne

    New York, NY
    4 days ago
  • $47.84k - $95.68k

     ...Position OverviewAs a Research Intern at...  ...our customers in designing and building a better...  ...world. We are a team of researchers,...  ...that range from learning-based design...  ...'ll develop and evaluate agentic workflows...  ...pursuing a PhD in Computer Science, Machine Learning, Computational... 
    For phd
    Internship
    Work at office
    Remote work
    Flexible hours

    Autodesk, Inc

    New York, NY
    4 days ago
  • $208k - $312k

     ...Overview Trajectory Labs is hiring researchers to design evaluations of conceptual reasoning in AI safety...  ...we build safety and alignment evals, red-teaming programs, and RL environments for...  ...merely sounds right. Desirable PhD-level research experience. All of our... 
    For phd
    Hourly pay
    Contract work
    Immediate start
    Remote work
    Flexible hours

    Trajectory Labs

    Remote
    15 days ago
  • $132k - $338.93k

     ...Division, is seeking researchers to advance the...  ...systems, or machine learning systems. You...  ..., empirical evaluation, and technical...  ...multi-disciplinary team; and a strong...  ...Preferred: PhD in Computer Science...  ...secure systems design. Experience...  ...evaluation, or red teaming.... 
    For phd
    Fixed term contract
    Work experience placement
    Remote work
    Visa sponsorship

    RAND

    Remote
    10 days ago
  • $155k - $185k

     ...deepfake detection platform empowers teams and developers alike to...  ...Most Innovative Startup The Red Team Role Reality Defender'...  ...adversaries do. As a Red Team Researcher, you'll get your hands on the...  ...2 weeks of Parental Leave ~ Learning and Development budget ~ Monthly... 
    Suggested
    Full time
    Temporary work
    Work at office
    Local area
    Remote work

    Reality Defender

    Remote
    17 days ago
  •  ...seeking a Member of Technical Staff, Law Research, to lead the development of evaluation frameworks for AI-enabled legal reasoning. You will design benchmarks and collaborate with...  ...requires advanced legal training (JD/LLM/SJD/PhD in Law) and a track record in legal research... 
    For phd
    Remote job

    micro1

    New York, NY
    6 days ago
  • AI Trainer Jobs is seeking a Bilingual Danish STEM Expert (PhD) for remote AI Safety red-team work. You will design adversarial prompts, document failures with reproducible steps, and map each jailbreak to a rubric clause to guide patching efforts. Responsibilities include... 
    For phd
    Remote job
    Hourly pay
    For contractors

    AuraOne

    New York, NY
    4 days ago
  • $142.8k - $274.8k

     ...Less than 25%Profession: Research, Applied, & Data SciencesDiscipline...  ...agent and systems red teamers to join a new red team spanning agent security,...  ...security products; design realistic attack chains across...  ...such as regression evaluations, automated attack suites,... 
    Ongoing contract
    Local area
    Remote work
    3 days per week

    Microsoft

    Redmond, WA
    4 days ago
  • $60 - $90 per hour

     ...talent with leading AI research labs. Headquartered in...  ...Dorsey . Position: LLM Red Team Specialist — Failure...  ...quietly fail. Design challenges by turning...  ...Must-Have ~ MSc or PhD in a STEM field or equivalent...  ..., security, or AI-evaluation roles. ~ Ability to identify... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $60 - $90 per hour

     ...talent with leading AI research labs. Headquartered...  .... Position: Machine Learning Engineer — Model Evaluation & Experimentation...  ...Responsibilities Design tasks by transforming...  ...Must-Have ~ MSc or PhD in machine learning...  ...mercor.com PS: Our team reviews applications... 
    For phd
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $142.8k - $274.8k

     ...ContributorTravel: Less than 25%Profession: Research, Applied, & Data...  ...Researcher to join a new red team spanning adversarial machine learning, model integrity, offensive security...  ...models and the training and evaluation systems around them; design attacks that expose... 
    Ongoing contract
    Local area
    Remote work
    3 days per week

    Microsoft

    Redmond, WA
    4 days ago
  •  ...building out its post-training research. The mandate is to take...  ...-specific tasks Build evaluation that measures what matters...  ...engineering and trading teams STACK: Python: PyTorch...  ...US PREFERRED: A PhD or Master's in machine learning, computer science,... 
    For phd
    Full time
    Contract work
    Remote work
    Shift work

    Thurn Partners

    Miami, FL
    2 days ago
  • $135k - $170k

     ...Principal Researcher - AI/ML Market Intelligence...  ...representing the team in internal and external...  ..., so rapid learning and genuine technical...  ...technology evaluation, or a closely related...  ...a focus on AI and machine learning. ~ Deep...  ...degree (Master's or PhD) in a technical or... 
    For phd
    Hourly pay
    Full time
    Local area
    Remote work
    Shift work

    Fractal

    New York, NY
    5 days ago
  •  ...Applied AI Research Fellowship at EvozyneEvozyne...  ...companies designing de novo...  ...the clinic. Our teams apply AI to develop...  ...models that learn how protein sequence...  ...see your ideas evaluated against real...  ...ExperienceLate-stage PhD student or...  ...with modern machine learning approaches... 
    For phd
    Remote work

    Evozyne

    Chicago, IL
    5 days ago
  • $250k - $350k

     ...real work across teams by accessing the industry...  ...Manager of AI Evaluations, you will lead a...  ...translating emerging AI/ML research into reliable...  ...-on experience designing, building, or...  ...safety testing or red teaming is a plus....  ...across teams. ~ MS/PhD in Computer Science... 
    For phd
    Work at office
    Home office
    Flexible hours

    Glean Work

    San Francisco, CA
    3 days ago
  • $169k - $250k

     ...Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform...  ...join us! We’re hiring a Researcher, AI Evaluations to join AI Insights within...  ...people who are excited to learn and develop their skills. If... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    Remote
    3 days ago
  • $118k - $309.8k

    Educational Research Scientist Department of...  ...education and join a team of health...  ...theory base to the design and conduct of quantitative...  ...related to learning, teaching, learner...  ...education scholarship and evaluate the effectiveness...  ...Fellows, MA and PhD students. Along... 
    For phd
    Full time
    Work at office

    University of California, San Francisco

    San Francisco, CA
    5 days ago
  • Machine Learning Researcher (MSc. or PhD) is a remote review track for evaluating AI outputs across machine learning researcher specialist operations workflows. Reviewers grade...  ...document the right next step so the modeling team can train on it. Why this role matters... 
    For phd
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  • $60 - $120 per hour

     ...Description ML Engineer (MSc. or PhD) (Remote | $60–$120/hr)...  ...is for experienced Machine Learning Engineers to contribute to AI...  ...components, data pipelines, evaluation systems, and numerical methods...  ...Strong professional or research experience in machine learning... 
    For phd
    Remote job
    Part time
    For contractors
    Immediate start
    Worldwide
    Flexible hours

    Synthires

    West Virginia
    16 days ago
  • $306.3k - $349.5k

    Staff Applied Researcher (Remote Eligible) At Capital...  ...industry in using machine learning to create real-time...  ...and engineering teams and continue our industry...  ...development, from design through training, evaluation, validation, and...  ...: ~ PhD in Electrical Engineering... 
    For phd
    Full time
    Part time
    Work at office
    Local area
    Remote work
    Flexible hours

    Capital One

    McLean, VA
    3 days ago
  •  ...Senior / Lead Applied ML Research Scientists (Diffusion...  ...for exceptional machine learning researchers and engineers...  ...ownership of the preference, evaluation, and reward alignment...  ...Evaluation Suites: Design evaluation harnesses...  ...: Early-stage team pace with direct, high... 
    Full time

    Oakwell Hampton Group

    New York, NY
    4 days ago
  • $99.6k - $192.9k

     ...vehicles that are as smart as you are.Ford’s Red Team operates as a highly technical offensive...  ...testing, adversary simulation, security research, or other offensive security disciplines...  ...to technical workflows.Experience designing or integrating autonomous or semi-autonomous... 
    Immediate start
    Relocation

    Ford

    Allen Park, MI
    2 days ago
  • $70k - $85k

     ...is a collective of designers, engineers, and researchers committed to tackling...  ...you’ll be part of the team that is changing the...  ...reviews to gather, evaluate, and synthesize...  ...findings and lessons learned through internal presentations...  .... Required MS or PhD in environmental... 
    For phd
    Contract work
    Local area
    Flexible hours

    LPA, Inc.

    Sacramento, CA
    3 days ago
  • $123.05k

     ...seeking a Postdoctoral Research Staff Member to...  ...(SI), machine learning (ML), and computational...  ...Contribute to the design and implementation...  ...Train, adapt and evaluate self-supervised and...  ...multidisciplinary team environment. Publish...  ...for details. PhD in Computational Biology... 
    For phd
    Permanent employment
    Full time
    Temporary work
    For contractors
    Relocation package
    Flexible hours

    LLNL

    Livermore, CA
    8 days ago
  • $136k - $211.75k

     ...assembling a lean team of scientists and engineers...  ...physiology, help design the human studies...  ...protocolsBuild and evaluate models that relate...  ...field, or an MD/PhD, with substantial applied machine learning experienceDeep knowledge...  ...inside an existing research codebaseEnough... 
    For phd
    Remote work

    Seres Therapeutics

    Cambridge, MA
    3 days ago
  • American Institutes for Research seeks a Principal Researcher to lead CMS Innovation Center evaluations within the Healthcare Innovations team. You will guide complex studies, design evaluation plans, and interact with federal clients to shape policy. The role requires... 
    Remote job

    American Institutes for Research

    Austin, TX
    2 days ago
  • $60 - $90 per hour

     ...talent with leading AI research labs. Headquartered...  .... Position: Machine Learning Engineer — Model Evaluation & Experimentation...  ...Responsibilities Design tasks by turning real...  ...Must-Have ~ MSc or PhD in machine learning...  ...mercor.com PS: Our team reviews applications... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    Abbeville, GA
    22 days ago
  • $180k - $260k

     ...maintained a 92 NPS. Our team of clinicians,...  ...healthcare problems into machine learning models and AI...  ...the intersection of research, product, engineering...  ...build strong baselines, design honest evaluations, run careful error...  ...edgeYou have an MS or PhD in computer science,... 
    For phd
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday

    Sprinter Health

    San Francisco, CA
    4 days ago
  • $142.8k - $193.2k

     ...Optimization Science (P2OS) team builds the machine learning systems that power...  ...estimation models, design analysis workflows...  ...on.This is not a research role. The bias here...  ...pricing — Design, train, evaluate, and deploy end-to-...  ...qualifications- PhD, or Master's degree... 
    For phd
    Flexible hours

    Amazon

    Seattle, WA
    3 days ago
  • $142.8k - $193.2k

     ...Scientist on this team, you will own the Natural...  .... You will also design the science behind...  ...offline and online evaluation methods,...  ...safe data handling.- Research and develop the agent...  ...experiencePreferred qualification - PhD in computer science, machine learning, engineering, or... 
    For phd
    Flexible hours

    Amazon

    Seattle, WA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine learning researcher (PhD): evaluation design and red-teaming. Be the first to apply!