Remote AI Evaluation Fellow - Engineering & Rubrics Expert
Crossing Hurdles
A leading education initiative is seeking candidates for the Rubric Academy Fellowship, a remote opportunity that involves completing a self-paced Academy focused on AI evaluation principles. Ideal candidates will possess strong analytical skills and deep subject-matter expertise, enabling them to work independently and engage thoughtfully with evaluation frameworks. This fellowship is a unique one-time paid opportunity designed for those interested in the evolving field of artificial intelligence. #J-18808-Ljbffr
$150 per hour
...Mercor is seeking Psychiatry experts to design clinical scenarios and evaluate AI model outputs based on high-quality... ...healthcare reasoning data. This is a remote role that allows flexibility,... ...final-year residents, and certified fellows. Asynchronous work and onboarding...Remote workHourly pay$70 - $100 per hour
...OverviewJoin a leading AI lab's cutting-edge... ...-level subject-matter experts (SMEs) to contribute to... ...supporting a frontier-model evaluation effort focused on... ...evaluation frameworks and rubrics for assessing... ...Computer Science, Electrical Engineering, Mechanical...Remote workHourly payContract workWeekday work$30 per hour
...A leading AI data platform is seeking Advanced Urdu Speakers to participate in training and evaluating AI models. Successful candidates will complete tasks such as analyzing and writing in Urdu and assessing AI performance. This role offers competitive pay of $30 per...Remote workHourly payWork from homeFlexible hours- ...A leading AI research accelerator is seeking an Associate to leverage expertise in internal... .... This role involves designing and evaluating clinical scenarios to enhance AI diagnostics... ...skills. The position is fully remote, requiring a commitment of 20–40 hours per...Remote work
- ...Mercor is looking for investment banking professionals to enhance AI systems related to financial modeling and capital markets. In this project-based role, you will evaluate AI outputs, create banking workflows, and collaborate with research teams to improve AI accuracy...Remote work
- ...Mercor is seeking experienced investment banking professionals to enhance AI systems in Hackensack, NJ. The role involves evaluating AI-generated financial models and providing insights based on investment banking workflows. Ideal candidates will have over 3 years...Remote work
- ...seeking experienced investment banking professionals to enhance AI systems in financial modeling and deal execution. This project-based... ...leverage your expertise in M&A advisory and capital markets to evaluate AI performance in investment banking tasks. The ideal...Remote work
- ...investment banking professionals in Richmond, California, to enhance AI systems focusing on financial modeling, deal execution, and... ...advisory, ECM, or DCM are preferred. Responsibilities include evaluating AI outputs, creating realistic investment scenarios, and...Remote workHourly pay
- ...seeking investment banking professionals to engage in a project-based role focused on improving AI systems in financial modeling and capital markets. The position requires evaluating AI outputs, creating investment banking scenarios, and providing feedback on AI accuracy....Remote workHourly pay
- ...Mercor is seeking investment banking professionals to enhance AI systems' reasoning around financial modeling, deal execution, and valuation. The role involves evaluating AI-generated outputs and providing feedback to improve task performance. Ideal candidates will...Remote work
- ...Mercor is seeking experienced investment banking professionals in Carlsbad, California, to evaluate and enhance AI systems in financial modeling and capital markets. Candidates will review AI outputs, create scenarios based on investment workflows, and collaborate with...Remote workHourly pay
- A data annotation company is seeking an advanced mathematician for a remote role to train AI models. Responsibilities include providing complex mathematical problems to AI chatbots and evaluating model performance for correctness. The ideal candidate should be detail-oriented...Remote work
- ...Mercor is looking for experienced investment banking professionals to enhance AI systems related to financial modeling and deal execution. This role involves evaluating AI outputs and creating scenarios based on investment banking workflows. The ideal candidate will...Remote workHourly pay
- ...seeking experienced investment banking professionals to partner with AI labs. The role involves enhancing AI systems' reasoning related... ...M&A advisory and capital markets. Responsibilities include evaluating AI outputs and creating realistic investment banking scenarios....Remote work
$8 - $65 per hour
Prolific is seeking Mental Health Professionals to assist in training and evaluating AI models. As a Domain Expert participant, you'll complete psychological tasks and enjoy flexible hours and competitive pay ranging from $8-$65/hr. Applicants must have verified professional...Remote jobWork from homeFlexible hours$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote jobHourly payWork from homeFlexible hours$60 per hour
Prolific in Portland, Oregon is seeking Chemistry Experts and Chemical Engineers for its Expert Network. This role involves evaluating AI-generated responses and validating chemical reactions, requiring a strong educational background in Chemistry and related experience...Remote jobHourly payWork from homeFlexible hours- Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants...Remote jobHourly payWork from homeFlexible hours
$40 per hour
A data and AI solutions company is seeking an advanced mathematician to join their team in a remote position. The role involves training AI models by evaluating their logic and solving complex mathematical problems. Candidates should have expertise in various fields like...Remote workHourly payFlexible hours- Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating...Remote jobWork from homeFlexible hours
$30 per hour
...Ltd is looking for Fluent Hindi Speakers to join our Expert Network for AI model training and evaluation. Successful candidates will complete tasks like... ...Hindi, with pay rates reaching up to $30 per hour. This remote position offers flexible hours and the ability to work...Remote jobHourly payWork from homeFlexible hours- Prolific is seeking Chemistry Experts and Chemical Engineers to join their Expert Network. The role involves evaluating AI-generated chemistry to ensure accuracy and safety, as well as reviewing technical documentation. Candidates should hold a BS, MS, or PhD in relevant...Remote jobWork from homeFlexible hours
$30 per hour
Prolific Academic Ltd. is looking for Fluent Hindi Speakers to join its Expert Network. This role involves training and evaluating AI models using real legal expertise. Candidates will complete tasks such as analyzing and writing in Hindi and judging AI performance. Competitive...Remote jobWork from homeFlexible hours$60 per hour
Prolific is looking for Chemistry Experts and Chemical Engineers to join its Expert Network, helping to train AI models using real-world expertise. Responsibilities include evaluating AI-generated chemical information, validating reactions, and auditing technical documentation...Remote jobHourly payWork from homeFlexible hours$60 per hour
Prolific in Seattle, WA is searching for Chemistry Experts and Chemical Engineers to join our Expert Network to train AI models with your expertise. The role involves evaluating AI-generated chemistry, fact-checking chemical reactions, and auditing technical documentation...Remote jobHourly payWork from homeFlexible hours- ...AI Risk & Evaluation Subject Matter Expert General Information Requisition # 968 Locations USA-VA-Arlington Posting Date 05/22/2026... ...Clearance Required - Active Public Trust at time of hire Remote Type Hybrid (must be located in the Washington DC Area...Remote workFull timeLocal area2 days per week1 day per week
$40 per hour
...A technology company specializing in AI is seeking a Physics Expert to evaluate and enhance AI chatbot performance. This remote role involves solving complex physics problems and assessing the functionality of AI models. Ideal candidates should possess a strong understanding...Remote workHourly pay$40 per hour
...A data annotation company is seeking a Physics Expert to improve AI chatbot models by evaluating their performance on complex physics problems. This remote position allows you to work on your own schedule and choose projects, offering competitive hourly pay starting at...Remote workHourly pay$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network to evaluate AI-generated science. This role allows you to work from home with flexible hours and offers a competitive pay rate of up to $60 per hour for reviewing model responses...Remote jobHourly payWork from homeFlexible hours$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Remote jobHourly payWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Fellow - Engineering & Rubrics Expert. Be the first to apply!

