Evaluation Specialist/Recent Grad
Remotebridge
Role Title: Evaluation Specialist/Recent Grad Role Type: Contractor Location: Remote Our team is engaging Evaluation Specialists/Recent Grads to contribute to a high-impact project for a customer at the frontier of artificial intelligence. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work Develop original, challenging question-and-answer pairs that test the limits of advanced AI models across diverse subjects. Conduct in-depth research, applying rigorous source triangulation to ensure each answer is accurate, comprehensive, and well-documented. Create multi-step questions that require synthesis and analytical reasoning — not just single-source lookups. Test your questions against AI models, analyze outcomes, and iterate to increase or adjust difficulty as needed. Document your research process, providing clear citations and logical explanations for each answer. Refine content based on reviewer input and maintain alignment with project guidelines and quality standards. Preferred Qualifications Proven ability to conduct thorough, independent research and critically evaluate information from multiple sources. Exceptional attention to detail and written precision in English (fluency required, but it does not need to be your first language). Talent for crafting nuanced and well-structured questions that probe deep understanding. Strong self-direction, reliability, and accountability in remote, independent project work. Interest in cutting-edge AI and a passion for testing the boundaries of current model capabilities. Prior experience in AI training, evaluation, or content creation is a plus, but not required. Open to recent graduates, advanced-degree holders, and individuals from any academic or professional background with demonstrated research and writing expertise. Compensation Structure Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week. Start Timeline & Availability We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding. #J-18808-Ljbffr Remotebridge
$90k - $130k
...listing represents a sample VC Analyst - New Grad role commonly found within the Career... ...Talent Network . It is designed to help recent graduates understand the responsibilities... ...receiving structured exposure to startup evaluation and venture fund operations. This role emphasizes...SuggestedFull timeInternship$90.58k - $114.59k
Position InformationNY HELP: YesAgency: Mental Health, Office ofTitle: Mental Hygiene Program Evaluation Specialist 3 (NY HELPS), Kingsboro Psychiatric Center, P27987Occupational Category: Health Care, Human/Social ServicesSalary Grade: 23Bargaining Unit: PS&T - Professional...SuggestedPermanent employmentFull timeWork at officeRemote work- ...best job outcomes. As a Data Analyst, New Grad, you will turn product, job market, and... ...and business metrics Support A/B tests and evaluate the impact of new features Investigate... ...business stakeholders Qualification Required Recent graduate or graduating soon in Data...SuggestedInternshipRemote work
$80k - $117.5k
Senior Specialist, Technical Evaluation And Proposals A career at Resilience is more than just a job - it's an opportunity to change the future. Resilience is a technology-focused biomanufacturing company that's changing the way medicine is made. We're building a sustainable...SuggestedContract workLocal areaFlexible hours- ...route to the best job outcomes. The New Grad Data Analyst will help product teams make... ...dashboards, and self-service reports Design and evaluate product experiments Investigate changes... ...based on data Qualification Required Recent graduate in Data Science, Statistics, Computer...SuggestedInternshipRemote work
- AuraOne, Inc. is seeking a remote Video Editing Professional contractor to review evaluation prompts and responses against our quality rubric. You will compare paired outputs, assign severity tags, and provide structured feedback for retraining. This role supports the...Remote jobFor contractors
- AuraOne is seeking a Voice Actor: CX Agent Voice Cloning (Indonesian Bahasa - Female) for a remote evaluation track reviewing prompts and responses against our quality rubric. Reviewers label edge cases and provide structured feedback for retraining. You will compare paired...Remote jobFor contractors10 hours per week
$89.59k - $197.46k
...currently seeking a Senior Associate, Credit Specialist to join our Audit practice.... ...documentationQualifications:Minimum two years of current and/or recent credit accounting and risk assessment... ...loss accounting concepts, including evaluation of model validation design and...H1bLocal area$31.25 - $33.65 per hour
...contact this employer to ask for an accommodation or an alternative application process. Research, Epidemiology and Program Evaluation Specialist State Funded Projects Professional New York Salary Range: $31.25 To $33.65 Hourly Position Title: Research, Epidemiology...Hourly payFor contractorsWork at office$86.21k - $141.64k
...motivated individual to join our team as Lead Specialist, General Audit.This role will support... ...and advisory services that identify, evaluate, and report on highly complex business risks... ..., Guardian will make public the most recent bias audit results for such AI tools,...Full timeH1bWork at officeVisa sponsorshipWork visaFlexible hours- ...Analytical Chemistry Specialist - AI Trainer, New Grad (Remote) Join to apply for the Analytical Chemistry Specialist - AI Trainer, New Grad (Remote... ...• Suggest improvements to our prompt engineering and evaluation metrics Qualifications: Required: • PhD in analytical chemistry...Full timeContract workFreelanceH1bRemote workWorldwide
- AuraOne is seeking a remote evaluation contractor to assess Korean generalist outputs against a quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to aid retraining of the model. Ideal candidates have prior evaluation or...Remote jobFor contractors10 hours per week
$230k - $270k
...misused. As a Safeguards Enforcement Analyst focused on Safety Evaluations, you'll play a central role in ensuring our models meet safety... ...way to understand our research directions is to read our recent research. This research continues many of the directions our team...Work at officeVisa sponsorshipFlexible hoursShift work- AI Trainer Jobs is seeking an Albanian Bilingual Expert to remotely evaluate prompts and responses against AuraOne's quality rubric. Reviewers label edge cases, compare outputs, and write structured feedback to aid model retraining. You will work as a contractor, reviewing...Remote jobFor contractors
- United Pharma seeks a detail-oriented Quality Control (QC) Sample Evaluation Associate to support evaluation and investigation of returned product samples tied to customer complaints. You will perform hands-on laboratory evaluations, functional testing, and visual examinations...
- The CDC Foundation is seeking a Research, Epidemiology and Program Evaluation Specialist to support the New York State Department of Health. The role focuses on epidemiologic analyses, data management and program evaluation related to STI surveillance and the Ending the...
- AuraOne is seeking a Kannada Audio Recording Expert on a remote contractor basis to evaluate audio annotation model outputs against a rubric and provide structured feedback. You will compare responses, label issues, and help identify edge cases for retraining. The role...For contractorsRemote work10 hours per week
$11 - $19 per hour
AI Trainer Jobs is seeking a Music Production Expert - Bengali for a remote evaluation track to review Bengali prompts and responses against AuraOne's rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining the model....Remote jobHourly payFor contractorsFlexible hours- ...compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. Ideal candidates have prior evaluation or annotation experience in music production English, strong attention to detail, and the ability to work asynchronously for at least...Remote jobFor contractors10 hours per week
- AuraOne is seeking an English voice recording evaluation reviewer for a remote contractor role. You will assess model outputs, apply rubrics, and provide structured feedback to help retrain the system. The work requires careful labeling of errors and regular calibration...Remote jobFor contractors10 hours per week
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Key Responsibilities Compare AI-generated...Hourly payImmediate startFlexible hours
- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...Remote jobContract workImmediate startFlexible hours
- YO AI Labs seeks a former U.S. Consular Officer or Passport Specialist to evaluate AI-generated guidance on passport and citizenship matters. This remote, contractor role asks for 20-30 hours per week and leverages your State Department experience to ensure accuracy and...Remote jobFor contractors
- micro1 is seeking a Secretary & Admin Assistant contractor to support a customer project focused on evaluating tasks for an AI benchmark. You will coordinate schedules, manage correspondence, and handle records while contributing to high-quality inputs that train AI systems...Remote jobFor contractors
- AuraOne is seeking a detail-oriented contractor to review Australian voice actor evaluation prompts and responses against our quality rubric. You will label edge cases, assign severities, and provide structured feedback to help retrain the model. This remote, US-eligible...Remote jobFor contractors10 hours per weekFlexible hours
- ...future team member for the role of Senior Specialist to join our Credit Management team in... ...Analyze complex entities and structures to evaluate the business justification for... ...Newsroom & BNY LinkedIn Here’s a few of our recent awards:America’s Most Innovative Companies...Full timeWork experience placementWorldwideFlexible hours
- ...seeking a future team member for the role of Specialist Fund operations to join Private Equity... ...and accounting processes.Assist in evaluating GAAP and/or IFRS rules to determine the... ...Newsroom & BNY LinkedIn Here’s a few of our recent awards:America’s Most Innovative...Work experience placementWork at officeFlexible hours
$60 per hour
...in a row, and U.S. News & World Report recently placed nine of its clinical specialties... ...opportunity to join our team as a Lactation Specialist - Per Diem. In this role, the successful... ...projects as applicable.Implements and evaluates quality and performance projects to promote...Hourly payDaily paidFull time$82.77k - $135.98k
...customers? Guardian is seeking an HCM Platform Specialist to serve as a subject matter expert... ...and time management conceptsExperience evaluating business requirements, reviewing system... ...times, Guardian will make public the most recent bias audit results for such AI tools,...Full timeH1bVisa sponsorshipWork visaFlexible hours- ...Summers, and Jack Dorsey. They are hiring a AI Safety Practitioner for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy, and policy compliance across sensitive domains, and collaborating with researchers...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation Specialist/Recent Grad. Be the first to apply!
- sewing specialist New York, NY
- graduation specialist New York, NY
- sem specialist New York, NY
- technology integration specialist New York, NY
- consumer insights specialist New York, NY
- drilling fluids specialist New York, NY
- vulnerability management specialist New York, NY
- evaluation specialist New York, NY
- escalation specialist New York, NY
- outsourcing specialist New York, NY


