Remote RLHF Evaluation Specialist — Instruction Tuning
AI Trainer Jobs
New York, NY
- Remote job
AuraOne is seeking an experienced remote contractor to evaluate instruction tuning reward model outputs according to a versioned rubric. You will compare paired responses, label edge cases, and write structured feedback for the modeling team to retrain. Responsibilities include labeling hallucinations and unsafe content, capturing ambiguous prompts, and providing calibration through inter-rater discipline. This is a remote, contractor role with hourly compensation to be confirmed after interview. #J-18808-Ljbffr AI Trainer Jobs
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote RLHF Evaluation Specialist — Instruction Tuning in New York, NY vacancy
- ...Instruction Tuning Reward Model Evaluator is a remote evaluation track for reviewing instruction tuning reward model evaluation... ...Preference ranking RLHF Rater calibration Instruction... ...US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR...Remote jobHourly payFor contractors10 hours per week
- ...Instructional Systems Specialist Major duties include but are not limited to: Accomplishes broad... ...conceiving, developing, implementing, and evaluating VCL/PSOC training programs and... ...after training per Agency policy. Remote: This is remote position. Selectees...Remote workPermanent employmentLocal areaWork from homeRelocation packageFlexible hours
US Department of Veterans Affairs
United States4 days ago - ...meetings, workshops, and conferences to exchange information on instructional technology development and integration. You will prepare... ...and training plan to the Competency Lead or other lead evaluators to develop program reviews or Independent Logistics Assessments...Remote workContract work
US Navy
Stafford, VA4 days ago $50 per hour
...Spanish (Mexico) Audio Evaluation Specialist is a remote evaluation track for reviewing spanish generalist evaluation prompts and responses against... ...with a written rationale. Label hallucinations, instruction-following failures, and unsafe content with structured tags...Remote workFor contractors10 hours per weekAI Trainer Jobs
New York, NY5 days ago- ...for every stage of your career! Job Title: Instructional Technology Specialist Agency: Department of Education Job... ...opportunities Create user documentation and resources Evaluate emerging technologies that enhance teaching, learning, and...Remote workShift work
State of Georgia
United States4 days ago - ...conferences to exchange information on instructional technology development and integration.... ...plan to the Competency Lead or other lead evaluators to develop program reviews or... ...station to CONUS and OCONUS and may include remote or isolated sites. You must be able to...Remote workFull timeContract workPart timeInterim roleWork at officeImmediate startRelocation package
U.S. Marine Corps
Stafford, VA2 days ago $70k - $80k
...Job purpose The Program Evaluation Specialist will help lead program impact evaluation efforts... ...incumbent normally receives minimal instruction on day-to-day work and receives general... ...Competitive compensation & benefits Remote work opportunity Timeline...Remote workFull timeCasual workLocal areaFlexible hoursWeekend workAfternoon shiftAmerican Farmland Trust
United States5 days ago- ...DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0080079] for Program Support... ...(Subject to Change or Working Remotely): 2440 Stevens Center Place, H520... ...INFORMATION - See Below Instructions On The Best Way To ApplyProSidian...Remote workFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hours
Prosidian Consultng
Richland, WA1 day ago - ...: CX Agent Voice Cloning (Indonesian Bahasa - Female) for a remote evaluation track reviewing prompts and responses against our quality rubric... ...the stronger answer with rationale, and tag hallucinations, instruction-following failures, and unsafe content. This independent...Remote jobFor contractors10 hours per week
$121.79k - $158.32k
...Design, Develop, Implement, and Evaluate (ADDIE) model and ISD... ...cradle-to-grave life cycle of instructional products and programs. Advise... ...58322/yr. Is this position remote or telework eligible? This position... ...INSTRUCTIONAL SYSTEMS SPECIALIST, INSTRUCTIONAL SYSTEMS...Remote work- Prolific Academic Ltd seeks a remote Punjabi evaluator for refining AI language outputs. This role is based in the United States and involves... ...onboarding before paid work. Fluency in Punjabi and comfortable English instructions are required. #J-18808-Ljbffr prolificacademicltdRemote jobWork from home
$70k - $140k
...Program Evaluation Specialist - Department of State The Position: We are seeking driven, thoughtful candidates with experience in program... ..., including paid vacation and sick leave, flexible and remote work opportunities, and tuition and training reimbursement....Remote workFull timeWork at officeWork from homeFlexible hoursNight shiftCenseo Consulting Group
Washington DC3 days ago$108k - $135k
...institute and foundation, we tune in, step up, and are a force... ...management.Maintain reporting instructions, reporting documentation, and... ...designation (in-office, hybrid, remote) and operational needs.... ...Partner should be contacted to evaluate the accommodation request.What...Remote workFull timeContract workWork at officeWorldwideTransamerica
Denver, CO3 days ago- ...Working 100% remotely, the full-time Instructional Systems Specialist will design and develop effective instructional programs and training materials for military and civilian students while ensuring quality assurance throughout the instructional analysis process. Key...Remote workFull time
Virtual Vocations Inc
United States4 days ago $110k - $120k
...Instructional Systems Specialist Job Locations US-Remote Worker Category Active Full Time Regular Clearance Required Secret Overview Millennium is proud to be part of the Markon enterprise, a network of specialized organizations united in support of...Remote workFull timeLocal areaMillennium
New York, NY1 day ago- ...consulting firm in Colby, Kansas, is seeking a Nurse Practitioner or Physician Assistant to conduct examinations for veteran compensation evaluations. Responsibilities include conducting assessments, reviewing medical histories, and completing reports, all while collaborating...Remote jobWork from homeFlexible hours
- ...leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring about 35 hours per week and close collaboration...Remote workFull time
- Millennium is seeking an Instructional Systems Specialist to work 100% REMOTE. The candidate must have an active secret clearance. You will lead and design instructional programs, develop training literature, and collaborate with SMEs to deliver effective learning to military...Remote job
- micro1 is seeking Humanities Evaluation Specialists to support an AI training project. Remote contractors will craft challenging humanities questions, verify sources, and design prompts that demand deep interpretation and analytical reasoning. The role involves evaluating...Remote jobFor contractors
- AuraOne is seeking an OCR and Document Understanding Model Evaluator for a remote evaluation track. Reviewers assess document annotation prompts and responses against a quality rubric, labeling edge cases and providing structured feedback for retraining. You will compare...Remote jobFor contractors
- AuraOne is seeking a Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses. You will compare outputs, label edge cases, and create structured feedback for retraining the model. As an independent contractor, you will review tasks with...Remote jobFor contractors
- YO AI Labs is seeking a Humanities Evaluation Specialist to support AI training through rigorous research, critical analysis, and well-documented reasoning. This is a contractor role with fully remote work, offering the flexibility to contribute to high-stakes evaluation...Remote workFor contractors
- YO AI Labs seeks a Humanities Evaluation Specialist to support an AI training project entirely remotely. You will create challenging humanities questions and high-quality answers, and research using authoritative sources with proper citations. Design prompts that require...Remote job
- micro1 is seeking Humanities Evaluation Specialists to support an AI training project requiring research, critical analysis, question development... ..., and evaluation. No prior AI experience is required. As a remote contractor, you will create challenging humanities questions...Remote jobFor contractors
- Humanities Evaluation Specialist role for a remote contractor project. The specialist will create rigorous humanities questions, verify sources, and craft prompts that require deep interpretation and analytical reasoning. You will evaluate AI-generated responses for accuracy...Remote jobContract workFor contractors
- AuraOne is seeking a French Audio Recording Expert (Canada) for remote evaluation. You will review prompts and responses, compare outputs, and label issues using a versioned rubric to aid retraining. This role focuses on assessing pronunciation, voice quality, and conversation...Remote job
- AI Trainer Jobs seeks a Music Production Expert - English to remotely review prompts and responses against AuraOne's rubric. You will... ...feedback to help retrain the model. Ideal candidates have prior evaluation or annotation experience in music production English, strong...Remote jobFor contractors10 hours per week
- AI Trainer Jobs is seeking a Hindi Audio Recording Expert for a remote evaluation track. You will review Hindi prompts and responses against AuraOne's rubric, compare paired outputs, label edge cases, and provide structured feedback to retrain models. You will help turn...Remote job10 hours per week
$20 - $40 per hour
AI Trainer Jobs seeks remote Swift Evaluators to review swift evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for retraining to improve model quality. This remote contractor...Remote jobHourly payFor contractors- AuraOne is seeking a Spanish Audio Recording Expert (Spain) for a remote contractor role. You will review Spanish prompts and responses,... ...US eligibility considerations. The role emphasizes meticulous evaluation, consistent rubric application, and the ability to name issues...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote RLHF Evaluation Specialist — Instruction Tuning. Be the first to apply!
Related searches
- senior safety specialist New York, NY
- reentry specialist New York, NY
- grocery specialist New York, NY
- localization specialist New York, NY
- agency management specialist New York, NY
- restaurant specialist New York, NY
- outreach specialist New York, NY
- renovation specialist New York, NY
- generation specialist New York, NY
- senior program specialist New York, NY