Remote Retrieval Relevance QA Specialist (Contractor)
AuraOne
New York, NY
- Remote job
AuraOne is seeking a Retrieval Relevance Research QA Specialist to remotely evaluate model outputs against a versioned rubric and provide structured feedback. You will compare responses, label issues, and suggest rubric improvements as part of contractor work for AuraOne Human Data. The role emphasizes writing clear rationales, applying rubrics across long batches, and maintaining calibration with gold-standard samples on a weekly cadence. Applicants must be US-based and authorized to work. #J-18808-Ljbffr AuraOne
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote Retrieval Relevance QA Specialist (Contractor) in New York, NY vacancy
- ...Retrieval Relevance Research QA Specialist is a remote evaluation track for reviewing retrieval relevance research qa evaluation prompts and responses against... ...— US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized...For contractorsRemote jobHourly pay10 hours per week
- AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs... ...provide structured feedback for model retraining. This contractor role requires careful reasoning, attention to detail, and...For contractorsRemote job10 hours per week
$81.15k - $137.95k
...ICF is seeking a Construction QA/QC Specialist to assist LA County with... ...plans, scopes of work, and contractor submissions to ensure consistency... ...of education and relevant work experience. 1-3 years of... ...environment. Other Job Details:Remote position with possible occasional...For contractorsRemote workFull timeContract workWork experience placementWork at office$50 per hour
...complex healthcare problems and evaluating AI outputs. Candidates must have healthcare expertise and a degree in a relevant field. This independent contractor position offers flexibility to choose projects and is open only to applicants in the United States, with hourly...For contractorsRemote workHourly payFlexible hoursDataAnnotation
Oklahoma City, OK5 days ago- ...currently searching for a QA Specialist to support our work at the... ...site in Bethesda, MD and/or remote. Position Title: QA Specialist... ...areas, research gaps and relevant program needs and makes recommendations... ...liaison with grantees/contractors, IC staff (e.g., grants...For contractorsRemote workPart time
BCC - LH
Bethesda, MD4 days ago $60k - $65k
...QA/QC Inspection Specialist, Energy Efficiency (Field) Utilities Programs and... ...Services Location: Maryland (Remote - Home Office with Local... ...Interact with contractors and homeowners answering questions... ...including, but not limited to, relevant work experience, skills,...For contractorsRemote workFull timeContract workWork experience placementWork at officeLocal areaHome officeFlexible hoursICF
Remote3 days ago$20 per hour
...interested in a wide range of expertise, so relevant backgrounds include Revenue Cycle... ...Operations. Benefits Full-time or part-time remote position Choose which projects you want... ...considered for this role. This is an independent contractor position. #generalist #J-18808-Ljbffr...For contractorsRemote workHourly payFull timePart timeFlexible hoursDataAnnotation
New York, NY5 days ago- ...Litigation Discovery Document QA Specialist is a remote review track for evaluating AI outputs in litigation... ...or legal-equivalent credential in a relevant jurisdiction. Prior experience... .... Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants...For contractorsRemote workHourly pay10 hours per week
AuraOne Human Data
Remote21 days ago - ...seeking a Copywriting & Content Subject Matter Expert (SME) for a remote contractor role. The ideal candidate will review AI-generated marketing... ...position requires a Bachelor's degree and over 5 years of relevant experience in copywriting or content writing. You will...For contractorsRemote workTemporary work
YO IT Consulting
San Francisco, CA1 day ago - ...AuraOne is seeking a Remote Temporal Action Evaluator contractor to review prompts and model outputs, applying the company's quality rubric to produce auditable feedback. You will compare paired responses, label edge cases, and document recurring failure modes to help...For contractorsRemote work10 hours per week
AuraOne
New York, NY1 day ago - ...AuraOne is seeking a Remote Household Data Specialist - Video Capture (Japan) to review model outputs, label edge cases, and provide structured... ...labeling quality across remote household data tasks. This is a CONTRACTOR, remote US-eligible position with hourly compensation...For contractorsRemote workHourly pay
AuraOne
New York, NY4 days ago $20 per hour
...DataAnnotation role. This opportunity allows flexibility for remote work and project selection. Ideal candidates should be fluent... ...with additional bonuses for high-quality work. This position is for independent contractors based in the United States. #J-18808-LjbffrFor contractorsRemote workHourly paySupportFinity
Lincoln, NE3 days ago- ...Quality Assurance Oversight Specialist [DOE0036035] for... ...requiring multidisciplinary contractor support, compliance... ...6035] candidates with relevant Environmental... ...to Change or Working Remotely): 2440 Stevens Center... ...Candidates:6-10+ years QA; DOE/NQA-1 preferred.Education...For contractorsRemote workFull timeContract workTemporary workFor subcontractorWork at officeFlexible hours
- ...and Quality Assurance Specialist - GSSC (Full-Time [W-2... ...candidates present with relevant Government, Public... ...the nuclear safety and QA war rooms, including but... ...directly with ORP contractors as part of an integrated... ...is approximately 77% remote and will require a two...For contractorsRemote workFull timeFlexible hours
- ...team and contribute to AI model training. In this remote position, you will provide complex healthcare-... ...should have fluency in English and a relevant medical or healthcare-related degree. This independent contractor role offers flexible scheduling and pays hourly...For contractorsRemote workHourly payFlexible hours
DataAnnotation
Providence, RI3 days ago - ...A leading AI training company is seeking remote contractors to help train AI chatbots. Responsibilities include developing prompts, evaluating AI performance, and ensuring high-quality responses. Ideal candidates are analytical small business owners or freelancers who...For contractorsRemote workHourly payFreelanceFlexible hours
DataAnnotation
Helena, MT1 day ago $20 per hour
...Operations. Candidates must have fluency in English and a healthcare-related degree. Flexible work options are available, with hourly pay starting at $20. Only applicants in the United States will be considered for this independent contractor position. #J-18808-LjbffrFor contractorsRemote workHourly payFlexible hoursDataAnnotation
Oregon, WI5 days ago$50 per hour
...include evaluating AI logic and ensuring model responses' accuracy. This position offers flexibility, with the chance to choose projects and a pay rate starting at $50 per hour. Independent contractor status applies, ensuring a dynamic work-life balance. #J-18808-LjbffrFor contractorsRemote workHourly payFlexible hoursDataAnnotation
New York, NY1 day ago$20 per hour
...accuracy, and ensuring medical quality of responses. Interested candidates should have a healthcare-related degree and be fluent in English. This is a flexible independent contractor position with hourly pay starting at $20, open to U.S.-based applicants only. #J-18808-LjbffrFor contractorsRemote workHourly payFlexible hoursDataAnnotation
Helena, MT1 day ago$30 - $34 per hour
...Engineering, Customer Service, Technical Support. Proven QA experience with manual testing, bug tracking, and... ...or media technology platforms. Work Terms Role type: Contractor. Location: Remote. You must be able to use an iOS device for mobile testing...For contractorsRemote workHourly paySaidGig
Canadaa month ago- ...Quality Assurance Specialist Business Consultants at Experience Level 1 are Consultants... ...skills and experience: # A degree relevant to the applicable Service Category and... ...Government infrastructure hosting. The Contractor will consult with Ministry of Education...For contractorsRemote workWork experience placement
Veracity
United States2 days ago - ...Role: QA Specialist Location: North Chicago, IL 60064 Duration: 12 Months Shift... ...Combination Product Hybrid, remote M, F, onsite T, W, R Travel Required... ...liaison and cooperative relationship with Quality areas from Third Party Contractors (TPC)...For contractorsRemote workLocal areaShift work
Akaasa Technologies
Illinois1 day ago $20 per hour
...problems and evaluating responses for accuracy. Candidates should have fluency in English and a degree in healthcare. This independent contractor role offers flexible hours and pay starting at $20 per hour, with bonuses for quality work. Applicants must be located in the...For contractorsRemote workHourly payFlexible hoursDataAnnotation
Raleigh, NC5 days ago- QA/ QC Specialist, NJ Maryland Energy Advisors (MDEA) is a rapidly growing energy management firm... ...work closely with program managers, contractors, field teams, and utility partners to... ...another language. WORK ENVIRONMENT Remote with travel required for project...For contractorsRemote workFor subcontractorWork at office
MD Energy Advisors, LLC
Newark, NJ3 days ago - ...in-person/in-office only; remote positions are not... ...worldwide. Responsibilities The Contractor - Game Quality Assurance Specialist 1 will work on specific projects... ...internal and external QA teams to uphold high... ...Qualifications Bachelor’s Degree in relevant field and 3 years of...For contractorsRemote workWork at officeWorldwide
Aspyr
Austin, TX3 days ago - ...language, annotate data, and generate educational resources to improve alignment with campaign expectations. Work remotely, collaborating as an independent contractor with flexible hours. Applicants must have strong linguistics background, proven data annotation experience,...For contractorsRemote jobFreelanceFlexible hours
- AuraOne seeks a Dutch Audio Evaluation Specialist to remotely review audio annotation prompts and responses against AuraOne's quality rubric. As a contractor, you help turn outputs into auditable labels and regression cases for the modeling team. You will compare paired...For contractorsRemote job10 hours per week
- AuraOne seeks a remote QA Specialist to review visual question answering prompts and model outputs against a quality rubric, labeling edge cases and providing structured feedback. This contractor role supports the evaluation of outputs for auditable labels, rationales,...For contractorsRemote job
- ...International (PSI), a Government Contractor, has an immediate opportunity for a Quality Assurance Specialist position under the... ...location for this position is remote to the Tampa, FL area.... ...Four (4) years of documented relevant experience or an associate degree...For contractorsRemote workFull timeContract workTemporary workWork at officeLocal areaImmediate startFlexible hoursShift work
Planned Systems International
United States3 days ago - ...Resource Partners to vet, annotate, and QA AI data. You will ensure native-level linguistic... ...-free outputs for a specialized project. Contractors will generate educational resources from... ...consultation throughout production. Remote work is available, with compensation per...For contractorsRemote jobHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Retrieval Relevance QA Specialist (Contractor). Be the first to apply!
Related searches
- quality assurance specialist New York, NY
- qa associate New York, NY
- qa specialist New York, NY
- software quality assurance specialist New York, NY
- quality assurance associate New York, NY
- operations coordinator remote New York, NY
- remote appointment scheduler New York, NY
- head of marketing remote New York, NY
- content designer remote New York, NY
- remote coordinator New York, NY