Remote AI Product Evaluation & Feedback Specialist

AuraOne

Remote job

AuraOne is seeking a remote, US-eligible contractor for Product management / roadmap / PRD evaluation. You will review model outputs, apply a versioned rubric, and provide structured feedback including severities, rationales, and regression notes. You will compare paired responses to identify the stronger answer and document edge cases for retraining. The role emphasizes clear reasoning, attention to detail, and consistent rubric application, with about 10 hours per week available remotely. #J-18808-Ljbffr AuraOne

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Remote AI Product Evaluation & Feedback Specialist in New York, NY vacancy

Specialist, Multimedia & Generative AI Production
$70k - $85k
...globally. Summary The Specialist is a key member of the... ...and Generative AI methods, this role drives... ...-streaming, on-site production, and event support. The... ...while incorporating feedback and supports multimedia... ...Days In-Office, 2 Days Remote): ~ This position...
Remote work
Live in
Work at office
Visa sponsorship
Work visa
Monday to Friday
Flexible hours
Night shift
SHRM
Alexandria, VA
15 hours ago
Video Production Specialist - Freelance AI Trainer Project
$8 - $65 per hour
...Video Production Specialist - Freelance AI Trainer Project United Kingdom Are you a video production... ...improvements to our prompt engineering and evaluation metrics. A bachelor's or master'... ...type: Contract Workplace type: Remote Seniority level: Mid-Senior Level...
Remote work
Hourly pay
Contract work
For contractors
Freelance
Immediate start
Meridial
United States
15 hours ago
Remote Multi-Turn Ranking Evaluator & Feedback Specialist
AuraOne seeks a remote contractor to evaluate multi-turn ranking reward model evaluation prompts and responses. You will compare outputs, assign severity tags, and provide structured feedback to retrain the model using AuraOne's rubric. You will identify hallucinations,...
Remote job
For contractors
AuraOne
New York, NY
5 days ago
Drilling/Production Engineer for AI Evaluation
$85 per hour
...Role Overview Drilling and Production Engineers apply field and production... ...engineering expertise to evaluate AI-generated content and create... ...engagement you can perform remotely alongside other work. Key... .... Provide detailed feedback and annotations that help AI...
Remote work
Hourly pay
Ongoing contract
Full time
Contract work
Part time
Flexible hours
SaidGig
United States
22 days ago
Evaluation Specialist
...Senior Evaluation Specialist This role combines rigorous evaluation with... ...day-to-day guidance, ongoing feedback, and formal performance... ...includes both hybrid and fully remote roles, depending on... ...effective collaboration and productivity Shared responsibility for...
Remote work
Local area
Flexible hours
Louisiana Public Health Institute
New Orleans, LA
2 days ago
AI Design Evaluator & UX Specialist - Remote
...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability... ...research, providing essential feedback on design. Applicants should have...
Remote work
Work from home
Flexible hours
Prolific
Tucson, AZ
1 day ago
Arabic MCQA Specialist for AI Evaluation — Remote
$24 - $30 per hour
Mercor is seeking a Moonlight MCQA - Arabic Generalist to draft Arabic MCQs for an AI evaluation dataset. This contract role offers remote work with flexible hours and a process including AI interview based on your resume. Must hold a master's or PhD, 2-6 years of experience...
Remote job
Hourly pay
Contract work
Freelance
Flexible hours
United States Digital Space LLC
New York, NY
3 days ago
Ardour Specialist for AI Training & Feedback (Remote)
A flexible AI research platform is looking for experienced Ardour users to evaluate AI-generated audio content. As an independent contractor, you can work remotely on an ongoing basis. Ideal candidates have at least 3 years of experience using Ardour and strong audio engineering...
Remote job
For contractors
Flexible hours
Handshake
New York, NY
4 days ago
Specialist, Multimedia & Generative AI Production
$70k - $85k
...per year Position Summary: The Specialist is a key member of the SHRM... ...communications, marketing, and product launches. Responsibilities Multimedia... ...programs. Generative AI Integration - Use Generative... ...office, with Monday and Friday remote. Employees must be available during...
Remote work
Work at office
Monday to Friday
Utah SHRM
Alexandria, VA
1 day ago
Specialist Software Engineer
...To support innovative AI projects, the part-time remote Software Engineering Evaluation Specialist will design coding tasks for AI agents... ...on task design based on feedback from expert QA reviewers and... ...qualifications 3+ years of production software development experience...
Remote work
Part time
Virtual Vocations Inc
United States
1 day ago
AI Engineer, Product
$171k - $240k
...spend effortlessly. Brex’s AI-native automation and... ...financial data with product and platform infrastructure... ...of record, to the feedback loops that make the agent... ...weeks per year of fully remote work!... ...Stand up feedback and evaluation loops that let us quickly...
Remote work
Full time
Work at office
Work from home
Brex Inc.
San Francisco, CA
15 hours ago
AI Evaluation Expert - Math & Stats Specialist (Remote)
...Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply... ...meaningful errors within their field. Flexible, remote contract work starting ASAP. You will work on challenging...
Remote job
Contract work
Immediate start
Flexible hours
BAM Ventures
New York, NY
1 day ago
Remote Technical Product Manager
$180k - $200k
...experienced Technical Product Manager to join our fast... ...conditions and customer feedback. Leverage your... ...with engineering teams to evaluate technical feasibility and... ...objectives. Scope and evaluate AI-powered capabilities... ...Comfortable working remotely One team, one dream About...
Remote work
Work from home
GrabJobs
Durham, NC
2 days ago
Remote AI Product Manager — Financial Modeling & Evaluation
A technology company is seeking an experienced Product Manager to help train AI models. You will evaluate chatbots’ performance and implement improvements. Candidates... ...degrees. This role offers the flexibility of remote work and hourly pay ranging from $50-$60, with bonuses...
Remote job
Hourly pay
DataAnnotation
New York, NY
3 days ago
Remote Classroom Scenario AI Evaluator - Quality Feedback
AuraOne is seeking a remote Classroom Scenario AI Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model. This contractor role requires prior evaluation...
Remote job
Hourly pay
For contractors
10 hours per week
AuraOne
New York, NY
5 days ago
Cybersecurity Specialist - AI Systems
$1,750 - $2,150 per month
...and technical talent with leading AI research labs. Headquartered in... ...task Location: Remote Role Responsibilities Review and evaluate AI-generated outputs related to... ...triage . Provide structured feedback on AI accuracy in areas such as...
Remote work
Hourly pay
Full time
Contract work
Summer work
Mercor
Remote
15 hours ago
ParaView Specialist for AI Content Evaluation
$125 per hour
...Role Overview ParaView Specialists apply hands-on experience with... ...and large dataset analysis to evaluate AI-generated outputs and guide... ...structured, domain-specific feedback that helps improve AI performance... ...working asynchronously with remote research teams and providing...
Remote work
Hourly pay
Full time
Contract work
Part time
For contractors
Flexible hours
SaidGig
United States
2 days ago
Remote AI Trainer & Evaluator: Data Quality & Feedback
YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will train AI systems by evaluating outputs, annotating data, and providing actionable feedback to improve model performance. You’ll work with client teams to apply rubrics across diverse...
Remote job
Contract work
YO IT Consulting
Atlanta, GA
2 days ago
Sr. Associate, Product Management - Applied AI Platforms
$66.1k - $114.02k
Sr. Associate, Product Management - Applied AI PlatformsSkip to main contentWe use cookies... ...500 Dallas St: USA IL Remote: USA MN Minneapolis: USA... ...dependency management, structured feedback, and blocker resolution.•... ...Code, and related tools. Evaluate new features, models, and...
Remote work
Work at office
Local area
Worldwide
Baker Tilly International
Houston, TX
3 days ago
Senior Product Manager (Developer Platform)
...re looking for a Senior Product Manager to lead key... ...Front's API, MCP, and AI connectivity strategy —... ...discovery, data, and hands-on feedback loops with the... ...execution, and you can evaluate where AI meaningfully improves... ...posted as a fully remote roleMental health support...
Remote work
Work at office
Immediate start
Work from home
Monday to Friday
FrontApp
San Francisco, CA
15 hours ago
Senior Product Designer for AI Evaluation
$70 - $80 per hour
...Role Overview Design evaluation tasks and senior-level scenarios that test AI systems used for rapid prototyping, product design, and human-AI collaborative coding. Work across two... ...encouraged to apply. Work Terms Location: Remote. Employment type: hourly....
Remote work
Hourly pay
SaidGig
United States
12 days ago
Audacity Specialist - AI Trainer
...Audacity users to support AI research through... ...editing, podcast production, or voice‑over recording to evaluate AI‑generated content and provide feedback that helps AI... ...Audio Post‑Production Specialist Podcast Producer... ...) Location: Fully remote; work from anywhere...
Remote work
Hourly pay
Full time
Contract work
For contractors
Freelance
Flexible hours
Handshake
New York, NY
5 days ago
Product Manager for AI System Evaluation
$80 - $90 per hour
...Role Overview Design and author realistic enterprise product evaluation tasks used to assess AI systems in Fortune 500 level product contexts. You will... ...documentation is a plus. Work Terms Location: Remote. Engagement type: Hourly independent contributor arrangement...
Remote work
Hourly pay
SaidGig
United States
7 days ago
Sourcing Specialist - New Product Sourcing
$87.87k - $163.12k
...comprehensive portfolio of systems and products. From advanced data... ...innovative software enabling remote collaboration, Waygate Technologies... ...with the bestAs a Sourcing Specialist - NPI, you are supporting... ...Supporting supplier identification, evaluation, and onboarding aligned with...
Remote work
Full time
Contract work
Work at office
Flexible hours
Baker Hughes
Skaneateles, NY
2 days ago
Analytical Evaluator - AI Feedback - AI Trainer
$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...outputs . Provide structured written feedback to improve training data quality...
Remote work
Contract work
Summer work
Mercor
Philadelphia, PA
5 days ago
Technical Product Manager of Artificial Intelligence (AI) Systems, Work From Home
...Description Technical Product Manager of Artificial Intelligence (AI) Systems, Work From Home... ...on system design, evaluation, and trade-offs-defining... ...This position is 100% Remote. Technical Product... ...experiments, and human feedback. - Drive execution with...
Remote work
Work from home
Next Step Systems
San Francisco, CA
a month ago
Product Engineer / Design Evaluation
$87.19k - $119.91k
...factories to augmented reality and remote healthcare.ADI fosters a... ...ADI combines analog, digital, AI, and software technologies into... ...more at and on LinkedIn and X.Product EngineerAnalog Devices Inc. is... ...new graduate as Product (Design Evaluation) Engineer to join our industry...
Remote work
Permanent employment
Full time
Work at office
Analog Devices
Wilmington, MA
4 days ago
Senior Software Engineer, Simulation Evaluation
$129.4k - $198.4k
...the Organization:The Evaluation team builds and evolves... ...level results into clear feedback, and help accelerate... ...practices. Leverage AI-assisted development tools... ...platforms to enhance productivity, improve code quality,... ...organizations in a remote or distributed environment...
Remote work
Full time
Local area
Work from home
Flexible hours
General Motors
Sunnyvale, CA
15 hours ago
Senior Specialist: IT Learning and Development
$115k - $152k
....C. office as a Senior Specialist: IT Learning and Development... ...and embed responsible AI practices into everyday... ..., and stakeholder feedback to identify learning gaps... ...delivering remote and hybrid learning via... ...learner's journey the way a product designer thinks about the...
Remote work
Contract work
Work experience placement
Work at office
Mayer Brown
Washington DC
15 hours ago
Evaluation Specialist
...AuraOne is seeking a Lingala Bilingual Expert for a remote evaluation track. You will review prompts and responses against a quality rubric, label edge cases, and provide structured feedback for retraining the model. This is a contractor role requiring reliable async...
Remote work
For contractors
AuraOne
New York, NY
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Product Evaluation & Feedback Specialist. Be the first to apply!