Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote | AI Scenario Quality Review & Technical QA Lead — $95-$125/hour

$95 - $125 per hour

24-MAG

New York, NY
  • Remote job

We are sharing a specialised part-time consulting opportunity for professionals experienced in quality control, technical review, rubric-based evaluation, scenario auditing, structured feedback, and complex workflow assessment.

This role supports current and upcoming remote consulting opportunities focused on structured AI training scenario review, simulated environment auditing, quality assurance, rubric-based scoring, technical content validation, and high-quality project execution. Selected professionals will apply strong analytical judgment and attention to detail to evaluate complex digital scenarios, identify inconsistencies, document issues clearly, and support rigorous quality standards across scenario-based review workflows.

Key Responsibilities

Professionals in this role may contribute to:

Scenario Auditing & Quality Review

  • Review complex simulated environments, personas, digital workspaces, and scenario-based tasks for realism, logic, and completeness
  • Evaluate tasks involving workplace-style tools, files, communications, and multi-step digital workflows
  • Assess whether scenarios are properly structured, internally consistent, technically sound, and appropriately challenging
  • Identify logical gaps, missing context, factual issues, unclear instructions, and broken or unrealistic task design

Rubric-Based Evaluation & Technical QA

  • Apply detailed grading rubrics to score scenario quality consistently and objectively
  • Review task materials for reasoning difficulty, feasibility, prioritization demands, and alignment with evaluation criteria
  • Identify technical flaws such as invalid JSON structures, incomplete metadata, inconsistent field logic, or broken workflow dependencies
  • Support structured quality checks across written content, technical content, and simulated environment materials

Feedback, Documentation & Review Operations

  • Provide clear, constructive, and actionable written feedback to scenario creators
  • Document review outcomes, scores, issue logs, and improvement recommendations in structured review systems
  • Support quality calibration by maintaining consistent standards across multiple scenario types
  • Work with tools such as Airtable, JSON editors, task review platforms, AI systems, and workflow tracking tools

Ideal Profile

Strong candidates may have:

  • 2+ years of professional experience in QA, editing, auditing, technical review, compliance review, peer review, scenario evaluation, or complex content assessment
  • Strong ability to learn and apply detailed grading rubrics with consistency
  • Excellent attention to detail and ability to catch inconsistencies, edge cases, logical gaps, and technical issues
  • Comfort reviewing structured content, simulated workflows, digital environments, and multi-step task designs
  • Ability to provide constructive, specific, and well-organized feedback
  • Strong written communication skills and comfort working in a remote, tool-heavy review environment

Educational Background

  • An undergraduate degree is helpful
  • Backgrounds in communications, English, technical writing, quality assurance, computer science, data analysis, operations, business, law, education, or related fields may be relevant
  • Equivalent practical experience in editing, auditing, QA, technical review, data review, process review, or structured evaluation work is also highly relevant

Nice to Have

  • Experience as a senior editor, QA tester, technical reviewer, compliance auditor, peer reviewer, data analyst, technical PM, process reviewer, or systems-focused professional
  • Familiarity with JSON, Airtable, Jira, Asana, SQL, Python, AI platforms, structured data review, or technical QA workflows
  • Experience reviewing complex written content, technical documentation, simulated workflows, data structures, task specs, or multi-stakeholder processes
  • Strong systems thinking and ability to understand how professional workflows should function logically
  • Comfort working approximately full-time hours during active project periods

Why This Opportunity

  • Apply quality control and analytical review expertise to structured remote project work
  • Contribute to high-quality scenario auditing, rubric-based evaluation, and technical QA workflows
  • Work on assignments aligned with your review, editing, QA, or systems-thinking background
  • Use your judgment in a focused, detail-oriented review environment
  • Remote structure with competitive hourly compensation

Contract Details

  • Independent contractor role
  • Fully remote with flexible scheduling
  • Extended weekly commitment may be available depending on project needs
  • Competitive rates between $95–$125 per hour depending on expertise
  • Weekly payments via Stripe or Wise
  • Projects may be extended, shortened, or adjusted depending on scope and performance
  • Work will not involve access to confidential or proprietary information from any employer, client, or institution

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: .

Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Remote | AI Scenario Quality Review & Technical QA Lead — $95-$125/hour in New York, NY vacancy
  • $85 - $125 per hour

     ...About the job Remote | Frontend...  ...Expert - $85-$125/hour We are...  ...workflow review. This role...  ...performance analysis, technical documentation, and high-quality project...  ...realistic technical scenarios, evaluate...  ...or frontend QA materials...  ...developer tools, AI systems, or... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    4 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals in Seattle to engage in reviewing and evaluating AI-generated scientific models. Candidates will work with flexible hours and competitive pay of up to $60 per hour. Applicants must have a relevant advanced... 
    Remote job
    Quality
    Hourly pay
    Flexible hours

    Prolific

    Seattle, WA
    1 day ago
  • $95 - $125 per hour

     ...current and upcoming remote consulting...  ...workflow review, business strategy...  ...transformation, and high-quality project...  ...realistic business scenarios, evaluate...  ...with competitive hourly compensation...  ...rates between $95–$125 per hour depending...  ...across technical, evaluation, and... 
    Remote job
    Quality
    Hourly pay
    Weekly pay
    Job sharing
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG

    New York, NY
    20 days ago
  • $70k - $80k

     ...developer to lead this transition...  ...of our technical infrastructure...  ...processes and code quality standards...  ...technical debt Review and...  ...Month 5-6 Build AI automation system...  ...We Work Fully remote - work from anywhere...  ...- no fixed hours, overlap as...  ...architecture scenarios Offer - Start... 
    Remote work
    Quality
    Local area

    Breakout Tools

    Pasadena, TX
    4 days ago
  • A leading AI training company in the United States is seeking an RCM Operations Manager...  ...providing diverse healthcare-related scenarios. It offers flexible scheduling and hourly payments starting at $20, along with bonuses for quality work. Applicants must be located in... 
    Remote job
    Quality
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Kansas City, MO
    6 hours ago
  •  ...an RCM Operations Manager to enhance AI chatbots' performance in healthcare scenarios. Applicants should possess a medical or...  ...schedule and project choice, offering hourly pay starting at $20+ and bonus opportunities based on quality. Applicants must be in the United States... 
    Remote job
    Quality
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $70 - $95 per hour

     ...generation SOC automation and AI‑driven investigation...  ...investigative judgment to review, validate, and construct high‑quality security investigations...  ...outputs based on predefined scenarios and criteria....  ...Collaborate with program leads and other expert annotators... 
    Remote job
    Quality
    Hourly pay

    Mercor

    Providence, RI
    4 days ago
  • $183.8k - $263.6k

     ...and is open to remote applicants residing...  ...Integrity Technical Lead to help us develop...  ...-volume, high-quality release,...  ...ASICs, including reviews of intricate IC...  ...organizations in the AI era - and...  ...at rate of 4.92 hours per pay period...  ...may pay 0% up to 125% of target. Cisco... 
    Remote job
    Quality
    Full time
    Temporary work
    Local area
    Flexible hours

    Cisco Systems, Inc.

    Dallas, TX
    4 days ago
  • $55 - $70 per hour

     ...About the job Remote | Image Data Quality Review Specialist - $55-$70/hour We are sharing a specialised...  ...validation, annotation QA, rubric-based evaluation...  ...Experience with AI data annotation, model evaluation...  ...opportunities across technical, evaluation, and project... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    2 days ago
  • $90 - $125 per hour

     ...About the job Remote | Product Design...  ...Consultant - $90-$125/hour We are...  ...accessibility review, and structured...  ..., and high-quality project execution...  ...realistic design scenarios, evaluate...  ...notes, and design QA materials...  ...opportunities across technical, evaluation, and... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    2 days ago
  • $65 - $95 per hour

     ...About the job Remote | Marketing Strategy...  ...Campaign Expert - $65-$95/hour We are...  ...marketing workflow review. This role...  ...analytics, and high-quality project execution....  ...realistic marketing scenarios, evaluate campaign...  ...opportunities across technical, evaluation, and... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    4 days ago
  • $85 - $125 per hour

     ...About the job Remote | IT Systems Management Expert - $85-$125/hour We are sharing...  ...oversight, technical operations, and structured...  ...IT environment review. This role supports...  ..., and high-quality project execution....  ...realistic technology scenarios, evaluate systems-... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    4 days ago
  • $95 - $135 per hour

     ...About the job Remote | ML Model Development...  ...MLOps Expert - $95-$135/hour We are...  ..., and structured AI workflow review. This role supports...  ...documentation, technical task development, and high-quality project execution...  ...realistic ML scenarios, evaluate technical... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    4 days ago
  •  ...17, 2025 Software QA Tech Lead (1445332) Meet the...  ...analytical acumen. As a technical lead, you have a...  ...for delivering quality and innovation....  ...organizations in the AI era - and beyond....  ...at a rate of 4.92 hours per pay period....  ...Cisco may pay up to 125% of target. Cisco... 
    Quality
    Full time
    Temporary work
    Local area
    Flexible hours

    lwtsquad

    Raleigh, NC
    4 days ago
  • $95 - $135 per hour

     ...and cross‐platform technical workflows. This role...  ...and upcoming remote technology consulting...  ...development, and high‐quality software execution....  ...testing, implementation review, and production‐...  ...with competitive hourly compensation for experienced...  ...rates between $95–$135 per hour... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Full time
    Contract work

    Nerdleveltech

    Burlingame, CA
    3 days ago
  • $96k - $181k

     ...KeyBank is seeking a Technical Lead to design, build,...  ...Apply agentic AI patterns using Gemini...  ...and agent handoff scenarios. Establish and...  ...standards, including code quality, testing, and...  .... Perform code reviews and mentor...  ...emailing ****@*****.***. #LI-Remote
    Remote work
    Quality
    Full time
    Work at office
    Flexible hours

    Key Bank

    Amherst, NY
    15 hours ago
  •  ...SUMMARY The Technical Lead, Oracle Lease Accounting...  ...that are high quality, well...  ...scripts, and scenarios for unit, system...  ...backlogs. * Review and Monitor Oracle...  ...RPA or Agentic AI’s. * Create...  ...balance for every hour worked and be...  ...considered for Remote positions.... 
    Remote work
    Quality
    Full time
    Flexible hours

    Marriott

    Bethesda, MD
    1 day ago
  • $95 - $125 per hour

     ...As our Technical Lead, you will help run our agency...  ...management, and setting quality standards. You...  ...roadmap (tasks, hours, and steps) needed...  ...and rigorous code reviews. The Ecosystem: You...  ...ranges between $95 – $125/hour. Location We are a fully remote team and are open... 
    Remote work
    Quality
    Hourly pay
    Contract work

    Smith & Connors

    New York, NY
    4 days ago
  • $40 - $60 per hour

     ...build and run custom AI systems that...  ...environments. As a remote-first, globally...  ...content we publish is technically accurate, useful...  ...help establish quality standards and review workflows that...  ...will be a 20-30 hour per week contractor...  ...content production and QA Produce and QA... 
    Remote work
    Quality
    Hourly pay
    Part time
    For contractors
    Work experience placement
    Worldwide
    Visa sponsorship
    Work visa

    GrabJobs

    Los Angeles, CA
    1 day ago
  • $125k

     ...Applications Architect 1, Remote About Axiom: As the leading alternative...  ..., delivering AI-enabled legal...  ...including talent quality, breadth, productivity...  ...The Salesforce Technical Lead serves as...  ...direction, code review, mentorship, and...  ...and Boston is $125,000 + a 20%... 
    Remote work
    Quality
    Immediate start

    Axiom Talent Platform

    United States
    15 hours ago
  •  ...model, mostly remote; on-site in Phoenix...  ...zone business hours. All work must...  ...for a Software QA Automation Lead # 8377. This...  ...:3+ years in a technical leadership or lead...  ...:Lead the quality platform behind...  ...while piloting AI-assisted testing...  ...QA engineers, review automation code... 
    Remote work
    Quality
    Hourly pay
    Contract work
    For subcontractor
    Local area
    Immediate start
    Relocation
    Shift work

    Torrey Holistics

    Phoenix, AZ
    2 days ago
  • $50 - $60 per hour

     ...committed to creating high-quality AI. Join our team to help...  ...the flexibility of remote work and the freedom...  ...this role, you might: Review and improve AI...  ...with complex, real-world scenarios and edge cases to see...  ...Projects are paid hourly starting at USD $50-$6... 
    Remote work
    Quality
    Hourly pay
    Contract work
    Work experience placement
    Flexible hours

    Data Annotation

    Deerfield Beach, FL
    29 days ago
  • $65 - $95 per hour

     ...healthcare workflow review. This...  ...upcoming remote consulting...  ...scenarios, clinical data...  ..., and high-quality project execution...  ...involving AI-generated...  ...healthcare QA, or care coordination...  ...hourly compensation...  ...between $65–$95 per hour...  ...opportunities across technical, evaluation... 
    Remote job
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG

    New York, NY
    20 days ago
  • $120k

     ...Position: Technical Lead / Business Analyst...  ...Location: Hybrid or Remote Terms:...  ..., and high-quality digital solutions...  ..., developers, QA testers, accessibility...  ..., code reviews, peer reviews,...  ...embedding, chatbot/AI search features...  ...Flex (Flexible Hours and Hybrid... 
    Remote work
    Quality
    Full time
    Temporary work
    Flexible hours

    RIVA Solutions

    Reston, VA
    1 day ago
  • $85 - $125 per hour

     ...About the job Remote | Software...  ...Expert - $85-$125/hour We are...  ...systems, technical problem-solving, code review, and structured...  ...review, and high-quality project...  ...realistic technical scenarios, evaluate...  ...or software QA materials...  ...developer tools, AI systems, or technical... 
    Remote work
    Quality
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    4 days ago
  • A leading AI development company is looking for a Partner to assist in...  ...time or part-time, allows for remote work and a flexible schedule....  ...financial expertise. The compensation is hourly, starting between $50 and $60, with bonuses for high-quality work. #J-18808-Ljbffr
    Remote work
    Quality
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Honolulu, HI
    2 days ago
  • 100% remote. Must reside in Bay Area....  ...looking for a Tech Lead Manager (TLM)...  ...and drive the AI team...  ...on hands-on technical work and 30% on...  ...for applied ML quality. On the management...  ...development, code reviews, and performance...  ...offsites, and happy hours. If you're... 
    Remote work
    Quality
    Flexible hours

    TEEMA

    Santa Clara, CA
    3 days ago
  • $20 per hour

     ...A leading AI training company is seeking detail-oriented individuals to train AI chatbots. This role offers the flexibility of remote work, allowing you to choose your own projects and schedule. Candidates...  .... Payment starts at $20 per hour, with potential bonuses, making... 
    Remote work
    Quality
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  •  ...Deccan Ai is seeking a Junior Quality Analyst / QA Trainee to lead quality assurance activities. The role involves defining test strategies, reviewing test cases, and ensuring that products and AI outputs...  ...offers the flexibility of remote work. The ideal candidate should... 
    Remote work
    Quality
    Traineeship

    Deccan Ai

    New York, NY
    4 days ago
  •  ...is seeking an RCM Operations Manager to support AI models in training. The successful candidate will...  .... This independent contractor position offers flexibility in scheduling and hourly pay starting at $20. Bonuses are available based on work quality. #J-18808-Ljbffr... 
    Remote work
    Quality
    Hourly pay
    For contractors

    DataAnnotation

    Brooklyn, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote | AI Scenario Quality Review & Technical QA Lead — $95-$125/hour. Be the first to apply!