QA Specialist - AI Product Testing & Support
AuraOne, Inc.
QA Specialist - AI Product Testing & Support is a remote review track for evaluating AI outputs across qa ai product testing support specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it. Why this role matters QA AI Product Testing Support specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would - checking workflow, policy, and the unwritten rules that decide whether a task actually gets done. Responsibilities Review AI outputs against current qa ai product testing support specialist operations workflows, playbooks, and firm policy for QA Specialist - AI Product Testing & Support assignments. Grade tone, escalation logic, and stakeholder fit on a structured rubric. Flag operational risk, missed escalations, and policy-adherence gaps with severity tags. Capture the right next step so the modeling team can train on it. Adjudicate disputed treatments against published playbooks or firm guidance. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications Direct working experience in qa ai product testing support specialist operations on real teams for QA Specialist - AI Product Testing & Support work. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the policy or workflow being applied. Strong attention to detail and the ability to flag when a prompt itself is the problem. Reliable async availability for at least 10 hours per week. Example tasks Grade a model's response to a real qa ai product testing support specialist operations ticket and rate workflow, tone, and escalation. Flag a missed escalation with the right severity tag and corrected next step. Adjudicate a disputed playbook call between two reviewers using firm guidance. Audit a 25-row batch for rubric consistency and report drift to the program lead. Nice to have Prior experience training, calibrating, or QA-ing operations teams. Familiarity with AI-assisted workflow tooling and its failure modes. Bilingual experience for cross-region operations. Skills Operational review Policy adherence Workflow judgment Stakeholder communication QA AI Product Testing Support specialist operations AI model evaluation Work model Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. Compensation Hourly rate confirmed after the interview process. Direct working experience in qa ai product testing support specialist operations on real teams for QA Specialist - AI Product Testing & Support work. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the policy or workflow being applied. Strong attention to detail and the ability to flag when a prompt itself is the problem. Reliable async availability for at least 10 hours per week. #J-18808-Ljbffr AuraOne, Inc.
$30 per hour
Prolific is seeking Customer Support Representatives to join its Expert Network to train and evaluate AI models using real service expertise. Successful candidates will be paid to complete paid tasks after a quick assessment, often up to $30 per hour, with flexible hours...SuggestedRemote jobHourly payFlexible hours- ...Purple, Rock, Scissors (PRPL) is seeking a QA UX (Visual) Specialist to support one of our large tech clients on a product excellence initiative focused on addressing underlying... ...bugs and reviewing the actual build against test cases, while contributing to process thinking...SuggestedFull timeContract workRemote work
Purple Rock Scissors
New York, NY2 days ago - TSMG is seeking Quality control specialists to support an AI language project focused on improving speech recognition systems. You will review completed language annotation tasks and ensure AI-generated transcripts are natural, readable, and aligned with project guidelines...Suggested
- AuraOne, Inc. seeks a Data Provenance Data Specialist contractor to review AI outputs and ensure compliance with data provenance workflows, policies, and escalation rules. You will evaluate tone, eligibility, and stakeholder fit against structured rubrics. You’ll flag...SuggestedRemote jobFor contractors
$30 - $50 per hour
A tech company specializing in AI solutions is searching for a remote, full-time candidate to support AI/ML training workflows. In this role, you will perform high-accuracy data labeling, execute RLHF evaluation, and ensure training data quality. Candidates should have...SuggestedRemote jobHourly payFull time- ...leading research accelerator for frontier AI labs and a trusted partner for global... ...enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by... ...are looking for experienced Video Data QA Specialists to support the OpenAI Egocentric project...Remote workFlexible hoursWeekend work
- Invisible Technologies Inc. seeks Korean translators to shape the future of AI. You will assess AI-generated translations for grammar, fluency, culture, and context, working with Korean and English. As a contractor, you’ll translate in both directions, annotate errors,...Remote jobFor contractors
- ...В составе Muse Group — Hal Leonard, публикующий нотные издания и образовательные материалы по всему миру. Задачи включают работу по QA моделей и разметке данных в области нотной записи и аудио, а также помощь в улучшении моделей и создании качественных золотых наборов...
- AuraOne is seeking a remote contractor to review AI outputs for Electrical Hardware Engineering Experts workflows. You will grade tone, policy adherence, and stakeholder fit against established playbooks and capture the right next steps for the modeling team. This role...Remote jobFor contractors10 hours per week
- Overview Production Support & QA Specialist role with Agile Resources, Inc. on a 1+ year contract with potential for FTE conversion. 100% Remote anywhere... ...prior to production releases, validating readiness, test results, and operational criteria Review and approve release...Contract workRemote work
- TSMG is seeking Quality control specialists to support an AI language project focused on improving speech recognition systems. As a QC contributor, you will review completed language annotation tasks and ensure transcripts are natural, readable, and aligned with guidelines...
- Flock Safety is seeking a remote-capable technical support specialist to help field technicians and contractors troubleshoot hardware, cameras, and network issues in real-time. You will own live chat guidance, ensure work order quality, and drive quick resolutions with...For contractorsRemote work
- Crossing Hurdles is seeking a detail-oriented evaluator to audit AI models and agents across predefined scenarios in a Canadian context. This role focuses on rigorous testing, precise execution, and thorough documentation of results. You will manage repetitive test cycles...
- .... ATS360 is our HR technology product, built on NetSuite and used by... ...person with strong functional testing, documentation and communication... ...testing, documentation and support tasks at once without losing track... ...in functional testing, QA, product support or a similar...Immediate start
- ...The eGIS team is seeking two skilled contractors to support data quality assurance and testing efforts for the Gas division of our project. This role... ...interviewing at Equiliem by 2x Get notified about new Information Specialist jobs in Bronx, NY . #J-18808-Ljbffr EquiliemContract workFor contractorsWork at office
- Join to apply for the Product Support & QA Specialist role at Adriel . This range is provided by Adriel. Your actual pay will be based on your skills... ...and streamlined flows, then collaborate to implement and test these changes. Coach customers to “aha!” moments - diagnose...Full timeRemote workFlexible hours
- ...Company: Aidey is an AI-first Business... ...audiences, and add product recommendations and... ...continuous and robust A/B testing. They are a lean... ...& Quality Specialist to ensure the quality... ...with Development, Support, and Customer Success... ...- ADVANTAGE Strong QA skills, including functional...Work at officeRemote workNight shiftDay shift
- RN Annotators is a remote review track for evaluating AI outputs across rn annotators specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team...Remote job
- ...remote work on a high-stakes data project. You will validate transformed documents, focusing on PII protection and data accuracy to support AI training and quality assurance. You will perform spot-checks, flag issues, and document findings clearly. Strong attention to...Remote jobFor contractors
- Remotebridge is seeking a Hebrew Bilingual Expert to work remotely as a contractor on a language and AI training project. You will review Hebrew audio, assess nativeness and fluency, and provide clear English feedback with detailed justifications. Ideal candidates are...Remote jobFor contractors
- SME Careers, a fast-growing AI Data Services provider and subsidiary of SuperAnnotate, seeks an Assamese Language SME for hourly remote contractor work. You will review AI-generated Assamese content, write high-quality references, and provide precise feedback on grammar...Remote jobHourly payFor contractors
- ...Assurance Analyst to join our team in support of an important federal... ...functional and integration testing. The right candidate will have... ...standards. Interpretation of product requirements into a test plan... ...report status. Ability to document QA procedures for the team....Remote workWork from home
BayNova LLC
New York, NY2 days ago - Filed is hiring for a remote QA/Support role focused on reproducing customer issues, writing precise tickets, and guiding engineers to fast fixes. You will interact with tax software users, coordinate with engineering, and ensure high-quality resolutions across time zones...Remote job
- HumanSignal in Hoboken, NJ seeks a QA Specialist to support an audio and video data processing project. You will align audio and video, trim recordings, and perform quality checks using Label Studio and project guidelines. This hands-on role suits detail-oriented individuals...Remote job
- ...between customers and engineering, reproducing issues, and writing precise tickets for fixes that ship quickly. The role emphasizes clear communication, rigorous testing, and ownership of problem-solving from reproduction to post-release validation. #J-18808-Ljbffr FiledRemote job
$35 - $40 per hour
...defining standards, and conducting assessments. Ideal candidates should have strong writing and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This mid-senior level role offers flexible hours (10-40/week) and competitive compensation...Remote jobContract workFlexible hours- ...Solutions Inc, a New York-based technology company, seeks a QA/Quality Engineer focused on AI-automated testing to join our growing team in New York, NY. You will... ...AI-powered test frameworks and collaborate across product squads to raise quality and speed of delivery. The...
- Support quality and accuracy of a government RFP data pipeline. Validate information from government websites and public documents. Key... ...output targets are met and blockers are clearly communicated. An AI-driven technology company specializing in government procurement...Remote job
- Caylent, a fully remote global AI-first cloud services company, seeks a QA tester to execute comprehensive test plans for IVR, chat, email, and Amazon Connect. You will validate CRM and third-party integrations, perform regression and usability testing, and collaborate...Remote job
- ...Position Summary The QA Specialist will play a key role in ensuring the quality, safety, and compliance of raw materials and related processes in support of biotechnology manufacturing operations. This position is responsible for reviewing raw material documentation,...Contract work
Astrix Inc
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to QA Specialist - AI Product Testing & Support. Be the first to apply!
- quality assurance specialist New York, NY
- quality assurance associate New York, NY
- qa specialist New York, NY
- software quality assurance specialist New York, NY
- qa associate New York, NY
- direct support assistant New York, NY
- operations support assistant New York, NY
- part time support assistant New York, NY
- administrative support assistant New York, NY
- program support assistant New York, NY