Remote Secrets Detection Evaluator & QA Reviewer
AuraOne
New York, NY
- Remote job
AuraOne is seeking a remote Secrets Detection Security Evaluator to review model outputs, apply structured rubrics, and label edge cases. You will compare paired responses, justify the stronger answer, and calibrate your scoring against gold-standard examples. The role emphasizes careful reasoning and documentation of failures for retraining. The work is contractor-based, remote from the US, with compensation discussed after interviews. #J-18808-Ljbffr AuraOne
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote Secrets Detection Evaluator & QA Reviewer in New York, NY vacancy
- Secrets Detection Security Evaluator is a remote evaluation track for reviewing secrets detection security evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the...Remote workHourly payFor contractors10 hours per week
- ...processes including Surveillance (Product Verification/Procedure Review), Test Witnessing, Compartment Completion Inspections,... ...rules and regulations. Must be able to obtain and maintain a Secret-level security clearance. Physical ability to perform moderate...Remote workContract workFor contractorsWork at officeLocal area
Zantech
United States1 day ago - AuraOne is seeking a remote contractor to review home robot failure case evaluations. You will assess model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining the system. The role emphasizes clear, written rationales and...Remote jobFor contractors
- AuraOne seeks a remote Bambara Language Expert contractor to review prompts and model outputs, apply a versioned rubric, and provide structured feedback for retraining. You will compare paired responses, label edge cases, and document recurring failure modes for continuous...Remote jobFor contractors10 hours per week
- Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years...Remote jobHourly payWork at office
- AuraOne is seeking an Indigenous Language AI Evaluator to remotely review indigenous language AI evaluation prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. This...Remote jobFor contractors10 hours per week
- ...with follow-up to ensure timely action. Review outgoing correspondence for supervisor... ..., personnel training records, member evaluations, certifications, and awards. Apply COMDTINST... ...Must be able to obtain and maintain a Secret-level security clearance. Familiarity...Remote workContract workWork at office
Zantech
United States2 days ago - A healthcare solutions company in McLean seeks experienced peer reviewers with at least 5 years in clinical settings. Responsibilities include reviewing medical records, assessing clinical guidelines, and providing improvement recommendations. Candidates must have an active...Remote jobWork from homeFlexible hours
- ...entertainment company is looking for a Junior QA Review Assistant to test mobile apps and provide insights. This remote role allows you to explore the user experience... ...smartphone or tablet with internet access and be ready to provide honest evaluations. #J-18808-Ljbffr Review PaysRemote jobWork from homeFlexible hours
$25 - $35 per hour
...looking for a Professional Domain Expert (Real Estate and Leasing) to work part-time and remotely. Responsibilities include writing prompts for real estate scenarios, evaluating AI outputs, and providing evidence-based evaluations. The ideal candidate has expertise in...Remote jobHourly payPart time- ...annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality... ...performance. This is a US-based remote, full-time role aligned with... ...collaborate asynchronously with reviewers and leads. A mid-senior...Remote jobFull time
- AuraOne is seeking a Unit Test Generation Evaluation Specialist to remotely support evaluation workflows. You will review AI outputs, grade tone, policy adherence, and stakeholder fit using structured rubrics, flag risks, and document next steps for model training. This...Remote jobHourly payFor contractors10 hours per week
- AuraOne is seeking an Arabic Legal AI Evaluation Specialist — Multiple-Choice QA Review (Remote) to assess AI-generated legal outputs. You will review citations, statutory reasoning, and policy adherence, flag risk, and document corrected analyses for training data. Remote...Remote jobFor contractors10 hours per week
- AuraOne seeks remote contractors to evaluate Sinhala voice QA expert outputs against a versioned rubric. You will label, compare, and document rationale for model responses, ensuring alignment with defined severity tags and rubrics. Responsibilities include ranking responses...Remote jobFor contractors
- ...documentation changes. Proofs documentation to detect and correct errors in spelling, grammar,... ...materials. Assists in peer reviews of all documentation materials created by... ...documentation ~ CANDIDATES MUST POSSESS A CURRENT SECRET CLEARANCE Other Job Specific...Remote workContract workWork at office
ASM Research
United States23 hours ago - AuraOne is seeking a remote, independent contractor to review voice actors evaluation prompts and responses. You will apply a versioned rubric to judge model outputs, assign severity tags, and provide structured feedback to help retrain models. You will compare paired...Remote jobFor contractors
- Ellenco Estágios e Treinamentos seeks a Graphic & UX/UI Designer to join a remote reviewer track for evaluating AI outputs in ui/ux design workflows. You’ll assess craft, constraints, and tooling, flag production-readiness issues, and document corrected approaches for...Remote job
- ...and help craft conversation scripts, collaborating with product teams to improve voice agents and escalation handling. The role is remote from the United States, initially contract-to-hire as a 1099 role with paid onboarding and growth opportunities. A strong health‑care...Remote workContract work
- AuraOne in the US offers a remote Experimental Design AI Reviewer track. Review AI outputs across experimental design workflows, grade correctness, policy adherence, and stakeholder fit, and flag operational risk to guide the modeling team. You will adjudicate disputes...Remote jobFor contractors
- A mobile app quality testing company is looking for Entry Level App Quality Reviewers to test and review various mobile applications and games. This remote role allows you to contribute insights into user experiences without any pressure, deadlines, or meetings. You'll...Remote job
- A leading mobile app testing company is looking for an Assistant QA Review Assistant based in the United States. In this remote position, you will test mobile apps and provide valuable feedback on usability and performance. This flexible role allows you to work at your...Remote jobFlexible hours
- A staffing agency is seeking a SNAP Case Reviewer to ensure compliance with SNAP policy. The role is 100% remote and requires extensive knowledge of SNAP eligibility and quality assurance processes. Candidates should have over 5 years of experience in supervising SNAP staff...Remote jobWork at office
$20 - $50 per hour
...audit AI outputs in elementary school teachers operations. You will review workflows, policy adherence, and stakeholder fit, grading tone... ...detail, and reliable weekly availability for at least 10 hours. Remote US-eligible, hourly compensation between $20 and $50. #J-18808-...Remote jobHourly payFor contractors- AuraOne seeks a remote reviewer for Farm Labor Contractors specialist operations AI outputs. You will grade workflow correctness, policy adherence, tone, and stakeholder fit, and flag operational risks to guide model training. This role emphasizes accuracy, detailed reasoning...Remote jobFor contractors10 hours per week
- A tech company is seeking an Associate QA Review Assistant to test mobile applications and provide feedback on user experiences. This is a flexible, remote opportunity ideal for detail-oriented beginners. You will perform tests on your smartphone or tablet, focusing on...Remote jobFlexible hours
- AuraOne is seeking a remote reviewer for Graba Videos desde Casa operations in the United States. You will assess AI outputs against workflows, policy, and playbooks, grade tone and escalation relevance, and document next steps to guide model training. This contractor role...Remote jobFor contractors
- AuraOne is seeking a Creative Brief Production Reviewer for a remote contractor role in the United States. You will evaluate AI outputs against workflows, policy, and stakeholder fit, and document the right next steps to inform model training. You will grade tone and escalation...Remote jobFor contractors10 hours per week
- AuraOne seeks an experienced Outage Coordinator specialist operations reviewer to evaluate AI outputs, grading workflow, policy adherence, and stakeholder fit for outage-related tasks. This remote contractor role prioritizes documenting the right next steps for model training...Remote jobFor contractors
- A tech evaluation company is seeking a Remote QA Review Assistant to test mobile apps and games. This entry-level position allows you to work flexible hours while providing valuable feedback on app performance and user experience. Ideal candidates should have access to...Remote jobFlexible hours
- ...oriented linguists with native speaker fluency in Vietnamese. This remote freelance position involves working on AI-related projects such as prompt evaluation, video content understanding, and text review. Ideal candidates will have strong English skills, attention to...Remote jobFreelance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Secrets Detection Evaluator & QA Reviewer. Be the first to apply!
Related searches
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- ads evaluator New York, NY