Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Formal Spec Model Evaluator & QA Reviewer

AuraOne

New York, NY
  • Remote job

AuraOne is seeking a Formal Specification Model Evaluator to remotely review prompts and responses against our quality rubric. This is a contractor role open to US-based, with flexible hours. You will compare outputs, label edge cases, and provide structured feedback to help retrain the modeling team. Candidates should have prior evaluation or annotation experience, strong attention to detail, and the ability to reason about rubrics and formal specification concepts. #J-18808-Ljbffr AuraOne

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote Formal Spec Model Evaluator & QA Reviewer in New York, NY vacancy
  • Formal Specification Model Evaluator is a remote evaluation track for reviewing formal specification model evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • AuraOne is seeking a remote Preference Dataset QA Reward Model Evaluator to assess model outputs against a versioned rubric and provide structured feedback. You will compare paired responses, label issues, and document edge cases for retraining the model. As an independent... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    2 days ago
  • AuraOne is seeking a remote Spoken Instruction Conversation Evaluator to review prompts and responses against its quality rubric. You will compare outputs, label...  ...and provide structured feedback for retraining the model. As an independent contractor, you will evaluate model... 
    Remote job
    Hourly pay
    Contract work
    For contractors

    AuraOne

    New York, NY
    1 day ago
  •  ...Formal Logic Model Evaluator is a remote review track for evaluating AI outputs across formal logic model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    18 days ago
  • AuraOne is seeking a remote Secrets Detection Security Evaluator to review model outputs, apply structured rubrics, and label edge cases. You will compare paired responses, justify the stronger answer, and calibrate your scoring against gold-standard examples. The role... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    2 days ago
  • AuraOne is seeking a remote Probability Model Evaluator to review prompts and model outputs against a quality rubric. You will compare paired responses, tag edge cases, and provide structured feedback to help retrain the system. The role emphasizes clear reasoning, attention... 
    Remote job
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    2 days ago
  • $40 per hour

     ...experienced quantitative professionals to evaluate AI-generated analyses and contribute to...  ...development of cutting-edge AI systems. This fully remote role offers flexible scheduling and...  ...us to directly impact the future of AI analytics and model reasoning. #J-18808-Ljbffr... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Lincoln, NE
    3 days ago
  • $40 per hour

     ...A leading AI development firm is looking for experienced quantitative professionals to evaluate AI-generated work and design problems for AI training. This fully remote position allows for a flexible schedule, offering competitive pay starting at $40+ per hour. Ideal candidates... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Bismarck, ND
    3 days ago
  • $40 per hour

     ...leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated analyses and design quantitative problems for AI training. This fully remote role offers flexibility in project selection and scheduling, with competitive pay starting... 
    Remote work
    Hourly pay

    DataAnnotation

    Juneau, AK
    3 days ago
  • $40 per hour

     ...development firm seeks experienced quantitative professionals to evaluate AI-generated work, applying their skills in statistical analysis, predictive modeling, and technical writing. This fully remote opportunity offers a flexible schedule and projects paid hourly, starting... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    3 days ago
  • $40 per hour

     ...AI development company is seeking experienced quantitative professionals to contribute to AI advancements. This fully remote role involves evaluating AI-generated analyses and ensuring they are technically accurate and valid in real-world scenarios. Candidates should have... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Santa Fe, NM
    4 days ago
  • A leading AI development company is seeking experienced quantitative professionals for remote work evaluating AI-generated quantitative analysis. Ideal candidates will have a robust background in fields like data science, economics, or biostatistics, with at least 2 years... 
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

     ...is seeking quantitative professionals to evaluate and improve cutting-edge AI systems. The...  ...analyses and providing critical feedback for model enhancement. Candidates should have a...  ...excellent writing skills. This position offers remote work from several countries, allowing for... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Helena, MT
    4 days ago
  • $40 per hour

     ...leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and provide critical feedback. This role offers the flexibility of remote work, allowing you to set your own schedule while focusing on impactful... 
    Remote work
    Hourly pay

    DataAnnotation

    Wisconsin
    3 days ago
  • $40 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative analysis and provide impactful feedback. This fully remote role allows for flexible scheduling and competitive pay starting at $40 per hour. Candidates... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Honolulu, HI
    4 days ago
  • $40 per hour

     ...A tech-focused company is seeking experienced quantitative professionals to evaluate AI-generated analysis and provide technical feedback. This remote role allows you to choose your schedule and work from various countries including the US. Ideal candidates will have... 
    Remote work
    Hourly pay

    DataAnnotation

    Providence, RI
    1 day ago
  • $40 per hour

    A leading AI development company is seeking experienced quantitative professionals to work remotely. In this role, you'll evaluate AI-generated quantitative work and solve technical problems while providing feedback to shape AI systems. Qualifications include 2+ years in... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Salt Lake City, UT
    3 days ago
  • $40 per hour

     ...seeks experienced quantitative professionals to evaluate AI-generated analysis and help advance AI development. This remote role allows flexibility in scheduling and...  ...experience in statistical methods and predictive modeling. Join to impact the next generation of AI systems... 
    Remote work
    Hourly pay

    DataAnnotation

    El Paso, TX
    3 days ago
  • $40 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to join their team remotely. The role involves evaluating AI-generated quantitative work, providing insights, and shaping the future of AI systems. Candidates should have over two years of... 
    Remote work
    Hourly pay

    DataAnnotation

    Indiana, PA
    3 days ago
  • $40 per hour

     ...annotation company is seeking professionals in quantitative fields to enhance AI development. This fully remote role allows individuals to set flexible schedules while evaluating AI-generated analyses and solving complex quantitative problems. Candidates should have 2+ years'... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Oregon, WI
    2 days ago
  • $40 per hour

     ...looking for experienced quantitative professionals to evaluate AI-generated quantitative work. Candidates should have...  ...analytical code, and providing feedback to improve AI models. This position offers fully remote work with a flexible schedule and competitive pay starting... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Montgomery, AL
    3 days ago
  • $40 per hour

     ...development firm is seeking experienced quantitative professionals to evaluate AI-generated analysis and solve complex technical problems....  ...methods, and experience with analytical coding. This fully remote position allows for flexible scheduling and competitive hourly... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Oklahoma City, OK
    3 days ago
  • $40 per hour

    A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated work and help shape future AI systems. This fully remote role offers a flexible schedule, competitive pay starting at $40+ USD per hour, and opportunities to work... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Nashville, TN
    3 days ago
  • $40 per hour

     ...leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated analytics and provide technical feedback for model improvement. The role offers fully remote work from multiple countries and a flexible schedule to choose your projects.... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Lansing, MI
    3 days ago
  • $40 per hour

     ...A leading AI company in the United States is seeking experienced quantitative professionals to evaluate and validate AI-generated analytical work. This fully remote position allows you to set your own schedule, with competitive hourly pay starting at $40 USD. Responsibilities... 
    Remote work
    Hourly pay

    DataAnnotation

    Jackson, MS
    3 days ago
  • $40 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to join their remote team. You will evaluate AI-generated quantitative analysis and solve complex problems to ensure technical accuracy. The ideal candidate should have at least 2 years of... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Denver, CO
    1 day ago
  • $40 per hour

     ...A leading AI development company is seeking experienced quantitative professionals for a remote role. Candidates will evaluate AI-generated quantitative work, solve complex problems, and provide valuable feedback. The ideal candidate has 2+ years of experience in a quantitative... 
    Remote work
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    Topeka, KS
    3 days ago
  • $40 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated work and solve complex problems related to data analysis. This fully remote role allows flexibility in schedule and project selection, catering to those with a background... 
    Remote work
    Hourly pay

    DataAnnotation

    Boston, MA
    4 days ago
  • $40 per hour

     ...A forward-thinking analytics company is seeking quantitative professionals to evaluate AI-generated work, ensuring accuracy in statistical analysis and predictive modeling. This fully remote role offers a flexible schedule and competitive pay starting at $40 per hour.... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Saint Paul, MN
    3 days ago
  • $60 per hour

     ...enjoying the flexibility of remote work and setting your own schedule...  ...advance AI development. AI models are increasingly capable of...  ...-art AI models on tasks like evaluating AI-generated quantitative analysis...  ..., with comfort writing and reviewing analytical code end-to-end.... 
    Remote work
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    Charleston, WV
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Formal Spec Model Evaluator & QA Reviewer. Be the first to apply!