Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied Philosophy Benchmark Specialist [Remote]

$50 - $63 per hour

AuraOne Human Data

Remote
  • Remote job

Applied Philosophy Benchmark Specialist is a remote review track for evaluating AI outputs across applied philosophy benchmark research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Applied Philosophy Benchmark research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current applied philosophy benchmark research review methods, conventions, and prior work for Applied Philosophy Benchmark Specialist assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in applied philosophy benchmark research review or a closely related field for Applied Philosophy Benchmark Specialist work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a applied philosophy benchmark research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Applied Philosophy Benchmark research review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$50–$63 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the Applied Philosophy Benchmark Specialist [Remote] in Remote vacancy
  •  ...verify rigorous multiple-choice questions across core chemistry domains, evaluate solution quality, and help establish gold-standard benchmarks for advancing AI capabilities. You will be assigned one of two task types: question authoring or question verification, with... 
    Suggested
    Remote job

    Mercor

    New York, NY
    1 day ago
  • $50 - $63 per hour

     ...Applied Psychology Benchmark Specialist is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical... 
    Suggested
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    10 days ago
  • $66 - $84 per hour

     ...Applied Computer Science Benchmark Specialist is a remote review track for evaluating AI outputs across applied computer science benchmark specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk... 
    Suggested
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    10 days ago
  • $66 - $84 per hour

    School: Harvard John A. Paulson School of Engineering and Applied Sciences Position Description Embodied Minds lab is seeking a Postdoctoral Fellow with training and proficiency in artificial intelligence and generative modeling. Successful candidates will have significant... 
    Suggested
    Remote job
    Hourly pay

    Harvard University

    Cambridge, MA
    3 days ago
  • $61 - $77 per hour

     ...Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo...  ..., Larry Summers , and Jack Dorsey . Position: Applied Mathematics Benchmark Specialist Type: Contract Compensation: $61–$77/hour... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    10 days ago
  •  ...rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will...  ...& Knowledge Representation, AI Ethics, Applied Epistemology, Philosophy of Technology &... 
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $94 - $119 per hour

     ...academic assessment content that supports an AI research initiative. This role focuses on creating gold-standard health and medicine benchmarks across Clinical Medicine and Surgery, Medical Imaging and Diagnostics, Pharmacovigilance, Healthcare Management and Economics,... 
    Hourly pay
    Remote work
    10 hours per week

    SaidGig

    United States
    1 day ago
  •  ...rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will...  ...& Knowledge Representation, AI Ethics, Applied Epistemology, Philosophy of Technology &... 
    Remote work

    Mercor

    Boston, MA
    3 days ago
  •  ...employees in 19 countries. At CHS, we are creating connections to empower agriculture. Summary CHS, Inc. is hiring a Seed Applied Technology (SAT) Specialist role to identify and grow the markets of seed treatments, inoculants, biologicals and stored grain products within... 
    Minimum wage
    Temporary work
    Work experience placement
    Seasonal work
    Work at office
    Local area
    Remote work
    Night shift

    CHS Inc.

    New York, NY
    5 days ago
  •  ...environment while ensuring data integrity and operational efficiency. This role provides day-to-day functional and technical support for Applied Epic, resolves Epic-related incidents in ServiceNow, supports system and user administration, and helps ensure stability across #J... 
    Remote job

    Addison Group

    Austin, TX
    3 days ago
  •  ...for an AI research initiative. You will craft challenging law questions, assess solution quality, and help establish gold-standard benchmarks for AI capabilities. Roles include question authoring or verification, with emphasis on deep legal reasoning and precise problem... 
    Remote job
    Part time

    Obsidian

    Chicago, IL
    1 day ago
  • $80k - $90k

     ...Arizona. Ideal candidates should have 3-5+ years of accounting experience in an independent insurance agency and a deep understanding of Applied Epic. This role includes responsibilities such as managing Accounts Payable/Receivable, overseeing premium trust accounts, and... 
    Remote work

    Bizsmart Insurance Group

    Tempe, AZ
    2 days ago
  • $60 - $90 per hour

     ...research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo ,...  ...accuracy and appropriate handling of sensitive content. Apply structured guidelines to classify prompts and conversations.... 
    Full time
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    Remote
    1 day ago
  •  ...IMPACT YOU WILL MAKEThe Senior Sourcing Specialist - Software and SaaS role will offer you...  ...software usage, spend, renewal history, market benchmarks, and business demand to identify savings...  ..., and timeline requirements.Apply procurement tools, contract systems, spend... 
    Full time
    Contract work
    Work at office
    Remote work

    Fannie Mae

    Reston, VA
    6 hours ago
  • $57k - $201.7k

     ...will work on the development, testing, and benchmarking of novel 512-channel flexible neural...  ...technologies.Required Qualifications: Junior Specialist - Baccalaureate degree (or equivalent...  ...Neurophysiological data analysisPlease apply online in AP Recruit. See Table 24B for... 
    Flexible hours

    University of California, San Francisco

    San Francisco, CA
    1 day ago
  •  ...Benchmark Regression Model Evaluation Specialist is a remote evaluation track for reviewing benchmark regression model evaluation evaluation prompts and responses...  ...Model Evaluation Specialist work. Comfort applying multi-page rubrics consistently across long batches.... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    22 days ago
  • $90k - $115k

     ...job’s a big deal:The Workday Integration Specialist is responsible for supporting Priceline’...  ...but not limited to external market benchmark data, geographic location, and years of...  ...shape what makes our team extraordinary.Applying for this positionWe're excited that you... 
    Full time
    Work experience placement
    Summer work
    Work at office
    Remote work
    Flexible hours

    Priceline.com

    Norwalk, CT
    1 day ago
  • $118k - $130k

     ...relationships.Provide direction and vision for sourcing initiatives and apply Lean Product Development principles and manufacturing...  ...other external factors impacting the role and/or business and benchmarks for improvement of processes and applications.Identifies the strategic... 
    Contract work
    Temporary work
    For contractors
    H1b
    Work at office
    Local area
    Remote work

    STERIS

    Mentor, OH
    3 days ago
  • $145.68k - $178.05k

     ...ll Make in this RoleAs a Process Safety Specialist - Global EHS, you will have the...  ...risk reduction.Participate in external benchmarking and trade association engagement to ensure...  ...links and select the country where you are applying for employment to review the applicable... 
    Full time
    H1b
    Remote work
    Flexible hours

    3M

    Austin, TX
    3 days ago
  • $100.1k - $150.4k

     ...Responsible for understanding and correctly applying option A, B, C, & D type of guarantees....  ...). Each Senior Customer Performance Specialist executes a portfolio of PSAs assigned...  ...phases.Develops customer baselines or benchmarks as needed.Participates in transition meetings... 
    Full time
    Contract work
    For subcontractor
    Local area
    Remote work

    Johnson Controls

    Rocky Hill, CT
    1 day ago
  •  ...Bank N.A. seeks a Quantitative Analytics Specialist in Charlotte, NC.Job Role and...  ...methodology and algorithms by conducting applied research. Disseminate best practice across...  ...library to support validation process. Design benchmark models and implement and automate their... 
    Full time
    Work experience placement
    Remote work
    2 days per week

    Wells Fargo

    Charlotte, NC
    1 day ago
  • $87.87k - $163.12k

     ....Partnering with the bestAs a Sourcing Specialist - NPI, you are supporting sourcing execution...  ...SupportSupporting cost analysis, benchmarking, and total cost of ownership (TCO) evaluations...  ..., risks, and timelines to stakeholders.Applying structured problem-solving methods to... 
    Full time
    Contract work
    Work at office
    Remote work
    Flexible hours

    Baker Hughes

    Skaneateles, NY
    2 days ago
  • $13 - $15 per hour

     ...Description Job Description Please read carefully before applying. We are onboarding independent contractors to support fundraising...  ...and script guidelines Meeting attendance and performance benchmarks Important Details This is a 1099 independent... 
    Remote job
    Contract work
    For contractors

    Virtual Vantage Inc

    High Point, MO
    17 days ago
  •  ...Administrator (RHIA) Certified Coding Specialist (CCS) Certified Coding Specialist '...  ...systematic issues. Analysis details of benchmarking and creates resolution of the edits. Develops...  ...Parkland policies and procedures apply to employees while working virtually.... 
    Live in
    Remote work

    Parkland Health and Hospital System

    Dallas, TX
    10 hours ago
  •  ...contract engagement. This role offers a unique opportunity to apply your advanced subject-matter expertise toward training,...  ...detailed explanations to help improve model capabilities and safety benchmarks. Core Domains Covered: Organic Chemistry, Inorganic Chemistry... 
    Hourly pay
    Contract work
    Part time
    Remote work
    Flexible hours

    Antal International

    New York, NY
    1 day ago
  • $66 - $84 per hour

     ...Mercor is seeking an Applied Computer Science Benchmark Specialist on a contract basis. The role is remote with a commitment of 10+ hours per week, offering pay between $66 and $84 per hour. The candidate should have a PhD or be a doctoral candidate in CS/EE and demonstrate... 
    Hourly pay
    Contract work
    Remote work
    10 hours per week

    Mercor Inc

    New Bremen, OH
    3 days ago
  • $126.2k - $226.16k

     ...Role OverviewPrincipal Partner Solution Specialist - D&M Core ProductsThe Principal Partner...  ...Manufacturing core products. This role sets benchmarks for pipeline forecasting, leads...  ...Autodesk? Please search for open jobs and apply internally (not on this external site).SummaryLocation... 
    Base plus commission
    Full time
    For contractors
    Work experience placement
    Remote work
    Flexible hours

    Autodesk

    Atlanta, GA
    2 days ago
  •  ...for a Senior Project Schedule/Controls Specialist for employment in Panama City, Panama. The...  ...to statistics and metrics for use in benchmarking, scoping studies, execution planning and...  ...procedures and financial obligations that would apply to projects.Expert in standard server... 
    Contract work
    For subcontractor
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    AECOM

    Panama City, FL
    3 days ago
  • $23 per hour

     ...company. We are recognized as the global benchmark for sustainability, quality and...  ...interconnected world. Job Description Specialist I, Quality Assurance is responsible for...  ...to this job at any time. If you are applying for a position within the United States... 
    Hourly pay
    Full time
    Work at office
    Immediate start

    SGS North America Inc

    Fairfield, Essex County, NJ
    2 days ago
  • $83.78k

     ...positive change. The Reimbursement Specialist II is responsible for preparation of Medicare...  ...strengths and capabilities, then please apply today! Starting Minimum Rate...  ...: Labor Market Data: Compensation is benchmarked against market data to ensure... 
    Hourly pay
    Full time
    Part time
    Apprenticeship
    Work experience placement
    Home office
    Shift work
    Night shift
    Weekend work
    Afternoon shift

    Hackensack Meridian Health

    Iselin, NJ
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied Philosophy Benchmark Specialist [Remote]. Be the first to apply!