Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Research Expert — Published First Author (Benchmark Authoring

Temporary

AfterQuery

Paid, remote work authoring and validating research-grade ML benchmark tasks. For Master's or PhD-level ML researchers with at least one first-author paper. Domain: Machine Learning / AI Research Requirements Experience: 1+ years of hands-on ML research; no upper limit Education: Master's or PhD (in progress is fine, including current PhD candidates) The work You will design and validate tasks that measure what frontier AI models can actually do across machine learning. We are looking for people who write ML code and publish results, not for annotation or data-labelling experience. Task areas span: Language Models, Deep Learning, Reinforcement Learning, Vision & Generation, Robotics, ML Systems & Efficient ML, Optimization & Theory, Classical & Adaptive Learning, Time Series & Forecasting, Structured & Causal Reasoning, Trustworthy Learning, and AI for Science. Application process Candidates who meet the requirements and provide the requested materials will be prioritised for review. As part of this process we conduct thorough background checks. Please apply only if you meet these requirements.

Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the ML Research Expert — Published First Author (Benchmark Authoring in San Francisco, CA vacancy
  •  ...Build benchmark tasks to expose weaknesses in AI models through research. About Turing: Based in San Francisco...  ...in two ways: first, by accelerating frontier...  ...checking, AI benchmark task authoring, red-teaming, or...  ...OSINT capabilities or published investigative/academic... 
    Suggested
    Part time
    For contractors
    Local area

    Turing

    San Francisco, CA
    1 day ago
  • $145 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst ,...  ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR...  ...closely related field. Published at least one main conference... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    9 days ago
  •  ...computational work from your own materials science research into paid evaluation tasks for AI models....  ...is building a network of researchers to author and validate research-grade scientific-...  ...review, and you may also review other experts' tasks against a short rubric. All... 
    Suggested
    Contract work
    Temporary work
    For contractors
    Visa sponsorship
    Flexible hours

    AfterQuery

    San Francisco, CA
    1 day ago
  • $125 per hour

     ...Author research-grade AI evaluation tasks from your own computational work. Open to PhD students, postdocs, research scientists, and research...  ...on. Tasks go through review, and you may also review other experts' tasks against a short rubric. All accepted experts undergo... 
    Suggested
    Contract work
    Temporary work
    For contractors
    Remote work
    Flexible hours

    AfterQuery

    San Francisco, CA
    3 days ago
  • $80 - $110 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst , Peter...  ...and scientific validity. Author and review challenging biology...  ...Qualifications Must-Have First-author or co-first-author... 
    Suggested
    Contract work
    Part time
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst , Peter...  ...Role Responsibilities Author original, free-response engineering...  ...& Engineering . Develop expert-level solutions grounded in real... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $300 per month

     ...medical writing scientific publication authoring peer-reviewed manuscript preparation...  ...models and evaluating AI agents. Experts contribute their diverse subject matter...  ...AI-generated draft sections align with publisher formatting standards, journal guidelines... 
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    3 days ago
  • $80 - $110 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst , Peter...  ...a closely related field. Published work on stochastic growth...  ...Verifiable publication record with first-author papers. Working... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $18 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst , Peter...  ...Position: Music & Lyrics Expert - Vietnamese Type: Contract...  ...Compare AI-generated lyrics with published songs to identify... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $17 - $42 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst , Peter...  ...Position: Music & Lyrics Expert - Hebrew Type: Contract...  ...Compare AI-generated lyrics with published songs to identify similarities... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $65 - $75 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  ...writing skills with prior experience or published research. Application Process (Takes 20–30... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    19 days ago
  • $50 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  ...Mercor project . Share insights on where you first saw the opportunity and who you interacted... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    28 days ago
  • $24 - $35 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...Francisco, our investors include Benchmark , General Catalyst , Peter...  .... Position: AI Safety Experts — English & Thai Type: Contract...  ...Experience in Adversarial ML , Cybersecurity , or socio-... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $20 - $22 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...Francisco, our investors include Benchmark , General Catalyst , Peter...  .... Position: AI Safety Experts — English & Punjabi Type:...  ...Experience with Adversarial ML , Cybersecurity , or Socio... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  •  ...Skills: Strong analytical, research, and problem-solving skills with...  ...in a fast-paced, remote-first setup. Technical Infrastructure...  ...role, you will help set the benchmark for AI capabilities in...  ...large language models. Authoring Gold-Standard Data: Creating... 
    Full time
    For contractors
    Remote work

    Turing

    San Francisco, CA
    1 day ago
  • $16 - $22 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...Francisco, our investors include Benchmark , General Catalyst , Peter...  .... Position: AI Safety Experts — English & Kannada Type:...  ...Experience with Adversarial ML , Cybersecurity , and socio... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  •  ...is the world’s leading research accelerator for...  ...customers in two ways: first, by accelerating frontier...  ...qualified Sports Domain Expert to evaluate and improve...  ...cases. Develop benchmark datasets and adversarial...  ...AI evaluation. Published research, industry recognition... 
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    3 days ago
  •  ...questions based on real research scenarios....  ...customers in two ways: first, by accelerating...  ...Subject Matter Experts to develop advanced...  ...Unlike coding-focused benchmarks, this role...  ...scientists who want to author rigorous scientific...  ...working with AI/ML evaluation datasets... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    3 days ago
  •  ...Job Description Job Description Equity Research Expert Role Type: Contractor Location: Remote We are seeking experienced...  .... Analyze earnings reports, estimate revisions, and peer benchmarking. Evaluate company financial models, including revenue, margins... 
    Remote job
    For contractors

    YO AI Labs

    San Francisco, CA
    4 days ago
  • $31 per hour

     .... Delivered work is human-authored throughout. Component identification...  ...to end by a second Korean expert, and experienced annotators...  ...second-expert review the first time Unsuitable pages are...  ...handles badly Work from real published Korean documents rather than... 
    Hourly pay
    Temporary work

    Mercor

    San Francisco, CA
    1 day ago
  • $110 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst , Peter...  ...correctness, novelty, and rigor. Author and review challenging...  ...Qualifications Must-Have First-author or sole-author publications... 
    Remote job
    Contract work
    Part time
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    7 days ago
  • $10 - $11 per hour

     .... Delivered work is human-authored throughout. Component identification...  ...to end by a second Malayalam expert, and experienced annotators...  ...second-expert review the first time Unsuitable pages are...  ...handles badly Work from real published Malayalam documents rather... 
    Hourly pay
    Temporary work

    Mercor

    San Francisco, CA
    1 day ago
  •  ...About the work We are building expert-authored forecasting and research data used to evaluate and improve AI...  ...when a named sell-side analyst will publish after a catalyst, and what that...  ...performance Backgrounds we look at first: Institutional Investor-ranked teams... 
    Part time

    Mercor

    San Francisco, CA
    15 days ago
  • $61 - $77 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ..., our investors include Benchmark , General Catalyst , Peter...  ...Role Responsibilities Author original physics questions that...  ...(advanced undergraduate), or Expert (post-graduate and above).... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $150 per hour

     ...talent with leading AI research labs. Headquartered in...  ...investors include Benchmark , General Catalyst...  ...Clinician (MD/DO) - HLS Expert Pool Type: Contract...  ...unsafe advice. Author guidelines to define edge...  ...development experience Published research or sustained... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  •  ...Psychology researchers to build the behavioral science scenarios frontier...  .... AfterQuery builds the expert evaluation data that frontier...  ...researchers as contractors to author and grade the behavioral science...  ...gets read against a published rubric and gets a decision. Written... 
    Weekly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AfterQuery

    San Francisco, CA
    15 days ago
  • $1,000 per month

     ...Required Skills equity research financial modeling earnings analysis peer benchmarking sector expertise investment...  ...and evaluating AI agents. Experts contribute their diverse subject...  ...written research, or as a publishing/lead Research Analyst (titles... 
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    15 days ago
  •  ...We're building a research cohort of senior domain experts across seven specialist tracks — software/systems engineering, formal methods and computational science, ML inference and GPU kernels, enterprise operations, security, hardware design, and creative technology —... 
    Contract work

    AfterQuery

    San Francisco, CA
    15 days ago
  • $300 per unit

     ...initiative that requires strong Engineering experts to develop realistic, terminal-based...  ...environments. Experience developing technical benchmarks, programming tasks, simulation-based...  ...coding or terminal agents or working in research software engineering. Publications,... 
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    3 days ago
  • $30 per hour

     ...captures the full picture of how expert work actually gets done, the...  ...the model learns from and a benchmark it is measured against. Because...  .... ## What You'll Do - Author production-realistic CAD tasks...  ...rather than merely correct on the first render. - Solid parametric... 
    Hourly pay
    Full time
    Contract work
    Freelance
    Local area
    Remote work
    Flexible hours

    SuperAnnotate

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Research Expert — Published First Author (Benchmark Authoring. Be the first to apply!