Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Architecture Expert - Task Author

$75 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Architecture Expert
Type: Contract
Compensation: $75/hour
Location: Remote
Commitment: 15–20 hours/week

Role Responsibilities

  • Evaluate AI models on visual document understanding in the Architecture domain.
  • Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
  • Review and improve AI model outputs for accuracy and alignment with architectural principles.
  • Collaborate with subject matter experts to ensure task relevance and coverage.
  • Work independently and asynchronously to meet deadlines and enhance model performance.

Qualifications

Must-Have

  • Expertise in the Architecture domain.
  • Experience in authoring complex, grounded tasks.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Architecture Expert - Task Author in San Francisco, CA vacancy
  • AfterQuery is seeking a Growth Associate in San Francisco to architect and scale the expert supply engine driving frontier AI training. You will own both manual and automated pipelines to grow the expert network from 100K to hundreds of thousands, working with a high-velocity... 
    Suggested

    David Joseph

    San Francisco, CA
    4 days ago
  • Vitalize is seeking a Recruiting Operations professional to serve as the operational backbone of our Talent team as we scale. You’ll own interview operations, build Ashby automations, and continuously streamline workflows to reduce manual work. You’ll also lead candidate...
    Suggested

    Vitalize Care

    San Francisco, CA
    2 days ago
  •  ..., and LP reporting materials. Fully remote, with a flexible commitment of 5-20 hours per week and an ASAP start. Ideal for candidates with 3+ years in deal-facing PE roles and expert PowerPoint skills who can craft precise, persuasive narratives. #J-18808-Ljbffr Ethos
    Suggested
    Remote job
    Immediate start
    Flexible hours

    Ethos

    San Francisco, CA
    4 days ago
  • YO AI Labs is seeking an experienced Medical Writer / Clinical Document Author to develop and review regulatory documents with a focus on accuracy and compliance. The role involves interpreting protocols, ensuring ICH E3 alignment, and producing high-quality CSRs and related... 
    Suggested
    Remote job

    YO AI Labs

    San Francisco, CA
    3 days ago
  • $17 - $42 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hebrew Type: Contract Compensation: $17–$42/hour Location: Remote Duration: Up to 6 months Commitment:... 
    Suggested
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $18 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Vietnamese Type: Contract Compensation: $18/hour Location: Remote Duration: Up to 6 months Commitment:... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • HED seeks an Architectural Designer III to join our PreK-12 Education practice in the San Francisco Bay Area, Sacramento, or Los Angeles offices. This mid-level role supports design from early design through construction, under supervision, with increasing autonomy as experience... 

    HED

    San Francisco, CA
    5 days ago
  •  ...Job Title: Robotics & Mechatronics AI Expert Role Type: Contractor Location: Remote...  ...problems. Use AI coding agents for tasks such as navigating large codebases, debugging...  ...end feature development, system design, architectural changes, debugging, and workflow... 
    Remote job
    For contractors

    YO AI Labs

    San Francisco, CA
    2 days ago
  • $90 - $100 per hour

     ...Jack Dorsey . Position: Litigation Expert Type: Contract Compensation: $...  ...settlement or arbitration processes. Build tasks across commercial litigation, complex and...  ..., motions, and trial memoranda. Author rubrics that distinguish authentic litigation... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $30 - $65 per hour

     ...understanding and pronunciation. Work collaboratively with the customer's team to maintain consistency and excellence across all tasks. Apply your knowledge of German phonetics and pronunciation in all aspects of the workflow. Demonstrate strong written and verbal... 
    Temporary work
    For contractors
    Remote work
    Worldwide

    Micro1

    San Francisco, CA
    19 days ago
  • $90 per hour

     ...models handle coding , ML , and analysis tasks. Identify spots where models quietly fail...  ...tasks by collaborating with task authors to close loopholes, shortcuts, and grading...  ...sharing insights with researchers and fellow experts to continually improve the benchmark.... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • YO AI Labs is seeking a Clinician Expert for a remote contract role focused on Oncology and Hematology. You will evaluate...  ...and domain knowledge are essential. You will author and review clinical evaluation tasks, analyze trial materials for accuracy, and advise on endpoints... 
    Remote job
    Contract work

    YO AI Labs

    San Francisco, CA
    3 days ago
  •  ...civic and public administration professionals to build evaluation tasks for AI systems operating in large government and public‑sector...  ...briefs, agency strategies, and executive/legislative communications. Author rubrics that distinguish authentic public‑sector judgment from... 

    Mercor

    San Francisco, CA
    2 days ago
  •  ...Accountants and Auditors to train AI systems by creating and refining realistic accounting tasks and ensuring accuracy to professional standards. You will produce high-quality expert tasks, review outputs, and escalate edge cases to the SME Lead. This contractor role... 
    For contractors

    Turing

    San Francisco, CA
    5 days ago
  • Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original, executable research problems that today's frontier models cannot solve... 
    Part time
    Immediate start

    Mercor

    San Francisco, CA
    3 days ago
  •  ...Clinical Medicine Domain Expert Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your...  ...this role. You will review the quality of medical knowledge work tasks, write the instruction specs and golden solutions that define what... 
    Full time
    Contract work
    Part time
    Freelance
    Live in
    Relocation
    Relocation package

    Mercor

    San Francisco, CA
    2 days ago
  •  ...ERP systems (e.g., NetSuite), and BI/reporting tools (e.g., Power BI) What you'll do Review AI-agent attempts at realistic accounting tasks and judge whether each conclusion is correct and adequately supported Confirm work is actually completed and recorded — entries... 

    Mercor

    San Francisco, CA
    3 days ago
  • $126k

     ...Incident Investigations (EII) Team as an Incident Investigator, Expert. The EII team is responsible for reporting Electric Incidents (...  ...problem-solving, organizational, prioritization, and multi-tasking skills. Proven ability to prepare materials for and effectively... 
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    PG&E Corporation

    San Francisco, CA
    1 day ago
  • $70 - $90 per hour

    Mercor is seeking Physics PhD Experts with specialization in General Relativity, Astrophysics, or Cosmology. The role involves developing...  ...cutting-edge research. Compensation ranges from $70 to $90 per hour with tasks commitment of 4 to 6 per week. #J-18808-Ljbffr Mercor
    Remote job
    Hourly pay

    Mercor

    San Francisco, CA
    3 days ago
  •  ...management and asset management professionals to build evaluation tasks for AI systems operating in Fortune 500 enterprise investment...  ...portfolio strategies, and client-facing executive narratives. Author rubrics that distinguish authentic enterprise wealth and asset management... 

    Obsidian

    San Francisco, CA
    3 days ago
  • Mercor is seeking senior corporate law professionals to build evaluation tasks for AI systems operating in complex corporate transactions and governance contexts. The role spans US and International jurisdictional tracks and involves drafting reference outputs and rubrics... 

    Obsidian

    San Francisco, CA
    4 days ago
  • $100 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70-$100/hour Location: Remote...  ...visual structure, formulas, and overall presentation against the task requirements. Grade AI-generated outputs against structured rubrics... 
    Remote job
    Contract work
    Summer work
    Work at office
    Immediate start

    mercor

    San Francisco, CA
    3 days ago
  • An explosives expert performs a wide range of tasks, including detonating and analyzing explosives, analyzing detonation sites, and choosing the best blasting materials and techniques for a project. Sometimes, these experts are used on movie and television production sets... 
    Full time
    Remote work

    Practical Adult Insights

    San Francisco, CA
    1 day ago
  • $100 per hour

     ...P&L. Role Overview: Turing is looking for Portfolio Management experts to work with our researchers to improve the performance of AI models...  ...optimization. Create rubrics to assess model capabilities on tasks like performance attribution, benchmark comparison, factor analysis... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    turing

    San Francisco, CA
    2 days ago
  •  ...litigation professionals to build evaluation tasks for AI systems operating in civil...  ...arbitration rules such as ICC and LCIA). Experts qualified in either or both tracks are encouraged...  ..., motions, and trial memoranda. Author rubrics that distinguish authentic litigation... 

    Mercor

    San Francisco, CA
    5 days ago
  • $60 - $70 per hour

     ...Jack Dorsey. Position: Higher Education Expert Type: Contract Compensation: $60-$70/hour...  ...or enrollment planning. Build education tasks in academic program development, student...  ...for administrators and boards. Author rubrics to distinguish authentic higher education... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • Computational Statistics and Applied Mathematics Expert About the Project We're building a large-scale benchmark to test how well advanced...  ...can solve hard scientific and engineering problems. As a task designer, you'll create challenging computational problems that... 
    Remote work

    Obsidian

    San Francisco, CA
    2 days ago
  • Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original, executable research problems that today's frontier models cannot solve... 
    Part time
    Immediate start

    Mercor

    San Francisco, CA
    2 days ago
  •  ...the ground up. We're seeking talented Insurance subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating...  ...reasoning. Design challenging, domain‑relevant insurance tasks and write accurate, well‑reasoned solutions grounded in real underwriting... 
    Contract work
    Weekday work

    Obsidian

    San Francisco, CA
    2 days ago
  •  ...research study with senior designers. The client wants to capture how expert designers think: how you approach a problem, what separates...  ...running the interview. What to expect Roughly 4-5 hours per task/interview, including prep beforehand and a short review afterward... 
    Remote work

    Obsidian

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Architecture Expert - Task Author. Be the first to apply!