Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Educational AI Benchmark Architect (Remote)

Obsidian

Mercor is seeking AI experts for a benchmark dataset project evaluating models on visual document understanding and instruction-following in the Education domain. This remote role offers ~15-20 hours per week with flexible scheduling from the US or Canada. Payments are made weekly via Stripe or Wise based on services rendered; we cannot support H1-B or STEM OPT candidates at this time. Projects may be extended or concluded early based on needs and performance. #J-18808-Ljbffr Obsidian

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Educational AI Benchmark Architect (Remote) in San Francisco, CA vacancy
  •  ...author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous MCQs...  ...domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two... 
    Remote job

    Mercor

    New York, NY
    2 days ago
  •  ...review high-quality academic assessment content for an AI research initiative. You will write and verify...  ...solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. This fully remote, asynchronous role requires 10+ hours per week. You... 
    Remote job
    10 hours per week

    Mercor Inc

    New York, NY
    2 days ago
  •  ...review academic assessment content for an AI research initiative. You will create and...  ...domains and help establish gold-standard benchmarks for AI evaluation. Role focuses on expert...  ...validation, with 10+ hours per week, fully remote, asynchronous collaboration. #J-18808-... 
    Remote job
    10 hours per week

    Mercor

    New York, NY
    2 days ago
  •  ...quality academic assessment content for an AI research initiative. You will craft and...  ...quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will...  ...Authoring or Question Verification, with remote collaboration and flexible scheduling.... 
    Remote job
    Flexible hours

    Mercor Inc

    New York, NY
    3 days ago
  • Mercor seeks contributors for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following in the Architecture domain. This is a fully remote independent contractor role, roughly 15-20 hours per week, available to candidates... 
    Remote job
    Weekly pay
    For contractors
    Flexible hours

    Mercor

    San Francisco, CA
    20 hours ago
  • A leading AI research accelerator is seeking a Biomedical Informatics Subject Matter Expert to design challenging evaluation questions...  ...rubrics to measure outcomes in bioinformatics domains. This remote position requires a Master’s degree or PhD in Biomedical Informatics... 
    Remote work
    Contract work

    Turing

    United States
    20 hours ago
  • A top AI research partner is seeking a Biomedical Informatics Subject Matter Expert to develop rigorous evaluation questions for advanced...  ..., and practical experience in the field. This position is fully remote and offers the opportunity to work on exciting AI projects with... 
    Remote work

    Turing

    Denver, CO
    3 days ago
  • A leading AI research accelerator is seeking a highly skilled Biomedical Informatics Subject Matter Expert to develop rigorous evaluation...  ...skills in Python or R. The successful candidate will work remotely on cutting-edge AI projects, with a commitment of at least 30 hours... 
    Remote work
    Contract work

    Turing

    Los Angeles, CA
    3 days ago
  • Mercor is seeking AI/ML specialists for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following in Education. This is a remote, independent contractor role requiring ~15-20 hours per week and can be performed from the... 
    Remote job
    For contractors

    Obsidian

    San Francisco, CA
    4 days ago
  • Mercor is seeking a talented AI/education domain specialist to support a benchmark dataset project evaluating AI models on visual document understanding and instruction...  ...in the Education domain. The role is fully remote, roughly 15-20 hours per week, and open to... 
    Remote job
    For contractors

    Mercor Inc

    New York, NY
    3 days ago
  • Mercor is seeking AI/education domain experts for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following. This is a fully remote, independent contractor role with flexible schedule (approximately 15-20 hours per week)... 
    Remote job
    Weekly pay
    Part time
    For contractors
    Flexible hours

    Mercor

    San Francisco, CA
    20 hours ago
  •  ...delivery. The role focuses on authoring and verifying challenging medical questions and establishing rigorous evaluation standards for AI systems. Engagement is fully remote and asynchronous, with a minimum expectation of 10 hours per week. #J-18808-Ljbffr 24-Mag Llc
    Remote job
    Part time
    For contractors
    10 hours per week

    24-Mag Llc

    New York, NY
    4 days ago
  •  ...Astrophysics & Cosmology Expert to design graduate-level problems that test AI systems using real scientific software, including simulations and...  ...and Linux familiarity are essential; 15-20 hours per week work is expected, with remote compute sandbox access. #J-18808-Ljbffr Obsidian
    Remote work

    Obsidian

    San Francisco, CA
    4 days ago
  • YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to...  ...synthesize evidence, and document rationales with citations. This is a remote contractor role emphasizing high-quality medical content. #J-188... 
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    1 day ago
  •  ...are seeking a People Content Architecture & AI Enablement Consultant to help drive...  ...standards.This is a long term contract that is remote. Must live in the Midwest.Desired Skills and...  ...career goals and aspirations. Through our Educate and Connect initiative, we offer multiple... 
    Remote work
    Long term contract
    Live in

    New Resources Consulting

    Milwaukee, WI
    3 days ago
  • $119.32k - $202.85k

     ...seeking a highly skilled ServiceNow Architect with hands-on experience implementing Now Assist and other AI‑powered capabilities on the...  ...role, geographic location, education and certifications as well as...  ...23.00 - $202,850.00Nationwide Remote Office (US99)SummaryLocation:... 
    Remote work
    Full time
    Contract work
    Work experience placement
    Work at office

    ICF

    Reston, VA
    20 hours ago
  • $110.6k - $178k

    Product Architect - AI & Digital ProductsCome make the world and accelerate your success. It...  ...our Digital Product team working as a remote employee. We're building a new generation...  ..., and AI agents.Experience evaluating, benchmarking, and optimizing Large Language Models and... 
    Remote work
    Full time
    Local area

    Stanley Black & Decker

    Towson, MD
    1 day ago
  • $120k - $275k

     ...tailored for the world’s best AI models. Our hardware will make...  ...largest models. MatX is seeking an Architect to join our team as we create...  .... In exceptional cases, remote work arrangements may be considered...  ...related skills, and relevant education and training. Career length is... 
    Remote work
    Full time
    Work experience placement
    Work at office
    Local area
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    2 days ago
  •  ...in 32 countries.Job DescriptionAs the AI Native Principal Architect, you will help define the future of...  ...Scottsdale, AZ office is preferred; however, remote candidates will also be considered....  ...job-related skills, experience, and education. You will be also eligible for a... 
    Remote work
    Work at office
    Local area
    Flexible hours

    Experian

    Scottsdale, AZ
    2 days ago
  • $142.9k - $266k

    Cloud Platforms and Agentic AI ArchitectThe Opportunity: Drive the architecture, design...  ...individual’s particular combination of education, knowledge, skills, competencies, and experience...  ...to have their cameras on during meetings.Remote: If this position is listed as remote,... 
    Remote work
    Full time
    Contract work
    Part time
    Work at office
    Local area

    Booz Allen Hamilton

    Atlanta, GA
    1 day ago
  •  ...your goals. EisnerAmper is seeking an AI Platform Architect, Strategy & Enablement who will serve...  ..., deprecated, retired) and evaluation benchmarks across the firm's multi-LLM environment...  ...Conshohocken; Raleigh; Boston; Owings Mills; Dallas; Remote; PrincetonType: Full time
    Remote work
    Full time
    Local area
    Work visa

    EisnerAmper

    Owings Mills, MD
    1 day ago
  •  ...Senior AI/ML Architect - (Contract 1099) At DI, we provide Data & Analytics expertise to drive...  ...: None Qualifications Education and Experience: ~ Bachelor's degree...  ...authoring complex Terraform modules with remote state management. ~ Deep experience building... 
    Remote work
    Contract work
    Work at office
    Local area
    Work from home
    Monday to Friday

    Data Ideology, LLC

    United States
    20 hours ago
  • $134.9k - $237.3k

     ...Be the one building what's next - where AI, experience and impact come together....  ...every day. Role Overview: The Senior AI Architect, Presales will shape how global enterprises...  ...learning programs, leadership development and education support. Time to recharge and give... 
    Remote work
    Work from home
    Worldwide
    Flexible hours

    Genesys

    United States
    1 day ago
  • $170k - $200k

     ...Modern Classrooms Project, an education nonprofit, seeks an architect to build an end-to-end generative video pipeline...  ...00,000 / yr Location Washington, DC Remote Seniority Senior Compared with 41...  ...Design the generative AI pipeline to create deterministic lessons... 
    Remote work

    Workman Labs

    Brooklyn, NY
    20 hours ago
  •  ...Job Summary We are seeking an experienced AI/ML Architect to support the Department of Veterans Affairs (VA) in shaping the strategy...  ...level AI/ML product management pipelines. No minimum education requirement specified; equivalent combination of technical training... 
    Remote work

    Aptiv

    United States
    1 day ago
  • $80 per hour

     ...AI Product Architect 6 Month contract to hire ASAP Remote $80.00/hr Our Client is not-for-profit organization that helps insurance companies...  ...QUALIFICATIONS Experience, Education and Licensure • More than 8 years of experience... 
    Remote work
    Contract work
    Immediate start
    Shift work

    Anveta

    United States
    2 days ago
  • $164.7k - $266k

     ...CLM).What you'll doWe are seeking a Lead AI Architect to turn enterprise data, metadata,...  ...divides their time between in-office and remote work. Access to an office location is required...  ...for coaching, online courses and education reimbursementsCompassionate Care Leave:... 
    Remote work
    Contract work
    Work at office
    Local area
    2 days per week

    DocuSign

    San Francisco, CA
    2 days ago
  • $165.6k - $228.49k

     ...Principal AI Architect US - Remote We're looking for a Principal Architect to lead the design and delivery of complex, multi-domain systems...  ...several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority... 
    Remote work
    Local area
    Shift work

    Robots & Pencils

    United States
    3 days ago
  •  ...Overview DecisionPoint seeks an AI/ML Architect to design artificial intelligence pilots...  .... This position is fully remote. Duties & Responsibilities...  ...Secret clearance or higher . Education (Required) Bachelor's degree... 
    Remote work
    For contractors
    Local area

    DecisionPoint | Cortek

    United States
    3 days ago
  • $190k - $210k

    Location: USA Remote Status: Fully Remote (#LI-Remote)LivePerson (NASDAQ...  ...enterprise conversational AI and digital transformation....  ...for a Principal Engineer, AI Architect to design and implement the latest...  ...location, skills, experience, education, and/or professional... 
    Remote work
    Permanent employment
    Temporary work
    Local area
    Flexible hours

    LivePerson

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Educational AI Benchmark Architect (Remote). Be the first to apply!