Educational AI Benchmark Architect (Remote)
Obsidian
- Remote job
Mercor is seeking AI experts for a benchmark dataset project evaluating models on visual document understanding and instruction-following in the Education domain. This remote role offers ~15-20 hours per week with flexible scheduling from the US or Canada. Payments are made weekly via Stripe or Wise based on services rendered; we cannot support H1-B or STEM OPT candidates at this time. Projects may be extended or concluded early based on needs and performance. #J-18808-Ljbffr Obsidian
- ...author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous MCQs... ...domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two...Remote job
- ...review high-quality academic assessment content for an AI research initiative. You will write and verify... ...solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. This fully remote, asynchronous role requires 10+ hours per week. You...Remote job10 hours per week
- ...review academic assessment content for an AI research initiative. You will create and... ...domains and help establish gold-standard benchmarks for AI evaluation. Role focuses on expert... ...validation, with 10+ hours per week, fully remote, asynchronous collaboration. #J-18808-...Remote job10 hours per week
- ...quality academic assessment content for an AI research initiative. You will craft and... ...quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will... ...Authoring or Question Verification, with remote collaboration and flexible scheduling....Remote jobFlexible hours
- Mercor seeks contributors for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following in the Architecture domain. This is a fully remote independent contractor role, roughly 15-20 hours per week, available to candidates...Remote jobWeekly payFor contractorsFlexible hours
- A leading AI research accelerator is seeking a Biomedical Informatics Subject Matter Expert to design challenging evaluation questions... ...rubrics to measure outcomes in bioinformatics domains. This remote position requires a Master’s degree or PhD in Biomedical Informatics...Remote workContract work
- A top AI research partner is seeking a Biomedical Informatics Subject Matter Expert to develop rigorous evaluation questions for advanced... ..., and practical experience in the field. This position is fully remote and offers the opportunity to work on exciting AI projects with...Remote work
- A leading AI research accelerator is seeking a highly skilled Biomedical Informatics Subject Matter Expert to develop rigorous evaluation... ...skills in Python or R. The successful candidate will work remotely on cutting-edge AI projects, with a commitment of at least 30 hours...Remote workContract work
- Mercor is seeking AI/ML specialists for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following in Education. This is a remote, independent contractor role requiring ~15-20 hours per week and can be performed from the...Remote jobFor contractors
- Mercor is seeking a talented AI/education domain specialist to support a benchmark dataset project evaluating AI models on visual document understanding and instruction... ...in the Education domain. The role is fully remote, roughly 15-20 hours per week, and open to...Remote jobFor contractors
- Mercor is seeking AI/education domain experts for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following. This is a fully remote, independent contractor role with flexible schedule (approximately 15-20 hours per week)...Remote jobWeekly payPart timeFor contractorsFlexible hours
- ...delivery. The role focuses on authoring and verifying challenging medical questions and establishing rigorous evaluation standards for AI systems. Engagement is fully remote and asynchronous, with a minimum expectation of 10 hours per week. #J-18808-Ljbffr 24-Mag LlcRemote jobPart timeFor contractors10 hours per week
- ...Astrophysics & Cosmology Expert to design graduate-level problems that test AI systems using real scientific software, including simulations and... ...and Linux familiarity are essential; 15-20 hours per week work is expected, with remote compute sandbox access. #J-18808-Ljbffr ObsidianRemote work
- YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to... ...synthesize evidence, and document rationales with citations. This is a remote contractor role emphasizing high-quality medical content. #J-188...Remote jobFor contractors
- ...are seeking a People Content Architecture & AI Enablement Consultant to help drive... ...standards.This is a long term contract that is remote. Must live in the Midwest.Desired Skills and... ...career goals and aspirations. Through our Educate and Connect initiative, we offer multiple...Remote workLong term contractLive in
$119.32k - $202.85k
...seeking a highly skilled ServiceNow Architect with hands-on experience implementing Now Assist and other AI‑powered capabilities on the... ...role, geographic location, education and certifications as well as... ...23.00 - $202,850.00Nationwide Remote Office (US99)SummaryLocation:...Remote workFull timeContract workWork experience placementWork at office$110.6k - $178k
Product Architect - AI & Digital ProductsCome make the world and accelerate your success. It... ...our Digital Product team working as a remote employee. We're building a new generation... ..., and AI agents.Experience evaluating, benchmarking, and optimizing Large Language Models and...Remote workFull timeLocal area$120k - $275k
...tailored for the world’s best AI models. Our hardware will make... ...largest models. MatX is seeking an Architect to join our team as we create... .... In exceptional cases, remote work arrangements may be considered... ...related skills, and relevant education and training. Career length is...Remote workFull timeWork experience placementWork at officeLocal areaMonday to FridayFlexible hours- ...in 32 countries.Job DescriptionAs the AI Native Principal Architect, you will help define the future of... ...Scottsdale, AZ office is preferred; however, remote candidates will also be considered.... ...job-related skills, experience, and education. You will be also eligible for a...Remote workWork at officeLocal areaFlexible hours
$142.9k - $266k
Cloud Platforms and Agentic AI ArchitectThe Opportunity: Drive the architecture, design... ...individual’s particular combination of education, knowledge, skills, competencies, and experience... ...to have their cameras on during meetings.Remote: If this position is listed as remote,...Remote workFull timeContract workPart timeWork at officeLocal area- ...your goals. EisnerAmper is seeking an AI Platform Architect, Strategy & Enablement who will serve... ..., deprecated, retired) and evaluation benchmarks across the firm's multi-LLM environment... ...Conshohocken; Raleigh; Boston; Owings Mills; Dallas; Remote; PrincetonType: Full timeRemote workFull timeLocal areaWork visa
- ...Senior AI/ML Architect - (Contract 1099) At DI, we provide Data & Analytics expertise to drive... ...: None Qualifications Education and Experience: ~ Bachelor's degree... ...authoring complex Terraform modules with remote state management. ~ Deep experience building...Remote workContract workWork at officeLocal areaWork from homeMonday to Friday
$134.9k - $237.3k
...Be the one building what's next - where AI, experience and impact come together.... ...every day. Role Overview: The Senior AI Architect, Presales will shape how global enterprises... ...learning programs, leadership development and education support. Time to recharge and give...Remote workWork from homeWorldwideFlexible hours$170k - $200k
...Modern Classrooms Project, an education nonprofit, seeks an architect to build an end-to-end generative video pipeline... ...00,000 / yr Location Washington, DC Remote Seniority Senior Compared with 41... ...Design the generative AI pipeline to create deterministic lessons...Remote work- ...Job Summary We are seeking an experienced AI/ML Architect to support the Department of Veterans Affairs (VA) in shaping the strategy... ...level AI/ML product management pipelines. No minimum education requirement specified; equivalent combination of technical training...Remote work
$80 per hour
...AI Product Architect 6 Month contract to hire ASAP Remote $80.00/hr Our Client is not-for-profit organization that helps insurance companies... ...QUALIFICATIONS Experience, Education and Licensure • More than 8 years of experience...Remote workContract workImmediate startShift work$164.7k - $266k
...CLM).What you'll doWe are seeking a Lead AI Architect to turn enterprise data, metadata,... ...divides their time between in-office and remote work. Access to an office location is required... ...for coaching, online courses and education reimbursementsCompassionate Care Leave:...Remote workContract workWork at officeLocal area2 days per week$165.6k - $228.49k
...Principal AI Architect US - Remote We're looking for a Principal Architect to lead the design and delivery of complex, multi-domain systems... ...several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority...Remote workLocal areaShift work- ...Overview DecisionPoint seeks an AI/ML Architect to design artificial intelligence pilots... .... This position is fully remote. Duties & Responsibilities... ...Secret clearance or higher . Education (Required) Bachelor's degree...Remote workFor contractorsLocal area
$190k - $210k
Location: USA Remote Status: Fully Remote (#LI-Remote)LivePerson (NASDAQ... ...enterprise conversational AI and digital transformation.... ...for a Principal Engineer, AI Architect to design and implement the latest... ...location, skills, experience, education, and/or professional...Remote workPermanent employmentTemporary workLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Educational AI Benchmark Architect (Remote). Be the first to apply!
- software engineering manager remote San Francisco, CA
- system engineer remote San Francisco, CA
- remote technical project manager San Francisco, CA
- remote recruitment consultant San Francisco, CA
- remote property manager San Francisco, CA
- remote reviewer San Francisco, CA
- remote insurance agent San Francisco, CA
- remote no experience San Francisco, CA
- remote life underwriter San Francisco, CA
- remote medical coding supervisor San Francisco, CA

