Architecture AI Evaluation & Task Designer
mercor
Mercor is seeking an Architecture Expert for a remote, part-time contract role. The position involves evaluating AI models focused on visual document understanding within the Architecture domain and authoring tasks with clear rubrics. Collaborate with domain experts to ensure dataset quality and model alignment. You’ll work independently, 15–20 hours per week, contributing to improving AI performance while meeting project deadlines. #J-18808-Ljbffr mercor
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Architecture AI Evaluation & Task Designer in San Francisco, CA vacancy
- Planet Pharma is seeking experienced clinicians to evaluate frontier AI models in real clinical work. You will design realistic tasks such as SOAP notes, reconciliations, triage decisions, discharge summaries, patient education, or protocols, and run them through frontier...SuggestedRemote job
- Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with...SuggestedRemote job
- Mercor is seeking a remote STEM Computational Scientific Software & Evaluation Designer in Astrophysics & Cosmology. The role focuses on creating graduate-level computational problems and evaluating how AI systems tackle research-grade challenges, from simulations to data...SuggestedRemote jobFlexible hours
$2,000 per unit
...technical talent with leading AI research labs. Headquartered in... .... Position: STEM Expert Task Pilot Type: Contract... ...expert-level technical work. Design open-ended tasks with no single... ...capabilities. Ensure tasks are evaluated automatically from 0 to 1 with...SuggestedContract workSummer workRemote work$70k - $80k
...precision and accuracy at a task-specific level. Produces and... ...innovates with a strong conceptual design ability. Integrates... ...critically and constructively evaluating ideas. Demonstrates an intermediate... ...of a professional degree in Architecture or a related field. Minimum 2...SuggestedContract workFlexible hours- ...creative and technical talent with leading AI research labs. This remote, contract... ...Seismology & Geophysics Expert to design and test AI-driven problems. You will... ...to create multi-step workflows, evaluate AI models, and refine tasks. Prior graduate-level STEM training and...Remote jobContract work
- ...In 2025, we started Handshake AI and built the fastest-growing... ...AI lab researchers to create evaluations, publish benchmarks, and push... ...operations to build and extend the tasking experience-the central... ...clear, simple solutions. Own design end-to-end-from concept through...Full timeWork at officeRemote workFlexible hours
Handshake
San Francisco, CA1 day ago - Mercor is seeking versatile designers and creative professionals to join a standing listing for AI-design evaluation and training work. Projects start on short notice and match across design, writing, and visual arts, with compensation posted per project. You will assess...
$80k - $95k
...innovates with a strong conceptual design ability. Integrates... ...critically and constructively evaluating ideas. Contributes to and actively... ...of others to meet project task deadlines and commitments, with... ...of a professional degree in Architecture or a related field. Minimum...Contract workWork at office- ...the intersection of human creativity and AI. We partner with leading AI labs and product... ...companies to improve their tools across design, video, development, and beyond. Our... ...comes through. What You May Work On Evaluate AI-generated brand design outputs including...Full timeContract work
Contra Labs
San Francisco, CA1 day ago $164k - $294k
...builders on a mission to make design accessible to all. Figma’s platform... ...into code, or iterating with AI. From idea to product, Figma... ...capabilities and oversee evaluation quality. This is an exciting opportunity... ...using AI models for design tasks, either coding or image models...Full timeFor contractorsRemote workWork from home- A forward-thinking tech company is seeking an AI Trainer specializing in visual and graphic design to evaluate AI outputs. Responsibilities include assessing design quality and providing feedback to ensure high professional standards. Applicants should have formal education...Remote jobFlexible hours
- ...the intersection of human creativity and AI. We partner with leading AI labs and product... ...companies to improve their tools across design, video, development, and beyond. Our... ...comes through. What You May Work On Evaluate AI-generated advertisements and marketing...Full timeContract work
Contra Labs
San Francisco, CA1 day ago $60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract... ...hours/week Role Responsibilities Design tasks by transforming real ML research ideas...Hourly payWeekly payContract workFor contractorsSummer workRemote work$166k - $185k
Who We AreNotion is the collaborative AI workspace where teams and agents think together... ...:Own how our Foundations business teams design, automate, and operate their most... ...including prompt design, tool selection, and evaluation for quality, reliability, and edge cases....Local areaNotion Labs
San Francisco, CA1 day ago$188k - $274k
Lead the design strategy and information architecture for core business generation surfaces across YouTube Studio, defining... ...every day.Pioneer intelligent, AI-first workflows that go beyond... ...Interaction Designers transform complex tasks into intuitive, easy-to-use experiences...Google
San Bruno, CA1 day ago$105k - $120k
...Senior Designer IA Interior Architects translates client goals, brand and culture into... ...environmental specialists in the largest global architecture firm concentrating exclusively on... ...the work of other Designers Oversees tasks and provide feedback on work product...WorldwideIA Interior Architects
San Francisco, CA16 hours ago- ...the intersection of human creativity and AI. We partner with leading AI labs and product... ...companies to improve their tools across design, video, development, and beyond. Our... ...comes through. What You May Work On Evaluate AI-generated graphic design outputs across...Contract workImmediate start
Contra Labs
San Francisco, CA1 day ago $73k - $83k
...Description MWA Architects is seeking a Designer to join our growing San Francisco... ...create a legacy of beautiful and sustainable architecture for our communities. Our primary markets... ...with successfully completing tasks Experience with sustainable and resilient...Full timeTemporary workWork at officeWork visaFlexible hoursMWA Architects, Inc.
San Francisco, CA3 days ago$210k - $250k
...enterprise data. Hence, we are growing the design team and looking for designers who are... ...the intersection of interaction design and AI engineering: someone who uses AI to ship... ...also writing code with AI, training it, evaluating it, and questioning every assumption about...Full timeWork at officeSigma Computing
San Francisco, CA5 days ago$40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate the functionality and performance of Blender... ...to ensure timely completion of tasks and asynchronous collaboration with team...Remote jobContract workSummer workMercor
San Francisco, CA10 days ago$30 per hour
AI Trainer - Visual & Graphic Design Expert (Remote) About Prolific Prolific is not just another player in the... ...Domain Experts for a high‑level AI evaluation project. AI models are evolving beyond... ...and now tackle complex design tasks such as layout, typography, and information...Remote jobWork from homeFlexible hours$169k - $303k
...creatives and builders on a mission to make design accessible to all. Figma's platform helps... ...designs into code, or iterating with AI. From idea to product, Figma empowers teams... ...a job, but successfully perform their job tasks to the same extent as people without disabilities...Minimum wageFull timeLocal areaRemote workFlexible hoursFigma
San Francisco, CA3 days ago- ...Senior Interior Designer International Architecture + Interiors studio is actively seeking a Senior Interior Designer to join their San Francisco office... ...proven record of managing teams and project deadlines, tasks, and critical path assignments across multiple complex...For contractorsWork at office
Northern Impact
San Francisco, CA2 days ago $125 per hour
DataAnnotation is where 100k+ experts train the world’s leading AI models. The role focuses on evaluating design work, critiquing user flows, and teaching the next... .... Compensation ranges hourly up to $125+, reflecting task complexity and specialization. #J-18808-Ljbffr...Remote jobHourly payFlexible hours$240k - $300k
...visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual expense and accounting tasks for customers so they can focus on what... ..., and support you need to grow your career.Design at BrexDesign at Brex creates the...Temporary workWork at officeRemote workWork from homeBrex
San Francisco, CA1 day ago$230k - $270k
Who We AreHP IQ is HP’s new AI innovation lab. Combining startup... ...world-class team—engineers, designers, researchers, and product... ...solutions that make complex tasks feel effortless, teamwork more... ...new paradigms for information architecture in AI-first systemsValidate concepts...Full timeTemporary workLocal areaFlexible hoursHP IQ
San Francisco, CA5 days ago$50 per hour
A leading AI research accelerator is seeking remote PhD candidates in Chemistry or related fields to work on innovative projects. You will design problems to test AI performance and evaluate the outputs for accuracy. The role offers flexible hours and a pay rate of $50...Remote jobHourly payWork experience placementFlexible hours- Hone is building AI engines that own outcomes, not tasks, and we’re seeking a designer to own the UX for agentic, multiplayer systems. You’ll shape product design end to end, craft the design system, and build Hone’s brand and marketing site with a focus on clarity and...
$50 per hour
A leading AI research accelerator in San Francisco is looking for PhD candidates in Chemistry or related fields for a fully remote contract role. You will design and evaluate advanced chemistry problems to enhance AI performance, collaborating with researchers. Strong...Remote jobContract workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Architecture AI Evaluation & Task Designer. Be the first to apply!
Related searches
- structural designer San Francisco, CA
- service designer San Francisco, CA
- lead designer San Francisco, CA
- layout designer San Francisco, CA
- mold designer San Francisco, CA
- revit designer San Francisco, CA
- retail designer San Francisco, CA
- exhibit designer San Francisco, CA
- designer part time San Francisco, CA
- museum designer San Francisco, CA