Brand Evaluators: Image Evaluation Task
$85 per hourTerac
What You'll Do
Review pairs of images presented on our digital platform. Evaluate each image against a specific set of brand guidelines. Select the most appropriate image based on visual coherence and rules. Complete a paid 30-minute calibration exercise ($85) and onboarding; approved experts continue on ongoing work at $85/hour.
Who Should Apply
Strong attention to detail and visual consistency Comfortable reading and applying written brand guidelines Ability to make clear, decisive evaluations between similar visual assets Access to a reliable computer and internet connection for remote work
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are processed weekly based on services rendered. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $85
$60 per hour
...What You'll Do Evaluate pairs of photographs to determine which best meets specific quality standards Assess various images for strict adherence to provided brand guidelines Complete a remote calibration task to demonstrate your visual assessment skills Participate...BrandContract workFor contractorsRemote work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: SWE-Bench Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality, correctness, and reproducibility of software-engineering benchmark...SuggestedRemote jobContract workSummer work$90 per hour
...including box model, typography, color, image handling, and overflow. Inspect underlying... ...from those that merely look correct. Evaluate responsive behavior and semantic quality,... ...Flag ties, ambiguous cases, and broken task items rather than forcing a preference....SuggestedContract workSummer workLocal areaRemote work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: ML Challenge Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality, correctness, and methodological rigor of applied machine-...SuggestedRemote jobContract workSummer work$175 per hour
...Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate JSON-formatted AI model outputs against defined grading rubrics. Read and understand written task descriptions and rubrics. Parse, read, and assess JSON-based outputs,...SuggestedRemote jobContract workSummer workStart working today$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated legal memoranda , contracts, case analyses, and... ...skills. Start Date ~ Immediate Compensation & Legal Task-based payment upon first task approval. Qualified experts...Hourly payContract workSummer workImmediate startRemote work$50 per hour
...0/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate the effectiveness of AI systems in handling personalized, real-world tasks. Use AI tools extensively to assess the utility, personalization, and realism of AI responses...Contract workSummer workRemote work$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated operational plans , staff schedules, and... ...skills. Start Date ~ Immediate Compensation & Legal ~ Task-based payment upon first task approval. Experts who complete their...Hourly payContract workSummer workImmediate startRemote work- ...We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains. You'll create complex research tasks that challenge AI capabilities in sports analytics, financial analysis, patent research, academic planning...Temporary workFor contractors10 hours per weekFlexible hours
$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated clinical assessments , treatment plans, and... ...skills. Start Date ~ Immediate Compensation & Legal ~ Task-based payment (payment upon first task approval). Experts who complete...Hourly payContract workSummer workImmediate startRemote work- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...Remote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations.Applicants must...Remote jobWork at office
$120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position & Details Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$70 per hour
...scientific prompts based on sourced input to challenge AI models . Build grading criteria to define correct answers for scientific tasks. Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed. Work...Contract workSummer workImmediate startRemote work$85 per hour
...$85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability...Contract workSummer workRemote work$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$60 - $70 per hour
...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Contract workSummer workRemote work$150 per hour
...Develop grading criteria by breaking clinical questions into discrete, checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy, safety, completeness, and appropriate escalation advice. Annotate clinical reasoning by...Contract workSummer workRemote work$100 per hour
...micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter... ...Cantonese speaker, you will participate in internal evaluation tasks using micro1's proprietary system, directly impacting the quality...Part timeFor contractorsRemote work- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based in San Francisco, California... ...product under this project centers on evaluating single-turn image edit requests against detailed safety guidelines and a defined...Part timeFor contractors
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$50 - $70 per hour
...Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness. Provide clear, well-reasoned written...Contract workSummer workRemote workFlexible hours$170 - $190 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Primary Care Physician (MD) - Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities...Contract workWork experience placementSummer workRemote work$16 per hour
...Compensation: $16/hour Location: Remote Duration: Up to 6 months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics, voice generation, and other standards. Score the quality of musical training data . Write music...Contract workSummer workImmediate startRemote work$170 - $190 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week Role...Contract workWork experience placementSummer workRemote work$180 per hour
...Location: Remote Duration: Estimated 2–3 weeks Commitment: Approximately 15 hours/week Role Responsibilities Evaluate AI-generated legal responses to enhance reasoning and procedural analysis. Review issue spotting and legal reasoning in scenarios...Contract workSummer workRemote work$100 per hour
...micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter... ...driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience...Part timeFor contractorsRemote work$25 - $45 per hour
...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... ...based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff...Part timeFor contractorsWork at officeWeekend work$120 - $175 per hour
Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Brand Evaluators: Image Evaluation Task. Be the first to apply!
- work from home web search evaluator San Francisco, CA
- evaluator San Francisco, CA
- education evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- senior brand designer San Francisco, CA
- brand marketing coordinator San Francisco, CA
- brand protection San Francisco, CA
- vice president brand marketing San Francisco, CA





