AI Image Evaluator: Judge & Calibrate Visual AI
Handshake
Handshake is seeking an AI Image Evaluator to assess generated images against prompts, check quality, and flag issues that violate policies. You will compare paired outputs, justify your choice with clear evidence, and help calibrate AI models. The role favors a trained eye from photography or design, hands-on use of generative tools, and experience reviewing visuals at scale while applying safety and IP guidelines. #J-18808-Ljbffr handshake
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Image Evaluator: Judge & Calibrate Visual AI in New York, NY vacancy
$30 per hour
...another player in the AI space – we are building... ...Professional Graphic and Visual Designers to act as... ...Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now... ...beyond "pretty pictures" to judge the professional...VisualRemote workWork from homeFlexible hoursProlific
New York, NY3 days ago- ...is recruiting a senior character animator to help shape evaluation standards for an AI-driven performance transfer model. The role focuses on facial... ...animation, performance capture, and translating complex visuals into precise data captions, with part-time W-2 engagement...VisualPart time
$188k - $262k
...methods for multimodal generative AI models, with a primary focus on image generation and editing . At Google... ...rapidly implement, and rigorously evaluate cutting-edge deep learning... ...combining large language models with visual generation (e.g., text-to-image/video...VisualFull timeGoogle DeepMind
New York, NY7 days ago$30 per hour
...: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous... ...and product improvements. Participate in calibration sessions to ensure consistent evaluation... ...Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research,...SuggestedRemote jobHourly payContract work- Mercor is hiring Legal Experts to evaluate AI-generated responses for employment and labor law scenarios. This fully remote, hourly contract... ...feedback to improve model behavior and participate in calibration sessions. Requirements include a J.D. (U.S.) or LL.B./LL.M.,...SuggestedRemote jobHourly payContract workFlexible hours
- ...with mechanical, electrical, AI, and embedded engineering teams... ...AI Object Detection Image Processing Pose Estimation... ...software modules. Integrate and calibrate sensors. Debug robot... ...PyTorch NVIDIA Jetson Visual Studio Code CMake KPIs...Visual
Ova Technologies
New York, NY3 days ago - ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...Remote work
BAM VENTURES LLC
New York, NY2 days ago - ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
Obsidian
New York, NY2 days ago - ...re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural... ...deviation) Detect hallucinations (fabricated claims, unrealistic visuals, incorrect attributes) Provide structured feedback that improves...VisualContract workTemporary workFreelanceImmediate startRemote work
$500 - $800 per day
...company helping global brands create world-class visual content. We combine traditional production expertise with cutting-edge AI image and video technologies to deliver... ...internal equity, and budget. Exact offers are calibrated by work location, individual candidate experience...VisualFull timeFreelanceWork at officeRemote workAfternoon shiftINDUSTRIAL COLOR
New York, NY2 days ago$20.3 per hour
...certified raters and contacted at least 48 hours before kickoff. We are looking for qualified raters to support a project focused on evaluating personalized search and location recommendations. This role involves rating the relevance and usefulness of suggested places...VisualHourly payContract workFreelanceImmediate start- ...re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...) Detect hallucinations (fabricated claims, unrealistic visuals, incorrect attributes) Provide structured feedback that improves...VisualContract workTemporary workFreelanceImmediate startRemote work
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY3 days ago- ...furnishings retailer is looking for a Photo–CGI–AI Assistant Art Director to elevate its... ...across teams to produce stunning visual content that aligns with business goals and... ...-5 years of relevant experience in photorealistic imaging and CGI design. #J-18808-Ljbffr...Visual
West Elm
New York, NY3 days ago - MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote jobContract workTemporary workImmediate start
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong...Remote jobHourly pay- Mercor seeks experienced brand designers to define grading criteria for real-world brand deliverables and to score AI-generated versus human work with detailed written justifications. You will apply evidence-based judgment, ensure reproducibility, and iteratively incorporate...
- Obsidian is seeking experienced evaluators to test AI systems on complex personal workflows across health, travel, planning, home services, and career search. You will create realistic prompts, execute tasks with screen recording, and use your own plugins to complete actions...
- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks....Remote jobHourly payWork at office
- AIUC is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models on policy-sensitive topics. You will assess AI-generated responses and provide structured feedback to improve model behavior. Join a collaborative team of...
- G2i Inc. is seeking a Senior AI Interaction Evaluator to assess how coding agents reason and respond. You won't write production code; you'll judge whether outputs show strong engineering judgment and useful explanations. You will evaluate end-to-end AI-generated coding...Contract workImmediate start10 hours per week
- Mercor seeks expert Evaluators in Real estate / hospitality / events to review AI-generated work products for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. You will evaluate artifacts...Remote jobHourly pay
- A virtual AI evaluation firm is seeking individuals to review and evaluate AI-generated responses in therapeutic conversations. The ideal candidate will possess strong written communication and analytical skills, as well as a keen attention to detail for assessing tone...Remote jobImmediate start
- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. You will apply subject-matter expertise to grade outputs and provide structured feedback. This is a remote, hourly engagement...Remote jobHourly payWork at office
- Mercor is recruiting experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. Work involves assessing AI-generated music across genres and rating it against detailed quality standards, with duties performed...Flexible hours
- Mercor is seeking an experienced IT management professional to evaluate AI-generated IT management content and workflows. You will direct information systems efforts, coordinate technical teams, and oversee enterprise technology operations in a short-term engagement. Responsibilities...Contract workTemporary workImmediate start
- Handshake is seeking an AI Policy Specialist on the Violence & Fiction team to evaluate how AI models handle violent content in fiction and related policy contexts. You will read requests and model replies, determine policy classification, and explain reasoning clearly...
- Dorado is hiring expert Evaluators in Legal/compliance to review AI-generated work products for accuracy and domain quality. You will apply deep subject-matter expertise to grade outputs across documents, spreadsheets, and slide decks. This is a remote, hourly engagement...Remote jobHourly payWork at office
- A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years...Remote jobFull timeFor contractors
- Productive Playhouse is building a talent pool of Armenian speakers to test and evaluate leading AI chatbots. This freelance, project-based opportunity lets you choose tasks, set your own hours, and work with other clients as needed. Open to freelancers outside the U.S....Remote jobFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Image Evaluator: Judge & Calibrate Visual AI. Be the first to apply!
Related searches
- education evaluator New York, NY
- program evaluator New York, NY
- social media evaluator New York, NY
- work from home web search evaluator New York, NY
- ai evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- judge New York, NY