AI Content Evaluator & Prompting Specialist
Linda Werner & Associates
Linda Werner & Associates is seeking an experienced Content Specialist III to help evaluate, refine, and improve advanced AI models and products. You will work directly with evolving AI systems, testing responses across topics, and shaping prompts, quality standards, and evaluation frameworks that influence system behavior. This hands-on role blends strong writing and content expertise with curiosity about AI, contributing to real-world AI product experiences and user interactions. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Content Evaluator & Prompting Specialist in New York, NY vacancy
$18 per hour
...Description Interact with an AI assistant in Malayalam. Translate English prompts into Malayalam and use them to interact with the AI application. Evaluate AI-generated responses according to... ...independently assess AI-generated content and provide consistent, accurate...ContentHourly payFreelanceImmediate startRemote workFlexible hoursRWS Group
New York, NY4 days ago- ...RWS Group is seeking a Speech AI Evaluation Specialist to support AI content improvement in Vietnamese (USA). This freelance, part-time role is remote from... ...for relevance, accuracy, and clarity, follow test prompts, and provide objective feedback within project guidelines...ContentPart timeFreelanceImmediate startRemote workFlexible hours
RWS Group
New York, NY3 days ago $15 per hour
...a role that applies Punjabi music expertise to evaluate generative AI music and lyrics. You will assess AI-generated content in Punjabi and English across a wide range of genres, checking quality, originality, and prompt adherence while considering linguistic nuances,...ContentHourly payImmediate startRemote workFlexible hoursSaidGig
New York, NY2 days ago- ...AI Trainer Jobs is seeking qualified professionals for a remote AI safety evaluation project focused on explosives and energetic materials. Tier 1 annotators review prompts and responses and classify content for safety, providing clear rationales. Tier 2 senior SMEs...ContentContract workRemote work
Pasiflora AI LLC
New York, NY4 days ago - ...Intelliswift - An LTTS Company is seeking a Content Specialist III to evaluate, improve, and shape AI content across diverse topics. The role focuses on high-quality... ..., with a 6+ month contract (W2). You will refine prompts, document evaluation outcomes, and collaborate...ContentContract workRemote work
Intelliswift
New York, NY23 hours ago - RWS Group is seeking a Speech AI Evaluation Specialist to support the improvement of AI-generated content in Chinese Simplified (USA). This freelance, part-time position... ...in short voice conversations, follow prompts, evaluate responses for relevance, accuracy, clarity...ContentRemote jobPart timeFreelanceImmediate startWork from home10 hours per weekFlexible hours
- ...Social Engineering Security Evaluator is a remote evaluation... ...security evaluation prompts and responses against... ...Why this role matters AI data reviewers help turn... ...following failures, and unsafe content with structured tags.... .... Remote · Independent specialist contractor. Employment...ContentHourly payFor contractorsRemote work10 hours per week
AuraOne, Inc.
New York, NY2 days ago $13 per hour
...Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from... ...Google apps to respond to personalized prompts. This remote project is for people based... ...internet access. AI evaluation, annotation, content review or quality assurance experience...ContentHourly payFor contractorsRemote work- Brazilian Portuguese AI Evaluator is a remote evaluation track for reviewing... ...generalist evaluation prompts and responses against... ...following failures, and unsafe content with structured tags. Capture... ...eligible. Remote · Independent specialist contractor. Employment type:...ContentHourly payFor contractorsRemote work10 hours per week
$18 per hour
AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance... ...where you’ll evaluate AI-generated content, assess linguistic accuracy and... ...target language. Translating provided prompts from English into your target language...ContentRemote jobTemporary workFreelanceImmediate startFlexible hours$18 per hour
Description: Interact with an AI assistant in Telugu. Translate English prompts into Telugu and use them to interact with the AI application. Evaluate AI-generated responses according to project... ...evaluate AI-generated content and provide consistent, objective...ContentHourly payTemporary workFreelanceImmediate startRemote workFlexible hours- ...Category: Frontier Model Evaluation Pay: Hourly rate... ...US-eligible Contractor AI Trainer & Evaluator is... ...ai trainer evaluation prompts and responses against... ...failures, and unsafe content with structured tags.... ...eligible. Remote Independent specialist contractor. Employment...ContentHourly payFor contractorsRemote work10 hours per week
AuraOne
New York, NY4 days ago - CNTXT AI is seeking a remote contractor to evaluate AI-generated financial content and develop test cases that probe analytical reasoning. You will help improve how AI models... ...from balance sheets and reports; creating prompts and Excel-based evaluation tasks; and #J-1880...ContentRemote jobFor contractors
- ...LILT is seeking detail-oriented human reviewers to support AI training and evaluation projects. You will assess prompts and outputs, review and correct text, and analyze multimedia content, applying local cultural context and brand alignment. This independent contractor...ContentFor contractorsLocal area
Lilt
New York, NY19 hours ago - ...is a global leader in AI-driven cybersecurity,... ...a world-class team of Specialist field experts with the... ...workshops, technical evaluations, and Proof of Value engagements... ...AI discovery, AI prompt analysis, AI agent... ...present thought leadership content including webinars,...ContentLocal area
Darktrace Limited
New York, NY2 days ago - ...Crossing Hurdles is seeking Medical Experts to audit AI-generated medical content for clinical accuracy, safety, and relevance on a remote, contractor assignment basis. This part-time role demands 20–40 hours per week with at least 4 hours overlap during PST business...ContentPart timeFor contractorsRemote work
Crossing Hurdles
New York, NY1 day ago - AuraOne is seeking a Chinese Voice Coach for a remote evaluation track. You will review prompts and model outputs against our quality rubric, label edge... ...model outputs, comparing paired responses, and tagging content with the appropriate rubric categories. Strong attention...ContentRemote job
- ...SaidGig seeks a remote contractor to evaluate AI-generated legal and technical content. You will assess clarity, tone, and instruction compliance, and provide detailed rationales. This role emphasizes independent work and meeting deadlines without giving legal advice....ContentContract workFor contractorsRemote work
SaidGig
New York, NY2 days ago - ...Gramian Consultancy is seeking Thai native-level evaluators to assess Thai audio content for fluency, nativeness and linguistic authenticity. You will provide well-reasoned English feedback to help improve AI language understanding and generation. No prior AI experience...Content
Remote Worker LTD.
New York, NY19 hours ago - ...Mindrift is seeking US-based physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. Projects are part-time and non-permanent... ...per accepted task. Contributors will review vignette content across multiple medical domains, score reasoning...ContentPermanent employmentPart time
Mindrift (Toloka)
New York, NY1 day ago - ...contractor to apply scientific expertise to improve AI systems through careful analysis of real-world scientific content. You will review figures, reports, and publications for accuracy and consistency, and evaluate dashboards and visualizations for scientific integrity...ContentFor contractorsRemote work
SaidGig
New York, NY2 days ago - ...Nurse Practitioners and advanced practice nursing professionals to join a remote project in the United States. You will evaluate AI-driven clinical content and provide expert feedback to improve accuracy and reliability of patient care materials. Responsibilities include...ContentRemote work
Synthires
New York, NY1 day ago - ...Anyone AI Inc. is seeking multilingual coding experts to evaluate AI-generated responses on a part-time remote contract lasting up to 3 months. This opportunity... ...AI-generated customer service and technical content for clarity, correctness, and quality, validating...ContentContract workPart timeRemote work
Anyone AI Inc.
New York, NY1 day ago - ...Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses. - Location:... ...solid understanding of JSON to evaluate AI-generated technical content and customer service responses. In this role, you’ll assess whether...ContentPart timeFor contractorsRemote work
OpenKrill
New York, NY2 days ago - ...Appraisal — Visual Document Understanding contractor to support AI model evaluation in the real estate domain. This remote, 15–20 hours/week engagement emphasizes rigorous assessment of AI-generated content and reliable benchmarking to strengthen model outputs. You will...ContentFor contractorsRemote work
Mercor Inc
New York, NY1 day ago - AI Trainer Jobs is seeking a detail-oriented evaluator to score prompt-response pairs from large language models. You will use structured rubrics to rate factual accuracy, instruction-following, and coherence across batches, typically 20-50 pairs per session. You will...
- ...The Work You will evaluate how AI models respond to sensitive questions about explosives and... ...unsafe, benign, dual-use, and adversarial content in explosives-related scenarios and... ...human work behind artificial intelligence. Specialists review and improve model responses so...ContentHourly payFor contractorsRemote work
OpenTrain AI, Inc.
New York, NY1 day ago - ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...ContentContract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY19 hours ago $210.2k - $284.3k
...Description AWS is hiring an AI Transformation Specialist to lead enterprise adoption... .... Build the technical content and hands‑on labs that form... ...: model selection, prompt engineering, retrieval‑augmented... ...production GenAI systems, not just evaluated them. ~ Demonstrated...ContentLocal areaFlexible hoursShift workAmazon Web Services (AWS)
New York, NY4 days ago- Advanced Specialist, Content Developer At Pearson, we're transforming how learning... ...through the use of AI-enabled workflows, agentic systems... ...-level positions such as Prompt Engineer, AgentOps Specialist... ...learning interactions. Evaluate emerging technologies and assess...ContentFull timeRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Content Evaluator & Prompting Specialist. Be the first to apply!
Related searches