Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Writing Evaluators (Domain Experts) - English Expertise

$20 - $23 per hour

Volga Partners

About Us Volga Partners, a U.S.-based company, specializes in Artificial Intelligence and machine learning, catering to top technology giants and multinational corporations. Beyond that, we offer a spectrum of services including IT, business process outsourcing, advanced professional services, and crowdsourcing in both established and emerging markets. Our client is seeking candidates interested in a retainer-based engagement for a 2‑week project. The hours will be structured around a daily commitment, with flexibility to work remotely from any location. Mandatory Requirements Must have strong subject‑matter expertise in Business Operations & Communications or Education and Academic Research. Must understand and be comfortable with the retainer model – you will be compensated for 8 hours per day regardless of task availability, provided you maintain the committed hours. Candidates must demonstrate US contextual understanding in writing and evaluation (location is not a factor). Resources required for a fixed 2‑week duration, with availability expected for 8 hours per day across the entire period. Must have reliable high‑speed internet and a functioning device (laptop, desktop, etc.) to ensure seamless communication and productivity. Total expected contribution: Approximately 120 hours over the 2 to 3 weeks (8 hours/day × 5 days/week × 3 weeks). Retainer Project Scope This is a retainer‑based, full‑time commitment role for a defined 2‑week period. Unlike task‑based freelance work, you are expected to be available for 8 hours each day, even if specific tasks are not actively assigned. Work may include prompt creation, response evaluation, feedback writing, and calibration sessions. Notifications and task assignments will be communicated via email, Slack, or the client’s portal. Position We are looking for AI Writing Evaluators (Domain Experts) with strong analytical and critical evaluation skills to assess the writing capabilities of advanced AI models such as ChatGPT, Claude, and Gemini. In this role, you will create domain‑specific prompts and evaluate AI‑generated responses for accuracy, clarity, relevance, and contextual alignment. While prior experience with AI tools is beneficial, we encourage candidates with strong academic or professional backgrounds in the target domains to apply, especially those who enjoy structured evaluation and detailed feedback. Key Responsibilities Prompt Development: create structured prompts that incorporate domain‑specific concepts, terminology, and professional context. AI Response Evaluation: assess AI‑generated outputs for Accuracy and factual correctness Relevance to the given prompt Clarity, coherence, and logical flow Appropriate use of domain‑specific language and tone Feedback & Rating: provide detailed feedback and ratings in accordance with project guidelines. Error Identification: identify inconsistencies, gaps, or improvements required in AI responses. Quality Adherence: ensure all evaluations meet the project’s quality standards and evaluation frameworks. Key Evaluation Criteria Accuracy & factual correctness Prompt relevance Clarity, coherence, logical flow Domain‑appropriate language and tone Assessment Qualification Review: candidates will be assessed based on domain expertise and a writing/evaluation sample. US Contextual Understanding: must be able to apply US‑based standards in writing and evaluation, regardless of physical location. Daily Commitment: 8 hours per day, Monday through Friday (or as scheduled), for the full 2‑week project duration. Immediate Start: project begins shortly after onboarding. Fields Most Suited for this Role Business Operations Manager / Consultant Corporate Communications Specialist Technical Writer / Editor Educator (Academic Research or Writing) Curriculum Developer Instructional Designer Linguist with strong writing focus Quality Assurance Analyst (content evaluation) Desired Qualifications Strong academic or professional background in Business Operations & Communications or Education and Academic Research. Excellent analytical and critical evaluation skills. Proficiency in written English with meticulous attention to detail. Familiarity with AI tools (ChatGPT, Claude, Gemini) is preferred but not mandatory. Ability to understand and apply US‑based contextual standards in writing and evaluation. Proactive attitude toward continuous improvement and adherence to evaluation frameworks. Compensation (Retainer Model) Competitive hourly rate (USD) – paid 8 hours/day for the full 2‑week project duration, irrespective of task availability, provided the committed hours are maintained. Compensation starting in CANADA: USD$20–23 per hour (DOE). Required Skills Expert‑level written English Strong logical reasoning and analytical skills Ability to interpret structured evaluation rubrics Attention to detail and ability to provide constructive, actionable feedback Time management to maintain consistent daily availability Required Qualifications Strong academic or professional background in Business Operations & Communications or Education and Academic Research. Proficiency in written English with a command of US contextual standards. Meticulous attention to detail. Ability to work independently and meet daily availability requirements. Must pass a project‑specific qualification assessment (writing sample and evaluation exercise). #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Writing Evaluators (Domain Experts) - English Expertise in New York, NY vacancy
  • $20 per hour

     ...seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring...  ...their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position offers flexibility with... 
    English language skills
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • A company specializing in AI technology is seeking detailed-oriented individuals to join...  ...include developing prompts, writing high-quality responses, and evaluating AI models. Ideal candidates should be fluent in English, possess a bachelor's degree, and have experience... 
    English language skills
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • A leading AI training company is seeking medical experts to evaluate AI chatbots' responses to complex healthcare problems in a REMOTE position...  ...medical accuracy of AI outputs and assessing writing tasks. A strong command of English and detail-oriented nature are essential.... 
    English language skills
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    5 days ago
  •  ...Korean Language Expert (AI Training) About the Role We're looking...  ...language experts to help evaluate and improve AI systems built...  ...Assess learner speech and writing across proficiency levels from...  ...learner language Fluent in English (C1/C2 level) Familiar with... 
    English language skills
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Worldwide
    Flexible hours

    Alignerr

    New York, NY
    4 days ago
  • $15 - $150 per hour

     ...power the future of AI by harnessing the expertise of professionals worldwide...  ...’ll Do Provide expert-level feedback, data...  ...languages, etc.) Evaluate, refine, or create...  ...Who You Are A domain expert, researcher,...  ...proficiency in written English; multilingual skills... 
    English language skills
    Hourly pay
    Weekly pay
    Contract work
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    NeuraScale

    New York, NY
    more than 2 months ago
  • $15 - $20 per hour

     ...technical talent with leading AI research labs....  ...Position: Generalist - English & Marathi Type:...  ...Generate high-quality human evaluation data by identifying...  ...(LLMs). Excellent writing skills in English ....  ...Background or experience in domains requiring structured... 
    English language skills
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    6 days ago
  •  ...global leader in AI-powered visual assistance...  ...Home Support Domain Expert, you will be the...  ...Set performance evaluation benchmarks and build...  ...programs). ~ Technical Writing & Flow Mapping:...  ..., unwritten field expertise into highly...  ...Communication: Exceptional English verbal and written... 
    Remote work
    Flexible hours

    TechSee

    New York, NY
    5 days ago
  •  ...-thinking Subject Matter Expert (SME) to review and evaluate online course content focused...  ...Artificial Intelligence (AI) in healthcare . The...  ...candidate will have deep domain expertise in healthcare and AI technologies...  ...modules. Strong writing, communication, and collaboration... 
    Contract work
    Part time
    Remote work
    10 hours per week
    Shift work

    Hurix Systems Private Limited

    New York, NY
    2 days ago
  • $73 per hour

     ...your resume in English and indicate your...  ...the future of AI. What We Do...  ...into real‑world expertise from across the...  ...are tested and evaluated? What the...  ...procedures, and genuine domain expertise...  ...scoring, then write an ambiguous version...  ...‑holding. Real expert complexity only... 
    English language skills
    Permanent employment
    Part time
    Freelance
    Remote work
    Flexible hours

    Mind Rift

    Brooklyn, NY
    5 days ago
  • $11 - $30.65 per hour

     ...Specialist for a freelance project focused on evaluating AI audio models for customer support....  ...intended for individuals with strong English skills, programming literacy, and experience...  ...of $11 to $30.65 per hour is offered based on expertise and location. #J-18808-Ljbffr... 
    English language skills
    Hourly pay
    Freelance
    Remote work

    Invisible Agency

    New York, NY
    2 days ago
  •  ...hourly contractor role, you will evaluate AI-generated financial content...  ...corrections clearly in writing Assessing AI reasoning across...  ...writing Full professional English proficiency Reliable and self...  ...AI products, with deep expertise in Arabic-native and secure,... 
    English language skills
    Hourly pay
    Full time
    Temporary work
    For contractors
    Remote work

    CNTXT AI

    New York, NY
    5 days ago
  • A leading AI development company is seeking proficient programmers to advance AI...  ...Responsibilities include designing coding problems, evaluating AI-generated code, and writing clear code snippets. The ideal candidate will be fluent in English, experienced in Kotlin, and... 
    English language skills
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  •  ...contractor role supporting AI data and language...  ...Content generation: writing high-quality prompts and...  ...training datasets. LLM evaluation: reviewing AI-generated...  ...speakers of American English born and raised in the...  ...AI products, with deep expertise in Arabic-native and secure... 
    English language skills
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    CNTXT AI

    Brooklyn, NY
    25 days ago
  • $60 per hour

     ...developing cutting-edge AI systems, while enjoying...  ...models on tasks like evaluating AI-generated quantitative...  ...statistical inference. Write clear technical...  ...forecasting). Fluency in English (native or bilingual level...  ...equivalent demonstrated expertise). Note: Payment is made... 
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    5 days ago
  • $25 - $100 per hour

     ...Medical Expert (SME) - Freelance Project...  ...consultant on AI training data...  ...successful delivery of domain‑specific...  ...Deep clinical expertise with 5+ years professional...  ...and written English, with clear and...  ...medical writing skills. We...  ...determined after evaluating your experience... 
    English language skills
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Invisible Agency

    New York, NY
    2 days ago
  •  ...A leading AI security solutions provider is seeking experienced cybersecurity professionals to evaluate AI-generated content and solve technical cybersecurity problems...  ...in various cybersecurity domains and a strong command of English. This is a flexible remote position... 
    English language skills
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  •  ...Are you passionate about AI and skilled at analyzing both text...  ...tasks such as prompt evaluation, video content understanding,...  ...fluency only Strong command of English Experience as a reviewer, annotator...  ...process tailored to your expertise. Information collected and processed... 
    English language skills
    Freelance
    Local area
    Remote work

    LILT (Production)

    New York, NY
    2 days ago
  •  ...Mapping City/Country Expert will be responsible for...  ...country specific expertise. The City/Country Expert...  ...data areas. Data evaluation and GTFS mapping for...  ...communication skills (read, write and speak) in English and native local...  ...intelligence (AI) tools to support parts... 
    English language skills
    Local area
    Weekend work

    TSMG

    New York, NY
    3 days ago
  • Biochemistry Subject Matter Expert (AI Training) About the...  ...reasoning. Your expertise will directly shape how...  ...Ground-Truth Solutions - Write precise, step-by-step...  ...Audit AI Outputs - Evaluate AI-generated biochemical...  ...discipline Strong domain knowledge - Deep grounding... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    2 days ago
  •  ...part of the GRC Team and your expertise will be an integral part of...  ...fulfill the role of subject matter expert, advising upon the on the...  ...Readiness Assessment, Policy Writing, Risk Assessment, client...  ...to communicate and write in English professionally Reliable personal... 
    English language skills
    Work at office
    Remote work
    Overseas
    Flexible hours
    Shift work

    NetCov

    New York, NY
    2 days ago
  • $30 per hour

     ...Prolific is looking for Advanced Mandarin Speakers to join as Domain Expert participants. You will assist in training and evaluating AI models while being part of a groundbreaking platform. Responsibilities include analyzing and editing Mandarin content and assessing AI... 
    Remote work
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  •  ...A tech company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at... 
    Contract work
    Remote work
    Flexible hours

    Handshake

    New York, NY
    8 hours ago
  •  ...A leading AI data platform is seeking individuals with Computer Science expertise to work as self-employed AI Trainers. This role involves completing tasks related to training and evaluating AI models. Successful applicants will have a strong understanding of programming... 
    Hourly pay
    Self employment
    Remote work
    Flexible hours

    Prolific - UK Job Board?

    New York, NY
    2 days ago
  • $70 - $75 per hour

     ...a talented AWS Generative AI Expert This is a 06+ Months Contract...  ...Implement automated model evaluation frameworks. Design and...  ...with AWS services. ~ Deep expertise in:AWS Bedrock and foundation...  ...documentation and technical writing skills. ~ Experience... 
    Contract work
    Local area
    Immediate start

    Pyramid Consulting

    Jersey City, NJ
    4 days ago
  • $20 per hour

     ...technology company is seeking a Pyxis Technician to evaluate AI chatbots and improve model quality through healthcare-related expertise. The role offers flexibility in project...  ...work setting. Candidates must be fluent in English and possess a relevant healthcare degree.... 
    English language skills
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    5 days ago
  • $40 per hour

     ...A leader in AI data collection is seeking skilled SQL Developers to join as Domain Expert participants. This role involves tasks like analyzing, editing, and writing SQL to evaluate AI models. Competitive pay of $40/hour per completed task is offered, with flexible hours... 
    Remote work
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • $40 per hour

     ...is seeking experienced professionals to evaluate AI-generated security content and solve technical...  ...candidates in the US and several other English-speaking countries, offering flexibility...  ...analytical skills, and the ability to write clear technical explanations.... 
    English language skills
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    5 days ago
  •  ...A leading AI company is seeking detail-oriented linguists with native Turkish fluency...  ...AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal...  ...candidates will have a strong command of English and experience as reviewers or evaluators... 
    English language skills
    Freelance
    Remote work

    Lilt

    New York, NY
    2 days ago
  •  ...Systems Engineer (Rust) - AI Platform About the...  ...What if your deep Rust expertise could directly shape...  ...annotation tooling to evaluation infrastructure that runs...  ...~ Native or fluent English speaker with clear written...  ...professional experience writing production Rust, with a... 
    Hourly pay
    Ongoing contract
    Contract work
    Remote work

    Alignerr

    New York, NY
    2 days ago
  • $60 per hour

     ...professionals to join their remote team. In this role, you will evaluate AI-generated cybersecurity content, design and solve technical...  ...years in cybersecurity roles, coding experience, and strong English writing skills. Competitive hourly pay up to $60 USD/hour is offered... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Writing Evaluators (Domain Experts) - English Expertise. Be the first to apply!