Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Content Specialist III | AI Evaluation & Prompting (Fully Remote)

Partner Engineering and Science

New York, NY
  • Remote job

Test new AI model versions across diverse topics and evaluate responses against quality standards. Write, test, and refine system prompts to influence model behavior and performance. Identify and document model failures and provide clear, actionable feedback. Your Requirements: 5+ years of professional experience in writing, editing, or a related discipline. At least 1 year of hands-on AI experience including prompting or model evaluation. Strong analytical judgment, attention to detail, and ability to apply rubrics consistently. 6-month remote contract with full-time schedule and comprehensive health coverage. Opportunity to work directly on advanced AI system evaluation and improvement. Hands-on exposure to prompt engineering and emerging AI products. Partner Company This company specializes in evaluating and improving advanced AI systems through content evaluation and prompt engineering. It operates as a partner company managing applications for this role, focusing on quality and consistency in AI behavior. #J-18808-Ljbffr Partner Engineering and Science

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Content Specialist III | AI Evaluation & Prompting (Fully Remote) in New York, NY vacancy
  •  ...partner company, who manages all applications and next steps. Our partner is looking for a Content Specialist III | AI Evaluation & Prompting based in United States. This remote contract role offers the opportunity to directly influence the quality and behavior of advanced... 
    Remote work
    Full time
    Contract work
    Shift work

    Jobgether

    Remote
    6 days ago
  • We are seeking an experienced Content Specialist III to help evaluate, refine, and improve advanced AI models and products. In this...  ...short, and helping shape the prompts, quality standards, and evaluation...  ...Location : United States (Remote) Role type: Contract 6 Month... 
    Remote work
    Full time
    Contract work
    Visa sponsorship
    Monday to Friday
    Shift work

    Linda Werner & Associates

    United States
    9 days ago
  • Job Title: Content Operations - Content Specialist III Job id: 61676-1 Location: Remote Skills: Fluency in Spanish and English is required...  ...skills. Experience with prompt engineering, visual and multimodal...  ...creation) and at least one year of AI experience Bachelor's degree... 
    Remote work
    Work experience placement

    Apex Informatics

    New York, NY
    14 hours ago
  • $60 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $60/hour Location: Remote Role Responsibilities Evaluate high-resolution images to test...  ...around those gaps. Write realistic prompts requiring image work and web... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    5 days ago
  • $25 - $30 per hour

    DataAnnotation is seeking analytical and detail-oriented professionals to train AI chatbots. This position involves developing prompts and evaluating AI responses, ideal for individuals interested in AI applications in business. Contractors can choose their projects and... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Work from home

    DataAnnotation

    Oklahoma City, OK
    14 hours ago
  • $50 per hour

    Remote, United States. Fully Remote. Literary Content Localization & Creative Writing Specialist. Remote freelance Literary Content Localization...  ...& Quality Evaluator needed: refine plots...  .... Experience with AI data labeling,...  ...model evaluation, or prompt writing. Chinese language... 
    Remote work
    Temporary work
    For contractors
    Freelance
    Local area
    Immediate start
    Worldwide
    Overseas
    Flexible hours

    aitrainer

    Eastern, KY
    1 day ago
  • 24-MAG LLC seeks experienced Educator/ Assessor Writers for remote evaluation of AI-generated written responses. You will apply structured rubrics, assess clarity and relevance, and provide detailed rationales to ensure consistent quality judgments across tasks. Ideal candidates... 
    Remote job

    24-Mag Llc

    Brooklyn, NY
    2 days ago
  •  ...AI Content Evaluation Specialist is a remote review track for evaluating AI outputs across ai content evaluation specialist operations workflows. Reviewers...  ...attention to detail and the ability to flag when a prompt itself is the problem. Reliable async availability... 
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Job Role: Content Strategist III Location: Remote Duration: 6 months Responsibilities: Plan for launch: Partner with cross functional...  ...strategy - including content that powers Generative AI - ahead of launch Handle confidential, pre-launch... 
    Remote work
    Shift work

    eTeam

    United States
    1 day ago
  •  ...That's why the content team is growing! Since...  ...Content Marketing Specialist (based in the...  ...biggest brands, our AI-powered tools make...  ...opportunity, AEO prompt coverage, pipeline...  ...performance tracking Evaluate and integrate AI-...  ...This is a remote role based in the... 
    Remote work
    Worldwide
    Flexible hours
    Shift work

    MappedIn

    New York, NY
    4 days ago
  • $65.6k

     ...Overview Empower AI is AI for government. Empower...  ...AI is seeking a Web Content Specialist to administer the...  ...and provides Tier II/III support for complex platform...  ..., VA (RKB) WITH REMOTE WORK ELIGIBILITY AND UP...  ...enrolled in Continuous Evaluation / Continuous Vetting.... 
    Remote work
    Contract work
    For contractors

    Empower AI Inc.

    United States
    4 days ago
  • Position: Digital Content Specialist III Location: Pennsylvania Duration: Contract Job ID: 179048 Pay Range: $50 - $60 Job Overview...  ...hiring process, we may use artificial intelligence (AI) tools to assist in evaluating information related to your application. These tools... 
    Full time
    Contract work

    Pinnacle Technical Resources

    New York, NY
    3 hours ago
  •  ...seeking a Digital Marketing Specialist III to help drive their web production...  ...practice forward. This is a fully remote role, working ideally...  ...proven track record of managing content through an enterprise web...  ...opportunities to apply automation and AI tools that help the team... 
    Remote work
    Temporary work
    Mountain View, CA
    13 days ago
  •  ...Biology Subject Matter Expert (AI Training) About The Role We're looking for biology experts to help train and evaluate cutting-edge AI models developed by the world's...  ...molecular genetics and beyond. This is a fully remote, flexible contract role. No prior AI... 
    Remote work
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Flexible hours

    Alignerr Corp.

    Sheffield, TX
    6 hours ago
  • $35 - $55 per hour

     ...Biology Subject Matter Expert - AI Content Specialist $35-55/hr Remote Freelance STEM About the Role We...  ...biology experts to help train and evaluate the next generation of AI models. At...  ...projects with real-world AI impact Fully remote and flexible — set your own... 
    Remote work
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Flexible hours

    Alignerr

    United States
    3 days ago
  •  ...We are looking for experienced  Content Writers & Editors to support a remote project focused on content quality and AI evaluation . The role involves reviewing written content, assessing quality, improving clarity and language, and providing structured editorial... 
    Remote work
    For contractors
    Flexible hours

    eDataBae

    United States
    13 days ago
  • YO AI Labs is seeking experienced Technical Writers / Editors to...  ...a customer project focused on evaluating and improving advanced AI...  ...You will review AI-generated content, assess clarity, tone, and usefulness...  ...to work independently in a remote setting. No prior AI experience... 
    Remote job

    YO AI Labs

    Austin, TX
    14 hours ago
  • $22 - $70 per hour

     ...expertise to improve the quality of text used in AI evaluation and training. This remote contract role focuses on assessing written content, identifying low-quality or artificial...  ...with project coordinators and other specialists, providing clear editorial insights and recommendations... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    SaidGig

    United States
    10 days ago
  • $35 - $40 per hour

    A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and...  ...skills, familiarity with AI tools like ChatGPT, and a BS or... 
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    4 days ago
  • Health Policy & Management - AI Content Specialist About The Role Your public health expertise is...  ...MPH-level knowledge to challenge, evaluate, and improve how AI systems understand...  ...health policy. This is a high-impact, fully remote contract role where your domain expertise... 
    Remote work
    Hourly pay
    Contract work
    Freelance
    Flexible hours

    Alignerr Corp.

    Seattle, WA
    3 days ago
  •  ...Description Are you a content strategist and...  .../GEO Content Specialist eager for a new...  ...discover and evaluate products online...  ...leveraging AI tools to support...  ...keyword, entity, and prompt fan-out...  ...option to work remotely the remaining days...  ...builders ~ Fully stocked kitchen... 
    Remote work
    Work at office
    2 days per week
    3 days per week

    Roi Revolution Inc

    Raleigh, NC
    6 days ago
  •  ...re looking for a Product & Content Marketing Specialist/Strategist to support the messaging...  .... You'll also be a regular AI content operator — using AI...  .... Travel: This role is fully remote with occasional travel...  ...following the team's existing prompt library and workflows Edit... 
    Remote work
    For contractors
    Shift work

    Balco, Inc.

    New York, NY
    14 hours ago
  •  ...Chinese-speaking professionals for a short-term AI quality evaluation project. You will create conversational prompts, evaluate AI responses, and provide structured feedback...  ..., and delivering actionable feedback. Remote work is supported; prior AI evaluation or data annotation... 
    Remote job
    Temporary work

    eDataBae

    New York, NY
    1 day ago
  • $35 per hour

     ...with the world’s leading AI research teams and...  ...cutting-edge AI models. Remote contract for Masters...  ...while earning $35+/hour, fully remote, with flexible...  ...Matter Expert - AI Content Specialist Type : Hourly Contract...  ...with rigorous logic. Evaluate AI outputs for accuracy... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Flexible hours

    Alignerr Corp.

    Sheffield, TX
    4 days ago
  •  ...Subject Matter Expert (AI Training) About The Role...  ...experts to help evaluate and improve AI systems...  ...on advanced scientific content. Your knowledge will directly...  ...Hourly Contract Location: Remote Commitment: 10-40...  ...leading research labs Fully remote and flexible — design... 
    Remote work
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Flexible hours

    Alignerr Corp.

    New York, NY
    1 day ago
  •  ...Subject Matter Expert (AI Training) About The Role...  ...experts to help evaluate and improve AI systems...  ...on advanced scientific content. Your domain knowledge...  ...Hourly Contract Location: Remote Commitment: 10-40 hours...  ...cutting-edge projects Fully remote and flexible - work... 
    Remote work
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Flexible hours

    Alignerr Corp.

    Seattle, WA
    1 day ago
  • $56.14 - $62.38 per hour

     ...ethical behavior of groundbreaking AI models, shaping the future of...  ...What You'll Do Lead the evaluation and refinement of cutting-edge...  ...Craft and iterate on system prompts to meticulously shape an AI model...  ...experience in a relevant content-focused field such as writing,... 
    Hourly pay
    Temporary work

    Skill Corp

    Boston, MA
    3 days ago
  •  ...in Michigan. TELUS Digital AI Community Our global AI Community...  ..., translate, and localize content to build better AI models....  ...independent contractors for a flexible, remote opportunity where you can help...  ..., internet-savvy, and enjoy evaluating online content, this freelance... 
    Remote work
    For contractors
    Freelance
    Flexible hours

    TELUS Digital

    Michigan
    14 hours ago
  •  ...Contract, Part-time Location: Remote Role Description In...  ...work as a Copywriting & Content Subject Matter Expert (SME) to review AI-generated marketing/...  ...expert copy and content, evaluating reasoning quality, intent...  ..., and adherence to the prompt; identify issues in logic... 
    Remote job
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start

    YO IT Consulting

    Austin, CO
    4 days ago
  • $105k - $145k

     ...ChatGPT, Gemini, and Google's AI Overviews and AI Mode instead...  ...lead.We're hiring an AEO Content Strategist to own the content...  ...ll turn priority categories, prompt data, and member insights into...  ...regularly or are part of our fully remote program, you’ll stay engaged... 
    Remote work
    Full time
    Freelance
    Seasonal work
    Work at office
    Local area

    Chime

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Content Specialist III | AI Evaluation & Prompting (Fully Remote). Be the first to apply!