Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Rater Guidelines Writer

$45 - $65 per hour

OpenTrain AI

About OpenTrain OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI is hiring and contracting for this opportunity, helping contributors find meaningful projects, build a professional AI training profile, and apply in minutes. Free account creation Access to opportunities across the growing AI training industry A way to build experience and a lasting AI training career About AI Training Work AI training is the human work behind modern artificial intelligence. People write, review, rate, and refine examples that help language models produce more accurate, useful, and reliable responses. As an AI Rater Guidelines Writer, you will contribute at the instruction-design layer of this process. Your guidelines and rubrics will help human raters evaluate model outputs consistently, including when examples are ambiguous or difficult to classify. Work on cutting-edge generative AI and RLHF projects Help shape how advanced language models are evaluated Apply writing, reasoning, and domain-translation skills to practical AI development The Role OpenTrain AI is seeking an AI Rater Guidelines Writer to turn high-level, sometimes ambiguous program specifications into precise instructions for human raters. You will bridge program requirements and field application by creating clear, non-contradictory guidelines that support consistent decisions across diverse subject-matter domains. This is a part-time contractor opportunity for applicants in the United States who work in English. The listed rate is $45-$65 per hour. Role: AI Rater Guidelines Writer Work type: Contractor and part time Location: United States Language: English Pay: $45-$65 per hour Subject matter: Cross-domain rater guidelines What You’ll Do You will collaborate with research, program, and subject-matter teams to make evaluation instructions accurate, usable, and consistent. The work includes both initial guideline development and detailed quality review before instructions are used in the field. Translate high-level and ambiguous program specifications into precise, unambiguous rater guidelines. Design rating rubrics that raters can apply consistently, including for edge cases. Review draft guidelines for internal contradictions and coverage gaps. Revise guidelines until they are ready for field application. Adapt instructions to terminology and standards in finance, retail, insurance, legal, and sports domains. Collaborate with subject-matter experts and program leads to maintain consistency and accuracy across the full guideline set. Requirements This role requires professional experience developing clear written guidance and direct experience supporting human rating in a generative AI or RLHF environment. You should be comfortable identifying ambiguity, resolving contradictions, and explaining complex requirements in straightforward language. 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field. Direct experience writing or refining guidelines and rubrics for human raters in a GenAI or RLHF environment. Ability to work across multiple subject-matter domains and translate domain-specific nuance into clear instructions. A strong track record of resolving ambiguity and contradiction in written specifications. Strong written communication skills, including the ability to explain complex guidance clearly. Experience with rating guidelines in fields such as finance, insurance, legal, retail, or sports. Availability for weekday work. The role details specify at least 35 hours per week; the structured listing indicates a 20+ hour weekly requirement. Who Should Apply This opportunity is suited to a precise, analytical writer who enjoys turning complicated requirements into practical instructions. It may be a strong fit for experienced technical writers, instructional designers, linguists, or AI evaluation professionals who can move confidently between domains without losing important nuance. The listing identifies the experience level as entry level, while the detailed requirements call for 3+ years of relevant professional experience and prior GenAI or RLHF guideline work. Applicants should review those requirements carefully before applying. You write with precision and care about consistency. You can anticipate edge cases and explain how raters should handle them. You are comfortable reviewing specifications for gaps and contradictions. You can adapt language for different industries and subject-matter standards. You communicate effectively with research, program, and subject-matter teams. #J-18808-Ljbffr OpenTrain AI

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Rater Guidelines Writer in Brooklyn, NY vacancy
  • Property Management IoT is seeking an AI-Assisted Tech Content Writing Intern to help create blogs, case studies, whitepapers, and marketing materials using AI tools. You will support content across channels and ensure brand consistency. You will research trending topics... 
    Suggested
    Remote job
    Internship

    Property Management IoT

    Brooklyn, NY
    1 day ago
  • $117.27k - $194.45k

     ...committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers... 
    Suggested
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA Services

    Jersey City, NJ
    21 days ago
  • $130k - $150k

    Our client is seeking a Staff Quality Engineer(Playwright/Typescript/AI - LLMs) to support the quality and validation of AI-powered products and platforms. This role focuses on testing LLM-based applications, agentic AI systems, and Retrieval-Augmented Generation (RAG)... 
    Suggested
    3 days per week

    Talener

    Hoboken, NJ
    1 day ago
  •  ...Harmonization), GCP (Good Clinical Practices), CenExel standard operating procedures, site working Practices, protocol, and company guidelines and policies. Assumes other duties and responsibilities as assigned. The above responsibilities are a general description of the... 
    Suggested
    Full time
    Work at office

    Cenexelresearch

    Brooklyn, NY
    3 days ago
  •  ...high-quality production code and maintains algorithms that run synchronously with appropriate systemsLeverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables... 
    Suggested

    JP Morgan Chase

    Jersey City, NJ
    5 days ago
  •  ...are seeking a highly detail-oriented and proactive Custom Entry Writer to join our dynamic logistics and compliance team. In this...  ...standards, FDA regulations, and trade compliance laws including OFAC guidelines Experience in logistics, supply chain management, freight... 

    ASAP LOGISTICS LTD

    Jamaica, NY
    a month ago
  •  ...Technical WriterThe Technical Writer is responsible for creating and producing in various output formats, technical and functional documentation...  ...and application of policies to Standard Operating Guidelines. The Technical Writer will make recommendations for change by using... 

    InfoPeople

    Long Island City, NY
    2 days ago
  • $20 - $50 per hour

    About OpenTrain OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. It helps professionals discover projects, build a profile that reflects their experience, and apply to opportunities in minutes. Creating an OpenTrain account... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work
    Worldwide
    Flexible hours

    OpenTrain AI

    Brooklyn, NY
    16 hours ago
  •  ...Advanced Research LLC (AFAR) is seeking an experienced Technical Writer to join our Enterprise Information Display System (E-IDS) team...  ...factors permitted by law. Posted pay ranges are a general guideline only and are not a guarantee of compensation or salary. EEO Statement... 
    Full time
    For contractors
    Work at office
    Relocation
    Work visa

    ASRC Federal

    Brooklyn, NY
    1 day ago
  •  ...their customers. We are looking for a Manufacturing Technical Writer to join our team in Austin, TX. As a uniquely qualified candidate...  ...documentation templates, terminology, visual standards, style guidelines, and workflows. Provide guidance to engineers and other subject... 
    Visa sponsorship
    Work visa

    Confluent Medical

    Brooklyn, NY
    2 days ago
  • $75k

    # Automotive Service Advisor / Writer | Up to $75K\* & Weekends Off | East WichitaWichita, KansasFull-time •permanent## Job OverviewAs...  ...of your information will be kept confidential according to EEO guidelines. Christian Brothers Automotive is an Equal Opportunity Employer... 
    Permanent employment
    Full time
    Local area
    Monday to Friday

    Christian Brothers Automotive Corporation

    Brooklyn, NY
    1 day ago
  •  ...LinkedIn. Responsibilities Under minimal supervision, the Medical Writer will critically evaluate, analyze, and interpret the medical...  ...of federal regulations, Good Clinical Practices, and ICH guidelines a plus Not required, but experience with orphan drug designations... 
    Remote job
    Worldwide

    MMS Holdings

    Jersey City, NJ
    1 day ago
  • Sr Medical Writer Publications - Sponsor Dedicated - Remote Based Syneos Health is a leading fully integrated biopharmaceutical solutions...  ...regulatory standards, including, but not limited to, ICH E3 guidelines, as well as company standard operating procedures, client... 
    Remote job
    Contract work
    Flexible hours

    Syneos Health/ inVentiv Health Commercial LLC

    Brooklyn, NY
    2 days ago
  • $65k - $75k

    Get AI-powered advice on this job and more exclusive features. This range is provided...  .... Role Overview: As an iQuanti Content Writer, you’ll be at the heart of crafting...  ...their expectations, branding, and compliance guidelines. Collaborate with Editors and Strategists... 
    Full time

    iQuanti

    Jersey City, NJ
    16 hours ago
  • $55k - $65k

     ...Quote and Proposal Writer - Environment Testing Full-time Compensation: USD 55,000 - USD 65,000 - hourly Eurofins Scientific is an international...  ...your information will be kept confidential according to EEO guidelines. Eurofins USA Environment Testing is a Disabled and Veteran... 
    Hourly pay
    Full time
    Contract work
    Part time

    Eurofins Viracor, Inc.

    Brooklyn, NY
    1 day ago
  • $71k - $76.5k

     ...available in our Boston office About the Role The Analyst and Medical Writer positions are ideal for recent graduates in the sciences, and...  ...of results, ensuring that the reviews conform to industry guidelines where applicable. You will also be involved in transforming the... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Immediate start
    Remote work
    Work from home
    Worldwide
    Flexible hours

    Costello Medical, Inc.

    Brooklyn, NY
    3 days ago
  •  ...|| | || | || --- | --- || | Senior Manager, Medical/Regulatory Writer || | VN831 || | Full Time || | Gaithersburg, MD, Radnor, PA, Remote...  ...studies. • Complying with internal and external processes and guidelines while managing the writing review process and resolving issues,... 
    Full time
    Contract work
    Remote work

    Immunocore

    Brooklyn, NY
    7 hours ago
  • $63.8k - $105.4k

     ...accurate vehicle / equipment damage appraisals, Actual Cash and Replacement values according to applicable regulatory and corporate guidelines. Partners with the assigned Claim Professional throughout the life of the claim. Partners from initial investigation through... 
    Contract work
    Local area
    Remote work

    Wells Media Group

    Brooklyn, NY
    16 hours ago
  • $65k - $85k

     ...Title: Grant Writer Unit: Development and Communications Reports to: Senior Director of Grants Status: Full-Time; Regular; Exempt Salary Range: $65,000 to $85,000 Annually Location: Long Island City, Queens Days/Hours: Monday - Friday 9:00am -... 
    Permanent employment
    Full time
    Monday to Friday

    FORTUNE SOCIETY INC

    Long Island City, NY
    2 days ago
  •  ...unified by a shared desire to make a difference in education. Come join us, and let's make change together. Job Description As a Product Writer you will: Write accurate and user-friendly in-product copy, comprising of: feature descriptions, user instructions, calls-to-action... 
    Local area
    Remote work

    DEV INC

    Staten Island, NY
    4 days ago
  •  ...Future Caucus is seeking a Contributing Writer for its Young Lawmakers’ Storybank on a six-month remote contract. You will own the editorial pipeline, conduct interviews with lawmakers from both parties, and produce 800-1,000 word pieces on a biweekly schedule. Ideal... 
    Contract work
    Remote work

    Future Caucus

    Brooklyn, NY
    3 days ago
  • The Inertia, a leading online publication dedicated to surf and snow, is looking for high-energy, creative wordsmiths with a passion for surf and the outdoors to write news, personality driven features, lifestyle stories, and opinion pieces. Responsibilities Write publication...

    AllGear Digital

    Brooklyn, NY
    1 day ago
  •  ...Role Overview As a Volunteer Grant Writer, you will research grant opportunities, craft persuasive proposals, and help manage the grant submission process. This role is perfect for someone who wants to use their writing and research skills to make a tangible difference... 
    Remote work
    Flexible hours

    Hunger Free America

    Brooklyn, NY
    3 days ago
  • $71k - $89k

     ...significant revenue insupportoffree civil legal services for vulnerable individuals and families. The ideal candidate is an exceptional writer and strategic thinker who brings demonstrated success in government grantprospecting and proposal development, with the ability to... 
    Work experience placement
    Work at office
    Local area
    Remote work

    Inside Philanthropy

    Brooklyn, NY
    5 days ago
  •  ...Job Summary The Customs Entry Writer is responsible for preparing, compiling and managing all documentation and records required to clear goods through the U.S. Customs and Border Protection (CBP), including negotiating with, retaining and service as an intermediary... 
    Overseas

    NNR Global Logistics USA, Inc.

    Valley Stream, NY
    5 days ago
  • Job Title Import Documentation Specialist Job Description We are the leading provider of worldwide smart end-to-end supply chain & logistics, enabling the flow of trade across the globe. Our comprehensive range of products and services covers every link of the...
    Full time
    Work at office
    Local area
    Worldwide

    DP World

    Jersey City, NJ
    5 days ago
  •  ...PA, US 23 days ago Requisition ID: 11341 Lifesteps, a non-profit agency based in Butler, PA is seeking a part-time talented Grant Writer to join the team. The position will work 24-28 hours per week, with the work being completed onsite during the weekdays - Monday through... 
    Part time
    Work at office
    Monday to Friday
    Weekday work

    Lifesteps of Western PA

    Brooklyn, NY
    5 days ago
  • $80k - $100k

     ...Senior Customs Entry Writer Position: Senior Customs Entry Writer Location: Valley Stream, NY Company/Industry: Well-established, small-sized & growing customs brokerage firm Schedule: Mon-Fri 1st shift, In-Office Only Salary: $80,000 - $100,000/yr, depending... 
    Work at office
    Day shift

    PrideStaff

    Valley Stream, NY
    3 days ago
  • $47.64k - $79.14k

     ...Overview Salary Range: $47,644-$79,141 Position Summary The Senior Entry Writer position works within the CHB team overseeing the correct and timely creation and transmission of CBP entries of key accounts. This position will have in-depth knowledge of customs... 
    Temporary work
    Work at office
    Local area
    Overseas
    Flexible hours

    Yusen Logistics

    Springfield Gardens, NY
    2 days ago
  • $28.85 - $31.25 per hour

     ...growth, purpose, and the chance to make a meaningful impact. This is more than a job. It’s a journey on which you rise.  Entry Writer $28.85 - $31.25 WHAT ARE YOU GOING TO DO Receive, review and process documentation for an assigned base of accounts, and... 
    Contract work
    Temporary work
    Work at office
    Flexible hours

    CMA CGM

    Springfield Gardens, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Rater Guidelines Writer. Be the first to apply!