LLM AI Quality Analysts

IMMEDIATE HIRING | LLM / AI QUALITY ANALYST

We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity.
Rate: $15/hr USD
Start Date: Immediately
Availability: 30–40 hours/week
PST Overlap: 4 hours required
Engagement: Contractor

Education: Bachelor’s or Master’s degree in IT or any IT-related field

Approved States:
Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, Wyoming.

Requirements

• Strong English reading and writing skills
• Strong analytical and attention-to-detail skills
• AI evaluation, data annotation, content moderation, or related experience preferred
• Ability to work independently in a remote environment
• Laptop/Desktop with reliable internet
• Willingness to use a primary personal Google account and enable personal data sources for the assessment

What You’ll Do

• Evaluate personalized AI/Gemini responses
• Create and test multi-turn prompts
• Assess AI responses for Grounding, Integration, and Helpfulness
• Compare model responses side-by-side
• Identify incorrect personalization, poor inferences, and hallucinations
• Provide detailed feedback and rationales

Interested?
Please send your updated resume + current location + availability to:

View email address on aiapply.co

This is a remote position.