AI Personal Assistant Quality Evaluator
Mercor
Obsidian in San Francisco is seeking advanced LLM power users to evaluate how AI systems perform on personalized, real-world life tasks. You will assess usefulness, realism, and practical success of AI responses in daily activities. Ideal candidates regularly use AI tools in their personal lives and can explain what makes outputs good or bad, including multi-step planning, research, and decision-making. 20–40 hours per week engagement is expected. #J-18808-Ljbffr Mercor
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Personal Assistant Quality Evaluator in San Francisco, CA vacancy
- Obsidian is hiring expert Evaluators in Public health communications for a remote position. The role involves reviewing and assessing AI-generated work products for accuracy and domain quality. Candidates must have 5+ years of experience, native or professional fluency...SuggestedRemote jobHourly payWork at office
- Mercor is seeking a contract Evaluator for nonprofit/philanthropy programs. This remote role focuses on assessing AI-generated artifacts and providing structured feedback to improve quality and rigor. You will identify factual and presentation errors, work with teams asynchronously...SuggestedRemote jobContract workWork at office
- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...SuggestedRemote jobHourly payWork at office
- Obsidian is seeking expert Evaluators in Training / onboarding / L&D to assess AI-generated documents and presentations. The role entails applying deep expertise to ensure accuracy and domain quality of outputs. This is a flexible, hourly remote position requiring over...SuggestedRemote jobHourly payWork at officeFlexible hours
- Mercor connects elite creative and technical talent with leading AI research labs. A remote contract role focuses on evaluating AI-generated artifacts against quality rubrics, identifying errors, and delivering structured feedback to support AI model improvements. Applicants...SuggestedRemote jobContract workWork at office
- Mercor connects elite creative and technical talent with leading AI research labs. The remote contract role evaluates AI-generated artifacts against domain-specific quality rubrics and provides clear, structured feedback to ensure accuracy and high presentation standards...Remote jobContract work
- ...elite creative and technical talent with leading AI research labs. A remote contract role as Customer success / support operations evaluator seeks a highly experienced professional to assess AI outputs against quality rubrics. The candidate will identify factual, aesthetic...Remote jobContract work
- ...seeking a remote Market research / competitive intelligence Evaluator to assess AI-generated artifacts against domain rubrics and provide... ...outputs. This role focuses on ensuring accuracy, rigor, and quality across diverse AI-produced documents #J-18808-Ljbffr mercorRemote jobContract workWork at office
- Mercor seeks a General business strategy / management evaluator for a remote, contract role. You will assess AI-generated artifacts, apply quality rubrics, and identify issues to help improve model performance. This role requires 5+ years in strategy/management, native...Remote jobContract workFor contractorsWork at office
- Mercor is hiring a contract Customer success / support operations Evaluator to assess AI-generated artifacts against domain-specific quality rubrics, identify errors in documents, spreadsheets, and slide decks, and provide structured feedback to improve AI outputs. You...Remote jobContract work
- Obsidian is seeking expert Evaluators in Data analysis to review AI-generated work products for accuracy and quality. The position involves applying subject-matter expertise to assess documents, spreadsheets, and slide decks. This is a remote, hourly engagement looking...Remote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations.Applicants must...Remote jobWork at office
- Obsidian is hiring expert Evaluators in General finance / accounting to review and assess AI-generated work for accuracy and domain quality. You will leverage your subject-matter expertise to grade outputs and provide structured feedback. This role requires over 5 years...Remote jobHourly payWork at office
- Obsidian is seeking expert Evaluators for a remote role focusing on Government and public administration. You will review AI-generated work products for accuracy and quality, applying your deep subject-matter expertise to grade outputs. The ideal candidate has over 5 years...Remote jobWork at office
- Obsidian is seeking expert Evaluators for program management and implementation planning to review AI-generated work for accuracy and quality. This is a remote hourly engagement requiring strong subject matter expertise. The ideal candidate will have over 5 years of experience...Remote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in San Francisco to review AI-generated documents and spreadsheets for accuracy. This role demands deep expertise... ...English. As a remote, hourly engagement, you will evaluate quality using specific rubrics and provide structured feedback...Remote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in Training / onboarding / L&D to assess AI-generated documents for accuracy and quality. Candidates should have over 5 years of experience, be fluent in English, and proficient in Microsoft Office and Google Workspace. This remote,...Remote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in Healthcare operations to review and assess AI-generated work products for accuracy and quality. This role requires a strong knowledge of healthcare operations and proficiency in Microsoft Office and Google Workspace. Ideal candidates...Remote jobHourly payWork at officeFlexible hours
- Obsidian is seeking expert Evaluators in Software Engineering to review AI-generated slides, spreadsheets, and documents for real-world quality. You will apply deep subject-matter expertise to grade outputs and provide actionable feedback in a clear, structured format....Hourly payWork at officeRemote work
- Obsidian is hiring expert Evaluators in Nonprofit and philanthropy to review and assess AI-generated work products for accuracy and quality. You will apply deep subject-matter expertise to grade outputs. This position is remote, requiring 5+ years of relevant experience...Remote jobWork at office
$80 - $120 per hour
Mercor is seeking a Software / AI / IT / data Evaluator for contract work. The role is remote and pays $80-$120 per hour. You will assess AI outputs... ...errors, and provide structured feedback to improve quality. Requirements include 5+ years in Software/AI/IT/data, native...Remote jobHourly payContract work- Obsidian is seeking expert Evaluators in Personal finance / consumer planning to assess AI-generated work products for accuracy and quality. You will leverage your expertise in financial planning to evaluate documents, spreadsheets, and presentations. This role is remote...Remote jobHourly payWork at office
- Mercor seeks a Media / journalism / communications Evaluator to assess AI-generated artifacts against domain rubrics, drawing on a strong media background. This remote contract role requires clear, precise feedback and independent work to help improve model outputs. Responsibilities...Remote jobContract work
- YO AI Labs seeks an AI Evaluation Specialist to assess enterprise AI outputs on a contractual, remote basis across the US, Canada, UK, Ireland, Australia, and New Zealand. You will apply rubrics, identify weaknesses, and provide concrete feedback to improve systems. The...Remote job
- Obsidian is looking for an AI Evaluator to assess and improve AI-generated responses. This role involves identifying strengths and weaknesses in AI-generated content, ensuring quality and adherence to conversational guidelines. Ideal candidates are native Odia speakers...Contract work
- Mercor is seeking an evaluator for nonprofit/philanthropy programs in a remote, contract role. You will assess AI-generated artifacts against quality rubrics, identify factual and presentation errors, and deliver concise feedback. Deep domain expertise will guide grading...Remote jobContract workWork at office
- Obsidian is looking for expert Evaluators in People ops / recruiting to review AI-generated work products for accuracy and quality. This remote position requires at least 5 years of relevant experience and fluency in English. The role involves evaluating artifacts against...Remote jobWork at office
- Obsidian is seeking expert Evaluators in Market research / competitive intelligence to review AI-generated documents, spreadsheets, and slide decks for accuracy. This... ...fluency in English.You'll evaluate outputs against quality rubrics, identify errors, and provide structured...Remote jobWork at office
- Obsidian is looking for expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy and quality. Candidates should have over 5 years of relevant experience and fluency in English. This remote position requires proficiency in Microsoft...Remote jobWork at office
- Mercor is seeking a Music & Lyrics Expert (Vietnamese) for a remote, contract-based role. Evaluate AI-generated music and lyrics in Vietnamese and English, rate quality, and compare lyrics to published songs to inform model improvement. Work asynchronously up to 6 months...Remote jobContract workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Personal Assistant Quality Evaluator. Be the first to apply!
Related searches
- caregiver personal assistant cna San Francisco, CA
- remote personal assistant San Francisco, CA
- personal assistant San Francisco, CA
- quality evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- education evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- personal security San Francisco, CA