AI Quality Analyst
Virtual Vocations Inc
To enhance personalized AI experiences, the full-time English AI Quality Analyst will design and evaluate multi-turn prompts, assess AI responses for relevance and helpfulness, and provide evidence-based rationales, all while working remotely. Key responsibilities Design and execute short, multi-turn prompts requiring meaningful personalization Compare AI responses and evaluate their grounding, integration, and helpfulness Write clear rationales that reference specific conversational turns and review debug information Required qualifications Bachelor's degree or equivalent practical experience in an analytical field Strong English reading and writing ability Willingness to use a personal Google account Ability to work independently on a remote team with a reliable computer and internet connection Excellent analytical judgment and attention to detail Virtual Vocations Inc
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Quality Analyst in New York, NY vacancy
- Quality Analyst We're hiring Quality Analysts on a contract basis to help ensure the accuracy, consistency, and reliability of data. You'll play a key role in reviewing outputs, flagging issues, and helping us maintain a high bar for quality across projects. What You'll...SuggestedContract workPart timeRemote work
$15 per hour
...leading research accelerator for frontier AI labs and a trusted partner for global... ...accelerating frontier research with high-quality data, advanced training pipelines, plus top... ...the P&L. Role Overview As an AI Quality Analyst, you will evaluate a new personalization...SuggestedRemote jobHourly payFull timeFor contractorsLocal area- AI Quality Analyst This is a remote position. AI Quality Analyst Reporting to Manager, Quality Engineering & AI Validation, focuses on validating the quality of AI-generated outputs, agent behaviors, and AI-assisted workflows. Builds benchmark scenarios, defines scoring...SuggestedRemote work
- A leading AI research accelerator seeks an AI Quality Analyst in Honolulu. You will evaluate a new personalization feature for AI, requiring Japanese proficiency and strong analytical skills. Your role involves designing prompts, assessing model responses, and providing...SuggestedRemote jobFor contractors
- ...credit risk tools. You will manage data acquisition, processing, and quality monitoring while producing analytical reporting for stakeholders... ...Moody's Banking Group to improve data operations and leverage AI-powered solutions for risk assessment. #J-18808-Ljbffr Moody'sSuggested
$35 per hour
A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing media...Remote job10 hours per week$80 per hour
A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies...Remote jobFlexible hours- Filevine is seeking an experienced QA professional to own AI-driven quality initiatives and drive end-to-end testing across AI workflows. You will mentor QA teammates and partner with Product and Engineering to ensure reliable, compliant software releases. With 7+ years...Remote job
$38 per hour
...The Bridge Between Human Judgment and AI Excellence Are you an experienced QA professional who knows how to mentor others and... ...a high bar for data integrity? Welo Data is seeking Data Quality Analysts for Project Perseus . This isn't just about labeling; you...Hourly payFull timeWork at officeShift workWelo Data
New York, NYmore than 2 months ago$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for those with strong analytical and detail-oriented skills. Responsibilities include reviewing evaluation tasks, identifying inconsistencies, and...Remote jobFlexible hours- An environmental consulting firm is looking for Environmental Scientists and Specialists to provide expertise in refining AI systems. This role involves analyzing various environmental datasets, contributing to risk assessments, and collaborating with technical teams....Remote jobFlexible hours
$38 per hour
...Data Quality Analyst Welo Data is looking for experienced, detail-oriented professionals to join our team as Data Quality Analysts. This... ..., but done right. You'll work closely with both people and AI systems — auditing outputs, supporting day-to-day execution, and...Full timeContract workRemote workVisa sponsorshipWelocalize
New York, NY2 days ago$100 per hour
Obsidian is collaborating with a leading AI organization to engage credentialed finance professionals for a project focused on enhancing AI systems. The role offers flexible scheduling and independent contractor arrangements, with compensation ranging from $100 to $200...Remote jobHourly payFor contractorsFlexible hours$40 - $60 per hour
...change takes place. Kira's mission is to harness transformative AI technologies to make world-class personalized teaching and learning... ...Associates (NEA), Andrew Ng's AI Fund, and Primavera. Quality is critical to ensuring teachers and students can rely on our product...Hourly payContract workLive inWork at officeLocal areaKira Learning
New York, NY4 days ago$100 per hour
...work independently, quickly learn complex systems, and ensure high-quality software through comprehensive manual testing. This role... ...fit? Apply to learn more! We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...WorldwideFlexible hoursUS Mobile
New York, NY4 days ago$38 per hour
...Description Join the Human Intelligence Behind the World’s Leading AI – NYCAre you sharp, curious, and obsessed with the details? Welo Data is looking for Data Quality Analysts who can go beyond simple labels to help define how AI should behave in the real world.This...Full timeWork at office- Lightcast seeks a Data Analyst (Arabic) to support multilingual data quality across global markets. You will work with Linguistics and Engineering to develop parsers and translate taxonomies, ensuring high-quality data delivery to customers. Responsibilities include analyzing...Full timeContract workFor contractors
$21.4 - $27 per hour
TELUS Digital is seeking an Ads Quality Analyst for a remote role, primarily working from California, Oklahoma, or New York. You'll collaborate with engineers to enhance advertising quality through data monitoring, administrative tasks, and problem resolution. This position...Remote jobPermanent employmentTemporary work$80k - $115k
A leader in industrial safety solutions is seeking a Senior Analyst for Data Management and Analysis. This remote position focuses on EHS, ESG, and Quality compliance, requiring expertise in data collection and visualization tools like Power BI, Python, and SQL. Candidates...Remote job- ...We are seeking a Freelance Apparel Quality Analyst / Data Analyst to support product quality strategy within a fast-paced retail environment. This role will focus on data collection, customer insights, quality analytics, reporting, and cross-functional coordination. The...Hourly payContract workTemporary workFreelanceWork at officeImmediate start3 days per week
Solomon Page
New York, NY22 days ago $38 per hour
...experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality —... ..., but done right. You'll work closely with both people and AI systems — auditing outputs, supporting day-to-day execution, and...Full timeContract workRemote workVisa sponsorship$153k - $179k
...the way. The Opportunity at Komodo Health Quality is at the heart of everything that Komodo... ...Komodo’s Data Products.Our data quality analysts support, investigate, and solve tangible... ...systems such as Git/GitHubExpectations of AI Use in this role (required):Ability to leverage...For contractorsWork experience placementWork at officeLocal areaRemote workFlexible hours- ...Team, the creative team behind Spotify’s AI voice experiences. We think about AI voices... ..., and work closely with Speak to set the quality bar for AI voice models across... ...Chat and more. As a Senior Product Quality Analyst, you’ll bring a dedicated evaluation perspective...Full time
- Custom Processing Services is seeking a Quality Technician in Pennsylvania to ensure manufactured products meet customer requirements through rigorous testing and analysis. Candidates should hold a Bachelor’s degree in Chemistry or a related field and possess exceptional...
$78.06k - $117.1k
Health Payer Data Governance Technical Analyst We're seeking a highly skilled and experienced Health Payer Data Governance Technical Analyst... ...for driving data governance initiatives and ensuring the quality, integrity, and security of our organization's data assets specific...Temporary workWork experience placementLocal areaWork from home- ...testing of applications to ensure functionality, reliability, and quality. Create and maintain test scripts, standards, guidelines, and... ...and prioritize critical ADA defects. Collaborate with Business Analysts and Clients to understand requirements and provide feedback....
- cargo.one is seeking a Content Operations QA Analyst (Ocean) to ensure accurate pricing data for ocean freight. This role involves quality-checking contracts and rates, maintaining high-quality master data, and communicating with vendor partners to resolve discrepancies...Remote jobHome office
- ...Job Summary: We are seeking Quality Analyst for Onsite Assignments in New York, NY to support the State of New York's Department of Social Services (DSS) in various critical IT initiatives. The ideal candidates should have at least 4+ years of experience in QA methodologies...
Macpower Digital Assets Edge
New York, NY2 days ago - ...Quality Analyst 1 Enjoy problem-solving, need a venue to display your creativity, and emerging technologies pique your interest; if so, Barrow Wise Consulting, LLC is for you. As a multi-disciplined leader, you understand the gifts that set you apart from everyone else...
Barrow Wise Consulting, LLC
New York, NY1 day ago - ...Senior Quality Analyst Location- Dallas, TX and San Ramon, CA and New York city, NY Experience- 10+ Years Customer – Centene We... ...quality risks, and release readiness. Use Windsurf and other AI-assisted engineering tools to accelerate test-case creation,...Contract work
Argyle Infotech
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Quality Analyst. Be the first to apply!
Related searches
- quality analyst New York, NY
- quality improvement analyst New York, NY
- remote call center quality analyst New York, NY
- quality facilitator New York, NY
- water quality New York, NY
- quality inspection New York, NY
- quality rater New York, NY
- quality distribution New York, NY
- air quality New York, NY
- quality reviewer New York, NY