Conversation Quality Analyst
Alignerr
Conversation Quality Analyst (AI Training) What if your instinct for natural conversation could directly influence how millions of people experience AI every day? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human — clear, helpful, and natural. This is a fully remote, flexible contract role open to anyone with sharp language instincts and a critical eye. No AI, linguistics, or technical background required — just a strong feel for how good conversation works. Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10–40 hours/week What You’ll Do Read and evaluate AI-generated conversations across a wide range of topics and contexts Rate responses for naturalness, tone, helpfulness, and conversational flow Identify awkward phrasing, off-topic replies, logical inconsistencies, or robotic-sounding language Compare multiple conversation paths and rank them by overall quality Submit structured, detailed evaluations using provided rubrics and rating tools Work independently and asynchronously on your own schedule Who You Are Strong reading comprehension and a natural sense for how conversation should flow Able to assess dialogue quality objectively and explain your reasoning clearly Detail-oriented and consistent — you apply the same standard across large volumes of work Self-motivated and reliable when working independently Comfortable working through high volumes of text-based tasks No prior AI, linguistics, or tech experience required Nice to Have Background in writing, editing, communications, or customer-facing roles Experience with quality assurance, content review, or critical analysis Familiarity with AI chatbots or conversational tools as an end user Why Join Us Work on cutting-edge AI projects alongside leading research labs Fully remote and flexible — work when and where it suits you Freelance autonomy with the structure of meaningful, task-based work Contribute to AI development that directly shapes how technology communicates with the world Potential for ongoing work and contract extension as new projects launch #J-18808-Ljbffr
- A data evaluation company is seeking an LLM - AI Quality Analyst (Personalization) skilled in Greek for a short-term, part-time role. Responsibilities... ...include evaluating the effectiveness of AI-generated conversations using personalization features and analyzing responses for...SuggestedRemote jobTemporary workPart time
- ...culture where all of our employees feel respected, valued and have an opportunity to contribute to the company’s success. As a Quality Analyst within PNC's TM Operations Production Support organization, you will be based remotely anywhere in the United States. The work...SuggestedWork experience placementWork at officeRemote workMonday to Friday
$40 - $60 per hour
HIM Analyst (Epic, MPI conversion) (Remote) DESCRIPTION: We require an experienced HIM analyst to support our client. Skills: The candidate should have 5 years experience working within Epic and have been involved in past implementations Prefer candidate with MPI conversion...SuggestedHourly payContract workRemote work$55k - $65k
Primary Functions Reporting to the Mobile Team Lead, the Quality Assurance Analyst’s key responsibilities will include: Create, maintain, and execute test plans, test cases, and test scripts for new features, bug fixes, integrations, customer scenarios, and release validation...SuggestedFull timeWork at officeRemote work$60k - $85k
...related experience Or an equivalent combination of education and experience Principal Duties & Responsibilities • Monitors quality indicators with a proactive approach and takes steps to reduce deficiencies. • Identifies and corrects process gaps within service...SuggestedWork at officeRemote workWork from homeFlexible hours- ...revenue. Our AI-native platform powers event lead capture, enrichment, and real-time CRM sync, transforming every badge scan into a high-quality, actionable lead. In a world where digital channels are saturated, we're building the infrastructure that makes in-person GTM...Full timeRemote work
$15 per hour
...Turing is seeking an AI Quality Analyst based in New York to evaluate a new personalization feature for Gemini. The ideal candidate will possess proficiency in Polish and demonstrate exceptional analytical thinking to assess AI model responses effectively. The role involves...Hourly payFor contractorsRemote work- ...Position Overview The Contact Center Quality Analyst (CCQA) is responsible for auditing member and provider interactions across Harbor Health's contact center channels — phone, email, chat, and text — to evaluate adherence to quality standards, operational workflows, and...
- ...Quality Analyst – Enterprise Document Automation (EDA) *3rd Parties — Do Not Contact New York City Department of Social Services (DSS) About DSS The New York City Department of Social Services (DSS) provides critical programs that help millions of New Yorkers access food...Full timeContract workLocal area
- ...processes. Provides installation, network access, control and troubleshooting for computers. Looking for a skilled and experienced Quality analyst (tester). Responsibilities Analyzing business requirements and develop detailed test plans, test scenarios and test cases....Contract work
$64k - $80k
...Scheduled Hours 8:30 AM-5 PM Scheduled Daily Hours 7.5 HOURS Pay Range $63,999.94-$79,999.92 Position Summary The Rose F. Kennedy Center's Quality Improvement (QI) Coordinator is responsible for implementing and coordinating the Quality Management program of the Developmental...Shift work- ...from everyone else. Demonstrate innovative solutions to our clients. Join Barrow Wise Consulting, LLC today. Responsibilities The Quality Analyst 1 will support Barrow Wise's NYC Department of Social Services project and perform the following duties: Initiate and implement...
$48.6k - $83.16k
...Summary of Position Responsible for assessing the quality of performance of employees who handle calls from our existing and potential members, providers, patients and customers. Provide full evaluation and feedback on customer service skills and call...Work experience placement- ...A tech company is seeking an LLM – AI Quality Analyst (Personalization) to work remotely. This short-term contract role requires proficiency in Vietnamese and strong experience in data annotation and AI evaluation. You will design multi-turn prompts, assess AI responses...Temporary workRemote work
- ...Job Title Quality Analyst (Remote, Work at Home) Overview Sagility combines industry-leading technology and transformation-driven BPM services with decades of healthcare domain expertise to help clients draw closer to their members. The company optimizes the entire member...Temporary workImmediate startRemote workWork from homeFlexible hours
$65k - $75k
...train key production employees and supervisors on new work‑recording procedures and manufacturing processes. Work closely with the Quality Manager to help develop and maintain qualified personnel within the plant, including organizational development, training, direction...Night shift- ...ideal candidate is a self-starter with strong technical aptitude and exceptional communication skills, capable of ensuring the highest quality across our mobile and hardware products. What You'll Do Execute comprehensive manual QA testing across Android and iOS platforms...
- ...release of information/medical records and contactless patient intake solutions which utilize Web/API/Mobile technologies. The Quality Assurance Analyst will ensure the delivery of high-quality products by writing test scripts cases in Azure and reporting issues. You will be...
$48k - $52k
...Quality Analyst Location: US based - Parsippany NJ preferred Who We Are Ipsos is one of the world's largest research companies and currently the only one primarily managed by researchers, ranking as a #1 full-service research organization for four consecutive years. With...Work experience placementWork at officeRemote workFlexible hours$60.6k - $120.75k
...Overview This position is for a Quality Analyst within the Undersea Warfare market segment (USW), supporting the MK48 Production Programs. This position will require on-site support for the Syracuse facility. Responsibilities Consolidate and analyze defect data to support...Full timeTemporary workRelocationFlexible hoursShift work3 days per week- ...butter? Do you like a role that keeps you on your toes? If you answer “yes” to any of these questions, then join our team of Quality Analysts! At Willson International, we’re creating an environment that empowers our people to reach their full potential, while embracing...Remote workWork from homeMonday to FridayShift work
- Dane Street, LLC is hiring a Peer / Record Review Quality Analyst responsible for managing medical file reviews and ensuring client standards are met. The ideal candidate must have strong communication skills, an educational background in healthcare or business, and the...Remote jobWork from home
$20 per hour
...seeking a Freelance Contractor to train AI models. In this remote role, you will evaluate the outputs of AI chatbots and ensure their quality. Ideal candidates should be fluent in English and detail-oriented, with a preference for those holding a Bachelor's degree. The...Remote jobHourly payFor contractorsFreelance- ...testing, and delivery. Since 1957, we have been known for our high‑quality, custom‑built control packages, our comprehensive service, and... ...and experienced Global QMS (Quality Management System) Analyst. The Global QMS Analyst is responsible for supporting, maintaining...Work experience placementWork at officeWorldwide
- ...A mobile app testing company is seeking a Beginner QA Analyst to review and enhance user experiences in mobile apps. This remote role involves testing apps by installing them, evaluating their performance, and providing valuable feedback. Perfect for those passionate about...Remote workFlexible hours
- ...Quality Assurance Analyst The NYC Department of Consumer and Worker Protection (DCWP) protects and enhances the daily economic lives of New Yorkers to create thriving communities. DCWP licenses nearly 45,000 businesses in more than 40 industries and enforces key consumer...
- ...A leading data and analytics firm seeks a talented Data Quality Analyst to ensure the accuracy and completeness of data across the organization. This full-time role involves validating data, setting up alert systems, and advocating for improvements in data quality. The...Full timeRemote work
$80 per hour
A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies...Remote workFlexible hours$35 per hour
...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing media...Remote work10 hours per week$65.65k - $118.68k
...The Leidos National Airspace Systems Integration Support (NISC) Program is looking for a part-time Quality Assurance Specialist to support the Federal Aviation Administration’s (FAA) William J. Hughes Technical Center for Advanced Aerospace in Atlantic City, New Jersey...Part timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Conversation Quality Analyst. Be the first to apply!
- remote call center quality analyst New York, NY
- quality analyst New York, NY
- quality improvement analyst New York, NY
- quality assurance quality control engineer New York, NY
- quality equipment New York, NY
- quality rater New York, NY
- vice president of quality New York, NY
- water quality scientist New York, NY
- quality reviewer New York, NY
- aerospace quality New York, NY

