Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Chatbot Tester

AI Support Positions

AI Chatbot Tester

MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are powered by both on-site and remote agents, leveraging advanced technologies to enhance customer journeys, drive scalability and reduce costs.

At MCI we are committed to fostering an environment where professionals can build meaningful careers, access continuous learning and development opportunities and contribute to the success of a globally expanding, industry-leading organization.

We are seeking an AI Chatbot Tester to evaluate, validate, and improve AI-powered chatbot and conversational AI solutions. This role focuses on ensuring chatbot responses are accurate, reliable, compliant, and aligned with business requirements and user expectations.

The successful candidate will play a key role in maintaining quality standards and enhancing customer experiences across AI-driven interactions.

Position Responsibilities

Chatbot Testing & Validation

  • Execute test plans and chatbot evaluation scenarios.
  • Assess response quality and conversational effectiveness.
  • Validate chatbot functionality across use cases.
  • Identify defects, inconsistencies, and performance issues.

Quality Assurance

  • Conduct regression and user acceptance testing.
  • Verify compliance with business requirements.
  • Document test results and findings.
  • Support issue resolution activities.

Conversation Analysis

  • Review chatbot interactions and user journeys.
  • Identify gaps in conversational flows.
  • Recommend improvements to responses and workflows.
  • Analyze trends and recurring issues.

Collaboration & Reporting

  • Work closely with AI trainers and prompt engineers.
  • Provide testing feedback to development teams.
  • Participate in quality review sessions.
  • Prepare reports and performance insights.

Continuous Improvement

  • Support chatbot optimization initiatives.
  • Contribute to testing standards and best practices.
  • Stay informed about conversational AI developments.
  • Assist with evaluation framework improvements.
Candidate Qualifications

All positive, and driven applicants are encouraged to apply. The Ideal candidates for this position are highly motivated and dedicated and should possess the below qualities:

  • Diploma or Bachelor's Degree in Information Technology, Quality Assurance, Communications, Business, or related field.
  • Experience in software testing, QA, customer experience, or chatbot evaluation.
  • Strong attention to detail.
  • Excellent written communication skills.
  • Analytical and problem-solving abilities.
  • Experience documenting defects and test outcomes.
  • Ability to follow testing methodologies and processes.
  • Strong organizational skills.
  • Ability to work independently and collaboratively.
  • Basic understanding of AI and chatbot technologies.
  • Experience using productivity and reporting tools.
  • Customer-focused mindset.

Nice to Have

  • Experience testing AI chatbots or virtual assistants.
  • Knowledge of prompt engineering principles.
  • Familiarity with Generative AI technologies.
  • Experience with QA management tools.
  • Exposure to conversational design principles.
  • Knowledge of user experience testing methodologies.
  • Experience within technology or BPO environments.
  • Understanding of AI evaluation metrics.
Physical Requirements

This job operates in a professional office environment. While performing the duties of this job, the employee will be largely sedentary and will be required to sit/stand for long periods while using a computer and telephone headset. The employee will be regularly required to operate a computer and other office equipment, including a phone, copier, and printer. The employee may occasionally be required to move about the office to accomplish tasks; reach in any direction; raise or lower objects, move objects from place to place, hold onto objects, and move or exert force up to forty (40) pounds.

Conditions of Employment

All MCI Locations

  • Must be authorized to work in the country where the job is based.

Subject to the program and location of the position

  • Must be willing to submit up to a LEVEL II background and/or security investigation with a fingerprint. Job offers are contingent on background/security investigation results.
  • Must be willing to submit to drug screening. Job offers are contingent on drug screening results. (Does not apply in Canada)
Reasonable Accommodation

Consistent with the Americans with Disabilities Act (ADA), it is the policy of MCI and its affiliates to provide reasonable accommodations when requested by a qualified applicant or employee with a disability unless such accommodations would cause undue hardship. The policy regarding requests for reasonable accommodation applies to all aspects of employment. If reasonable accommodations are needed, please contact Human Resources.

Equal Opportunity Employer

At MCI and its subsidiaries, we embrace differences and believe diversity is a benefit to our employees, our company, our customers, and our community. All aspects of employment at MCI are based solely on a person's merit and qualifications. MCI maintains a work environment free from discrimination, one where employees are treated with dignity and respect. All employees share in the responsibility for fulfilling MCI's commitment to a diverse and equal opportunity work environment.

MCI does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. MCI will consider for employment qualified applicants with criminal histories in a manner consistent with local and federal requirements.

MCI will not tolerate discrimination or harassment based on any of these characteristics. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of MCI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations, and ordinances where an employee works.

About MCI (Parent Company)

MCI helps customers take on their CX and DX challenges differently, creating industry-leading solutions that deliver exceptional experiences and drive optimal performance. MCI assists companies with business process outsourcing, staff augmentation, contact center customer services, and IT Services needs by providing general and specialized hosting, software, staff, and services.

In 2019, Marlowe Companies Inc. (MCI) was named by Inc. Magazine as Iowa's Fastest Growing Company in the State of Iowa and was named the 452nd Fastest Growing Privately Company in the USA, making the coveted top 500 for the first time. MCI's subsidiaries had previously made Inc. Magazine's List of Fastest-Growing Companies 15 times, respectively. MCI has ten business process outsourcing service delivery facilities in Georgia, Florida, Texas, New Mexico, California, Kansas, Nova Scotia, South Africa, and the Philippines.

Driving modernization through digitalization, MCI ensures clients do more for less. MCI is the holding company for a diverse lineup of tech-enabled business services operating companies. MCI organically grows, acquires, and operates companies that have synergistic products and services portfolios, including but not limited to Automated Contact Center Solutions (ACCS), customer contact management, IT Services (IT Schedule 70), and Temporary and Administrative Professional Staffing (TAPS Schedule 736), Business Process Management (BPM), Business Process Outsourcing (BPO), Claims Processing, Collections, Customer Experience Provider (CXP), Customer Service, Digital Experience Provider (DXP), Account Receivables Management (ARM), Application Software Development, Managed Services, and Technology Services, to mid-market, Federal & enterprise partners. MCI now employs 10,000+ talented

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Chatbot Tester in United States vacancy
  • $40 - $120 per hour

     ...AI Chatbot Tester $40-120/hr Remote Freelance GENERAL About the Role What if your curiosity and critical eye could help shape the future of artificial intelligence? We're looking for AI Chatbot Testers to put cutting-edge AI systems through their paces — having... 
    Suggested
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    Flexible hours

    Alignerr

    United States
    2 hours ago
  •  ...Trigyn's direct government client has an immediate need for Senior Tester in Albany, NY. Description: The Senior Tester will perform functional, integration, API, microservice, AI-tool, and MCP validation to ensure reliable and secure read/write data exchange.... 
    Suggested
    Immediate start

    Trigyn Technologies, Inc.

    Albany, NY
    4 days ago
  •  ...AI Agent Evaluation Specialist This project aims to test and evaluate one AI agent in the development stage. By asking questions and requests, based on various categories (the training is provided), you will try to force the AI agent to say something harmful, offensive... 
    Suggested
    Full time
    Remote work

    TSMG

    United States
    1 day ago
  • $40 - $42 per hour

     ...Job Description Job Description Requisition ID: 102547-1 Title: AI Agentic Tester Duration: 6-12 Months Location: Denver CO 80221 Salary Range: $40-$42 per hour on W2/C2C Job Description: Skills: QA/Test Engineering experience Must have- Experience... 
    Suggested
    Hourly pay

    Artech LLC

    Denver, CO
    22 days ago
  • $70 per hour

    Mindrift (Toloka) invites US-based participants to record short videos at home for a smart-TV AI project. You’ll use an iPhone and a living room setup, following step-by-step YouTube instructions, and upload everything via the Mindrift app. This is a one-time task with... 
    Suggested

    Mindrift (Toloka)

    New York, NY
    1 day ago
  • $15 - $30 per hour

     ...prompt for Seedance, Kling, Wan and Grok Imagine, which you can edit and then use to generate your own video. It also runs a library of AI video prompts we've actually tested. Each one is shown with the real output clip and a note on what the model followed and what it... 
    Freelance
    Remote work
    Worldwide

    VideoCreate

    New York, NY
    4 days ago
  •  ...app by acting as a real user, generating authentic data, and documenting user journeys across platforms. Your feedback will help train AI systems to better understand user behavior in grocery and restaurant discovery contexts. Ideal candidates are active food delivery... 
    Remote job
    For contractors

    Remotebridge

    New York, NY
    1 day ago
  • Systechcorp Inc. is seeking an Informatica Lineage Tester for a remote, full-time engagement. The role requires 5+ years of experience with...  .... Proficiency in front-end and back-end testing, and leveraging AI tools in testing is a plus. #J-18808-Ljbffr Systechcorp Inc
    Remote job
    Full time

    Systechcorp Inc

    New York, NY
    1 day ago
  • Vettedlance is seeking a remote, part-time contractor to help test AI chatbots by writing realistic prompts and rating responses for usefulness and accuracy. You will conduct short multi-turn conversations with several chatbots and submit transcripts and structured judgments... 
    Remote job
    Part time
    For contractors

    Vettedlance

    New York, NY
    21 hours ago
  • micro1 is seeking a contractor for the role of Food Delivery App User Tester in the United States. This position focuses on contributing high-quality, real-world input to train AI systems, with emphasis on clear feedback and independent remote work. You will use your existing... 
    Remote job
    For contractors

    Micro1

    New York, NY
    1 day ago
  • TSMG is seeking a remote, full-time Project Coordinator for a multi-month AI safety testing initiative. You will generate prompts, evaluate outputs for potential harms, and report daily progress to a supervisor from a home office. Training will be provided and collaboration... 
    Remote job
    Full time
    Home office

    Tsmg

    New York, NY
    2 days ago
  • Lionbridge AI is seeking Irish speakers for a remote, part-time AI testing project. You will help test and improve an AI tool by following simple instructions and reporting results with clear feedback. Ideal candidates are proficient in Irish and English, comfortable with... 
    Remote job
    Part time
    Flexible hours
    3 days per week
    1 day per week

    Lionbridge AI

    New York, NY
    3 days ago
  • $70 per hour

     ...Integration and End to End testing. Understanding of Ruby test automation and Jira. Strong written and verbal communication skills is a must. Desirable Skills: Keyword: Skills: Digital : Artificial Intelligence(AI)~Playwright~Selenium Experience Required: 6-8

    Q1 Technologies, Inc

    Aurora, IL
    22 days ago
  • $20 per hour

    Job Description Job Description Company Overview Kett Engineering is a well-established company with over 60 years of experience, specializing in automotive testing and development. Renowned for our commitment to quality and customer service, we support leading ...
    Daily paid
    Contract work
    Worldwide
    Monday to Friday
    Flexible hours

    Kett Engineering

    Chandler, AZ
    24 days ago
  • $25 - $45 per hour

     ...you’ll receive the offer and complete onboarding. You’ll begin tasking as soon as tasks are assigned. You’ll need: An active personal AI assistant account (Plus tier), active Muse and Dots access, a smartphone that can screen record, and a payment card you can use for... 
    Contract work
    Work at office
    Immediate start
    Remote work

    HumanitApp

    New York, NY
    3 days ago
  • Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills... 
    For contractors

    Remotebridge

    New York, NY
    4 days ago
  • $85 per hour

    Category: Enterprise Workflow & Tool Use · Pay: $85 / hr · Location: Remote — US-eligible · Contractor Everyday AI Agent Tester is a remote review track for evaluating AI outputs across everyday ai agent tester specialist operations workflows. Reviewers grade workflow... 
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    Auraone

    New York, NY
    1 day ago
  • Xperteez Technology Pvt Ltd in the United States is seeking an AI Agent Tester to evaluate real-world tasks across two AI agents, using your own device and accounts. You will observe flows, record outcomes, and provide clear feedback. This contract role emphasizes attention... 
    Remote job
    Contract work
    Flexible hours

    Xperteez Technology Pvt Ltd

    New York, NY
    1 day ago
  • YO AI Labs is seeking U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. Test two AI agents using your own accounts and smartphone, assess performance, and provide feedback to improve real-world usability. Responsibilities include testing... 
    Remote job

    YO AI Labs

    New York, NY
    2 days ago
  • micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your own phone and accounts, with screen recording and detailed feedback on agent performance. You will run scenarios such... 
    For contractors

    Micro1

    New York, NY
    3 days ago
  • $25 - $45 per hour

    Zekai is seeking an AI Agent Tester to evaluate real-world AI assistants on everyday tasks. This is a 100% remote contractor role based in the United States, with pay of $25-45 per hour and onboarding within 24-48 hours of selection. You will run real-life scenarios with... 
    Remote job
    Hourly pay
    For contractors

    Confidential

    New York, NY
    3 days ago
  • Job Title: AI Agent Tester - Real-World Tasks Role Type: Contractor Location: United States Job Summary We are seeking detail-oriented, U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. You will test two AI agents using your own accounts and... 
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    New York, NY
    2 days ago
  • $25 - $45 per hour

    Test two AI agents on everyday tasks such as bookings, shopping, forms, and returns using your smartphone. This remote U.S. contractor role pays $25 to $45 per hour. Remote Hourly · $25-$45/hr $25-$45/hr Compensation Contract, part-time Engagement Remote Location... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Work at office
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • $93.82k - $131.5k

     ...part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Tester - Healthcare Data & AI Validation - Remote to join our team in Philadelphia, Pennsylvania (US-PA), United States (US). Data Engineer... 
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA Services

    Remote
    1 day ago
  • OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user... 
    Remote job
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • Vettedlance is seeking a part-time, remote contractor to craft realistic customer-support conversations for AI voice agents and assess how well AI responses handle real-world calls. You will also schedule and record outcomes of calls, including reservations and confirmations... 
    Remote job
    Hourly pay
    Weekly pay
    Part time
    For contractors
    Shift work

    Vettedlance

    New York, NY
    21 hours ago
  •  ...ready to accept new challenges. Project Description We are looking for participants to take part in a one-time testing session of an AI Assistant system in a car. Your role will help improve voice-command functionality and user experience for future in-car technologies... 
    Part time

    TSMG Holding

    Dallas, TX
    2 days ago
  • Service Measure is seeking participants for a one-time, part-time testing session of an AI Assistant system in a car. You will drive a vehicle under supervision for 4 hours, interact with the AI Assistant using voice commands, and complete quick feedback forms during and... 
    Part time

    Tsmg

    New York, NY
    2 days ago
  • Service Measure is seeking participants for a one-time testing session of an AI Assistant system in a car. You will drive a vehicle during a supervised 4-hour session and interact with the AI Assistant by providing voice commands. Your feedback on the AI Assistant's performance... 

    TSMG Holding

    Dallas, TX
    2 days ago
  • $62.82k - $67.5k

     ...more about 9th Way Insignia at Application password: Niner Team (Project) Introduction 9th Way Insignia is seeking a Junior Tester for manual testing of C#, Visual Studio, and .NET-based applications in support of the to support the Department of Veterans... 
    Full time
    Contract work
    Local area

    9th Way Insignia

    Remote
    16 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Chatbot Tester. Be the first to apply!