Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI tester with Portuguese language

Tsmg

Project Objective This project aims to test and evaluate one AI agent in the development stage. By asking questions and requests, based on various categories (the training is provided), you will try to force the AI agent to say something harmful, offensive, dangerous or toxic an evaluate it’s responses. The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer. This role is fully remote, full-time with a duration of several months (depending on the project progress it might be prolonged). Full online training before the project will be provided. Responsibilities: generate requests to the AI agent on the proposed topic; evaluate the response proposed by agent, classify it accordingly; meet daily targets; сommunication with a supervisor. Requirements: fluent Portuguese; intermediate English (for training and internal communication with the team); basic tech savviness; good time-management skills; high level of responsibility; quick learner. #J-18808-Ljbffr Tsmg

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI tester with Portuguese language in New York, NY vacancy
  •  ...remote, full-time Project Coordinator for a multi-month AI safety testing initiative. You will generate prompts,...  ...will be provided and collaboration will occur with a distributed team in English and Portuguese. Ideal candidates are fluent in Portuguese with solid... 
    Portuguese language skills
    Remote job
    Full time
    Home office

    Tsmg

    New York, NY
    1 day ago
  • Agency is seeking a Portuguese Language Specialist (Brazil) to help train and evaluate AI language models. This remote, contract role is entry level and focuses on phonetics, morphology, syntax, semantics, pragmatics, and sociolinguistics of Brazilian Portuguese. You will... 
    Portuguese language skills
    Remote job
    Contract work

    Agency

    New York, NY
    1 day ago
  • Innodata India in the United States is seeking a Portuguese language QA specialist to review AI-generated prompts, responses, and conversations for grammar...  ...datasets for training, identify biases, and collaborate with global teams to ensure culturally appropriate language... 
    Portuguese language skills

    Innodata India

    New York, NY
    3 days ago
  • A progressive technology company is seeking a remote AI Red Teamer to assess conversational AI models and identify vulnerabilities...  .... Candidates should be fluent in both English and Brazilian Portuguese, with a background in cybersecurity or adversarial testing. This... 
    Suggested
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    14 hours ago
  •  ...About The Role What if your curiosity and sharp instincts could help shape the AI tools millions of people rely on every day? We're looking for AI Chatbot Testers to engage directly with cutting‑edge AI systems, put them through their paces, and provide the human feedback... 
    Suggested
    Hourly pay
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    4 days ago
  • $30 per hour

    Review and improve AI answers written in Portuguese so they read naturally and get the facts right. You rate responses, fix weak ones and write examples that show the model what good looks like. What you will do Rate Portuguese AI responses for accuracy, fluency, tone... 
    Portuguese language skills
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    4 days ago
  • $35 per hour

    Lead quality for Portuguese AI training data by checking reviewers' work and keeping the team...  ...What you need Native-level Portuguese with strong written English Prior QA, editing...  ...projects require living in a country where the language is spoken Contract Remote, hourly... 
    Portuguese language skills
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    1 day ago
  • Systechcorp Inc. is seeking an Informatica Lineage Tester for a remote, full-time engagement. The role requires 5+ years of experience with Informatica PowerCenter and data lineage...  ...-end and back-end testing, and leveraging AI tools in testing is a plus. #J-18808-Ljbffr... 
    Remote job
    Full time

    Systechcorp Inc

    New York, NY
    14 hours ago
  • Lionbridge AI is seeking Irish speakers for a remote, part-time AI testing project. You will help test and improve an AI tool by following simple instructions and reporting results with clear feedback. Ideal candidates are proficient in Irish and English, comfortable with... 
    Remote job
    Part time
    Flexible hours
    3 days per week
    1 day per week

    Lionbridge AI

    New York, NY
    2 days ago
  • $70 per hour

     ...based participants to record short videos at home for a smart-TV AI project. You’ll use an iPhone and a living room setup, following...  ...upload everything via the Mindrift app. This is a one-time task with $70 paid for one approved submission. Expect about 1 to 1.5 hours... 

    Mindrift (Toloka)

    New York, NY
    14 hours ago
  • Vettedlance is seeking a remote, part-time contractor to help test AI chatbots by writing realistic prompts and rating responses for...  ...usefulness and accuracy. You will conduct short multi-turn conversations with several chatbots and submit transcripts and structured judgments... 
    Remote job
    Part time
    For contractors

    Vettedlance

    New York, NY
    4 days ago
  • micro1 is seeking a contractor for the role of Food Delivery App User Tester in the United States. This position focuses on contributing high-quality, real-world input to train AI systems, with emphasis on clear feedback and independent remote work. You will use your existing... 
    Remote job
    For contractors

    Micro1

    New York, NY
    14 hours ago
  • $15 - $30 per hour

     ...and Grok Imagine, which you can edit and then use to generate your own video. It also runs a library of AI video prompts we've actually tested. Each one is shown with the real output clip and a note on what the model followed and what it missed. Homepage: VideoCreate... 
    Freelance
    Remote work
    Worldwide

    VideoCreate

    New York, NY
    3 days ago
  •  ...documenting user journeys across platforms. Your feedback will help train AI systems to better understand user behavior in grocery and...  ...contexts. Ideal candidates are active food delivery app users with documented order history, excellent written and spoken English, and... 
    Remote job
    For contractors

    Remotebridge

    New York, NY
    14 hours ago
  • $28.74 per hour

     ...Responsibilities Red team conversational AI models and agents (jailbreaks, prompt...  ...Native-level fluency in English and Brazilian Portuguese (required). Prior experience in AI red...  ...risk analysis. Strong adversarial mindset with structured, methodical testing approaches... 
    Remote job
    Hourly pay
    Full time
    Contract work
    Part time

    Crossing Hurdles

    New York, NY
    14 hours ago
  • Are you a Portuguese (Brazil) language expert eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into powerful engines of linguistic discovery. With high-quality training data, tomorrow's AI can democratize world-class education... 
    Portuguese language skills
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Agency

    New York, NY
    1 day ago
  • Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills... 
    For contractors

    Remotebridge

    New York, NY
    3 days ago
  • $25 - $45 per hour

     ...tasking as soon as tasks are assigned. You’ll need: An active personal AI assistant account (Plus tier), active Muse and Dots access, a...  ...that are reimbursed afterward Your tasks: Run everyday errands with two AI agents, approve key steps, screen record, and score the results... 
    Contract work
    Work at office
    Immediate start
    Remote work

    HumanitApp

    New York, NY
    2 days ago
  • YO AI Labs is seeking U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. Test two AI agents using your own accounts and smartphone, assess performance, and provide feedback to improve real-world usability. Responsibilities include testing... 
    Remote job

    YO AI Labs

    New York, NY
    1 day ago
  • micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your own phone and accounts, with screen recording and detailed feedback on agent performance. You will run scenarios such... 
    For contractors

    Micro1

    New York, NY
    2 days ago
  • $25 - $45 per hour

    Zekai is seeking an AI Agent Tester to evaluate real-world AI assistants on everyday tasks. This is a 100% remote contractor role based in the United States, with pay of $25-45 per hour and onboarding within 24-48 hours of selection. You will run real-life scenarios with... 
    Remote job
    Hourly pay
    For contractors

    Confidential

    New York, NY
    2 days ago
  • Mercor is seeking experienced Brazilian Portuguese Linguistic Experts to join a cutting-edge AI research project in partnership with a leading research lab. This role focuses on...  ...how an LLM performs in Brazilian Portuguese-language tasks and on curating high-quality... 
    Portuguese language skills
    Part time
    Remote work

    Mercor

    New York, NY
    2 days ago
  • $25 - $45 per hour

    Test two AI agents on everyday tasks such as bookings, shopping, forms, and returns using your smartphone. This remote U.S. contractor...  ...based in the United States. You will complete the work with a smartphone, personal accounts, and the required testing tools.... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Work at office
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $85 per hour

     .../ hr · Location: Remote — US-eligible · Contractor Everyday AI Agent Tester is a remote review track for evaluating AI outputs across everyday...  ...risk, missed escalations, and policy-adherence gaps with severity tags. Capture the right next step so the modeling team... 
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    Auraone

    New York, NY
    14 hours ago
  • Xperteez Technology Pvt Ltd in the United States is seeking an AI Agent Tester to evaluate real-world tasks across two AI agents, using your own device and accounts. You will observe flows, record outcomes, and provide clear feedback. This contract role emphasizes attention... 
    Remote job
    Contract work
    Flexible hours

    Xperteez Technology Pvt Ltd

    New York, NY
    14 hours ago
  • Job Title: AI Agent Tester - Real-World Tasks Role Type: Contractor Location: United States Job Summary We are seeking detail-oriented, U.S....  ...account (Plus tier), active Muse and Dots access, a smartphone with screen-recording capability, and a payment card for... 
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    New York, NY
    1 day ago
  • £30 per hour

     ...This is a self-employed vacancy. Applicants must be UK based. We require Portuguese language interpreters and translators. Language based formal qualifications and experience are essential. Excellent rates of pay starting at £30.00 for the first hour. We also pay travel... 
    Portuguese language skills
    Minimum wage
    Self employment
    Local area

    Alpha Language Services

    New York, NY
    14 hours ago
  •  ...contractor to craft realistic customer-support conversations for AI voice agents and assess how well AI responses handle real-world calls...  ...experience, be fluent in English, and have a quiet workspace with reliable internet. Shifts may include weekends, paid weekly at $3... 
    Remote job
    Hourly pay
    Weekly pay
    Part time
    For contractors
    Shift work

    Vettedlance

    New York, NY
    4 days ago
  • OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user... 
    Remote job
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $40 per hour

     ...time Mercor is seeking experienced Brazilian Portuguese Linguistic Experts to join a cutting-edge AI research project in partnership with a leading research lab. This role centers on evaluating how effectively a large language model (LLM) performs in Brazilian Portuguese... 
    Portuguese language skills
    Part time
    Remote work

    Mercor

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI tester with Portuguese language. Be the first to apply!