Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation & Annotation Reviewer (L3 - Advanced) - French/Italian/Portuguese

$15 - $18 per hour

Dorado

Launch Your Career in Artificial Intelligence Artificial Intelligence is transforming how the world communicates, learns, and solves problems—and skilled reviewers play an important role in improving the quality of these systems. We are seeking language professionals in the United States who are available and prepared to commit to this project for a minimum of six months. This is a long-term engagement that requires consistent attendance, dependable availability, and the ability to work the required schedule throughout the project. As an AI Evaluation & Annotation Reviewer , you will evaluate AI-generated content, identify linguistic and structural issues, annotate language data, and provide feedback that helps make AI responses more accurate, relevant, and reliable. This opportunity is ideal for professionals with backgrounds in linguistics, translation, localization, language education, research, writing, or quality assurance who are interested in gaining hands‑on experience on a real‑world AI project. Why Join This Project? Gain practical experience working on a global Artificial Intelligence project. Build valuable skills in AI evaluation, annotation, prompt review, and language quality. Work directly with QA Leads, international teams, and client stakeholders. Strengthen your experience for future opportunities in AI, language technology, localization, research, and quality assurance. Receive project‑specific training, guidance, and ongoing feedback. What You’ll Do Review AI‑generated responses for clarity, accuracy, correctness, relevance, and overall quality. Annotate and label language content according to detailed project guidelines. Generate or evaluate prompts based on assignment requirements. Identify linguistic errors, dataset concerns, and structural inconsistencies. Provide clear, structured feedback to support improvements in AI performance. Communicate complex language requirements clearly to both linguistic and non‑linguistic stakeholders. Collaborate with QA Leads and clients to apply feedback and maintain quality standards. Participate in required client‑facing meetings with your camera on. Submit daily work reports and consistently meet productivity and quality expectations. WhatWe’reLooking For Professional fluency in your Language of Focus : French, Italian, or Portuguese A bachelor’s degree in Linguistics, Languages, Computer Science, or a related field, or equivalent professional experience A degree or certification in your Language of Focus (French, Italian, or Portuguese), where required Strong analytical skills and exceptional attention to detail Ability to identify patterns, errors, inconsistencies, and subtle language issues Experience in annotation, evaluation, translation, localization, linguistics, research, education, or quality assurance is helpful but not required Interest in Artificial Intelligence, Machine Learning, language technology, or data annotation Ability to learn new tools, follow detailed guidelines, and adapt to changing project requirements Strong organization and task‑management skills Professional communication skills and confidence participating in client‑facing meetings Ability to work independently and collaborate effectively with a global team Schedule and Commitment Requirements Applicants must be able to meetallofthe following requirements: Commit to the project for a minimum ofsix months. Maintain consistent availability throughout the engagement. Work consecutive eight‑hourshifts. Remain available during the required core hours of8:00 AM–5:00 PM PST. Attend daily client meetings scheduled between10:00 AM–12:00 PM PST. Consistently meet attendance, productivity, quality, and reporting expectations. Only approved and properly logged hours will be compensated. This is an independent contractor engagement and does not include paid holidays or paid time off. Compensation Range Rates vary by language and are confirmed based on project requirements. French — $15.00–$18.00 USD/hour Italian — $14.00–$16.00 USD/hour Portuguese — $8.00–$11.50 USD/hour Location Restrictions We are unable to accept applicants currently residing in: Argentina, Bolivia, Chile, China, Colombia, Cuba, Ecuador, Iran, Iraq, North Korea, Mexico, Panama, Russia, Sudan, Syria, Ukraine (Crimea, Luhansk, Donetsk), United Kingdom, Venezuela. #J-18808-Ljbffr Dorado

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation & Annotation Reviewer (L3 - Advanced) - French/Italian/Portuguese in New York, NY vacancy
  • $23.2 per hour

     ...Roblox systems. As a Human Evaluator you will have the...  ...classification includes the review and classification of text...  ...and trends related to annotation projects Test out new features...  ..., Korean, Chinese, Portuguese, Spanish, French, German, Italian Prior experience with... 
    French language skills
    Italian language skills
    Portuguese language skills
    Hourly pay
    Full time
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday

    Roblox

    New York, NY
    18 hours ago
  • $30 per hour

     ...Intelligence Behind the World’s Leading AI – NYC Are you sharp,...  ....   The Mission: Beyond Annotation Model Evaluation : Critique AI outputs and...  ...bilingual mastery in French, Italian, German, Spanish, or Brazilian Portuguese. Writing Mastery: 1–2 years... 
    French language skills
    Italian language skills
    Full time
    Temporary work
    Work at office

    Welo Data

    New York, NY
    more than 2 months ago
  • $43.5 per hour

     ...the Future of Human-in-the-Loop AI Are you a strategic leader who...  ...improved in one of the world’s most advanced AI evaluation environments. You are the...  ...Advantage: Bilingual mastery in French, Italian, German, Spanish, or Brazilian Portuguese is highly preferred. Operational... 
    French language skills
    Italian language skills
    Full time
    Shift work

    Welo Data

    New York, NY
    1 day ago
  • AuraOne is seeking a remote Spreadsheet Automation Workflow AI Reviewer to assess evaluation prompts and responses against our quality rubric. You...  ...from the US. Prior experience with rubric-based annotation and inter-rater calibration is highly valued. #J-18808-... 
    Suggested
    Remote job
    For contractors
    Flexible hours

    AuraOne

    New York, NY
    4 days ago
  • $38 per hour

     ...the Teams Shaping the Future of AI - On‑Site [NYC] Are you a strategic...  ...analysts dedicated to AI model evaluation. This isn’t just a management role...  ...bilingual mastery in French, Italian, German, Spanish, or Brazilian Portuguese . Industry Veteran: 5-8 years of... 
    French language skills
    Italian language skills
    Full time

    Welo Data

    New York, NY
    18 hours ago
  • $90k

     ...opportunity to join Luminance, the pioneer of Legal-Grade™ AI for enterprise. Backed by internationally renowned VCs...  ...work in the USA. ~ European languages (particularly French, German, Spanish, Italian, Portuguese and Dutch) are desirable, but not essential.... 
    French language skills
    Italian language skills
    Portuguese language skills

    Luminance

    New York, NY
    1 day ago
  •  ...satisfaction. The ideal candidate has a background in sales, speaks fluent English, and one additional language among German, Italian, Spanish, Portuguese, or French. Join our international, supportive team and grow your career in a fast-paced environment. #J-18808-Ljbffr Xometry... 
    French language skills
    Italian language skills
    Portuguese language skills
    Remote job

    Xometry Europe GmbH

    New York, NY
    5 days ago
  •  ...procedures Proficient in MS Office (MS Excel, MS Power Point, MS Word) and Adobe. Strong organizational skills with the ability to multi-task. Fluent in English & Spanish. One of the following languages is a plus: French, Portuguese, Italian and/or Arabic. #J-18808-Ljbffr... 
    French language skills
    Italian language skills
    Portuguese language skills
    Contract work
    Worldwide

    Black Bull Group

    New York, NY
    2 days ago
  • $192k - $264k

     ...pushing the boundaries of what’s possible. We invest heavily in advanced AI capabilities—specifically our Process Intelligence Graph—to...  ...in English, an additional language such as Spanish, French or Italian is a strong advantage MSc degree in Computer Science or equivalent... 
    French language skills
    Italian language skills
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Celonis

    New York, NY
    3 days ago
  •  ...materials. Proficiency in multiple languages such as French, German, Spanish, Italian, or Portuguese is essential. Ideal applicants have strong attention to...  ...focused on maintaining high-quality output across various multimedia formats. #J-18808-Ljbffr Uber AI Solutions
    French language skills
    Italian language skills
    Portuguese language skills
    Remote job
    Freelance

    Uber AI Solutions

    New York, NY
    1 day ago
  • A leading AI company is seeking detail-oriented linguists with native...  ...related projects such as prompt evaluation, video content understanding, and text review. Ideal candidates will have...  ...to innovation and contribute to advancements in AI and content understanding.... 
    Remote job
    Freelance

    LILT (Production)

    New York, NY
    1 day ago
  •  ...About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer...  ...our specific customers Bilingual Portuguese, French or Spanish language proficiency is a plus...  ...tools to help our recruiters assess and evaluate candidates' resumes and qualifications... 
    French language skills
    Portuguese language skills
    Work at office
    Local area

    PVH (Tommy Hilfiger/Calvin Klein)

    New York, NY
    3 days ago
  •  ...Linguistic Specialist role at Uber AI Solutions . Uber AI Solutions is...  ...experienced transcribers and linguistic reviewers to support video/audio...  ...) and linguist QA. Proficient in French, German, Spanish, Italian, or Portuguese. Why This Role is Critical for Our... 
    French language skills
    Italian language skills
    Portuguese language skills
    Contract work
    Freelance
    Remote work

    Uber AI Solutions

    New York, NY
    19 hours ago
  • Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    3 days ago
  • AuraOne is seeking an Indigenous Language AI Evaluator to remotely review indigenous language AI evaluation prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. This... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    18 hours ago
  • AuraOne is seeking an Educational Safety AI Evaluator for a remote, contractor-based role. You will review educational safety AI outputs, apply the quality rubric, and produce auditable labels, rationales, and regression cases for AuraOne Human Data. Responsibilities include... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    18 hours ago
  • AuraOne is seeking a remote Video Understanding AI Evaluator contractor to review model outputs, apply a structured rubric, and provide rationale. You will compare responses, tag issues, and help refine prompts to improve reliability across batches. The role emphasizes... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    4 days ago
  • AuraOne is seeking a remote People Ops / Recruiting Evaluator to review evaluation prompts and responses against a quality rubric. You will compare paired outputs, write rationale, and tag edge cases to support retraining of the modeling system. The role emphasizes structured... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    5 days ago
  • AuraOne is seeking a remote Capability Elicitation Risk Evaluator to review prompts and model outputs. You will apply a versioned rubric to label edge cases, assign severity, and provide structured feedback for retraining. You will compare paired responses, select the stronger... 
    Remote job

    AuraOne

    New York, NY
    2 days ago
  •  ...meticulous Arabic-speaking Data Annotation Specialists from the MENA...  ...audio, and images to support AI training, with flexible hours...  ...candidates are fluent in English or French, have strong attention to...  ...detail, and can follow guidelines, review data, and maintain quality... 
    French language skills
    Remote job
    Flexible hours

    Socket.dev

    New York, NY
    19 hours ago
  • Welo Data is seeking a detail-oriented Data Labeling Associate to evaluate AI outputs and improve system behaviors in real-world scenarios. The ideal candidate will have native French proficiency and a university degree. This full-time role, based in New York City, involves... 
    French language skills
    Full time

    University of Delaware

    New York, NY
    18 hours ago
  • $23 - $30 per hour

     ...-store and overseas. - Demonstrate sales leadership and advanced clienteling, using tools available to foster development existing...  ..., and holidays.- Foreign languages (Mandarin, Spanish, Portuguese, Italian, French) are a plus. Compensation Range The base... 
    French language skills
    Italian language skills
    Portuguese language skills
    Hourly pay
    Local area
    Overseas
    Flexible hours
    Afternoon shift

    LVR USA CORP

    New York, NY
    20 days ago
  •  ...the agency fee to help you find your new home. Who We Are Looking For C2 Level: Speakers of German, Dutch, French, Danish, Portuguese, Czech, Italian, or Spanish. English Skills: At least a B2 level for communication and training purposes. Legal Right to Work... 
    French language skills
    Italian language skills
    Portuguese language skills
    Remote job
    Freelance
    Summer holiday
    Relocation package

    Freelance Headhunters Collective

    New York, NY
    2 days ago
  • $30 - $60 per hour

     ...Get AI-powered advice on this job and more exclusive...  ...experiments for evaluating transcription quality....  ...in transcription and annotation systems such as SAMPA,...  ...Humanities (English and Portuguese) Generative AI Specialist...  ...(English and Italian) Portuguese English:... 
    Italian language skills
    Portuguese language skills
    Contract work
    Remote work

    US Tech Solutions

    New York, NY
    11 hours ago
  •  ...a dynamic, multicultural team providing customer support with full relocation support! Languages Needed: Dutch | French | German | Italian | Portuguese | Spanish | Swedish | Romanian | Danish | Polish | Finnish Role Overview: Handle customer inquiries via phone... 
    French language skills
    Italian language skills
    Portuguese language skills
    Local area
    Immediate start
    Remote work
    Relocation
    Relocation package

    Cross Border Talents

    New York, NY
    4 days ago
  • Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in Italian. This freelance, remote role offers a part-time schedule (10+ hours/week) with immediate start and flexible hours. You will conduct short voice conversations with AI models... 
    Italian language skills
    Remote job
    Part time
    Freelance
    Immediate start
    Work from home
    Flexible hours

    Dorado

    New York, NY
    5 days ago
  • French Voice Actor - Freelance AI Trainer Project World Wide - Remote We’re looking for a highly skilled...  ...with cutting‑edge AI tools, record and evaluate French speech samples, and provide...  ...linguistic accuracy and naturalness, annotate errors, and collaborate with our... 
    French language skills
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    New York, NY
    2 days ago
  • Dorado seeks AI Data Specialists to support the improvement of AI-generated content in Italian. This is a remote freelance, part-time...  ...perform data collection, evaluation, annotation, pairwise comparisons, counting...  ...should be fluent or advanced (B2-C2); AI/data capabilities... 
    Italian language skills
    Remote job
    Part time
    Freelance
    Immediate start
    10 hours per week
    Flexible hours

    Dorado

    New York, NY
    5 days ago
  •  ...We’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye...  ...expectations. What You’ll Do Review AI-generated content in French Identify...  ...experience in marketing and data annotations Availabilities: This is a short-... 
    French language skills
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    BAM Ventures

    New York, NY
    4 days ago
  • $18 per hour

     ...intelligence. About The Role Annotation is what helps AI make sense of the world....  ...AI‑generated content, evaluating factual accuracy, or...  ...Responsibilities Carefully review provided data (text,...  ...professional discipline You have advanced proficiency in Italian (C1 or above) and a B2... 
    Italian language skills
    Part time
    Freelance
    Internship
    Remote work

    Toloka Annotators

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation & Annotation Reviewer (L3 - Advanced) - French/Italian/Portuguese. Be the first to apply!