Bilingual Evaluator for AI Model Training (Spanish - Spain) [Remote]

Join a dynamic team as a Bilingual Evaluator Expert, where you will play a crucial role in advancing AI research focused on multilingual communication and internet culture. This position allows you to evaluate and enhance AI model outputs in both Spanish and English, ensuring that these models accurately reflect modern online communication, cultural nuances, and the vibrant language used in Spanish internet communities. Key Responsibilities

• Evaluate Internet-Native Communication
  • Analyze content from social media, forums, messaging platforms, and other digital environments.
  • Assess AI-generated responses for naturalness, fluency, cultural relevance, and authenticity.
  • Identify issues related to slang, memes, abbreviations, code-switching, and evolving online language.
  • Evaluate content specific to Spanish internet culture and trends.
• Develop Evaluation Standards
  • Create detailed rubrics and guidelines for evaluating bilingual and internet-native communication.
  • Define standards for tone, cultural relevance, contextual understanding, and linguistic accuracy.
  • Document edge cases involving internet culture, humor, sarcasm, and platform-specific language.
  • Identify distinctions between Peninsular Spanish and Latin American Spanish internet usage.
• Conduct Model Testing and Feedback
  • Test language models using real-world multilingual prompts.
  • Evaluate outputs in both English and Spanish.
  • Provide structured feedback to enhance model performance and cultural understanding.
• Support Quality Assurance
  • Participate in review cycles and benchmark development.
  • Collaborate with project leads to improve evaluation frameworks.
  • Maintain consistency across datasets and evaluation processes.

• Native or near-native fluency in Spanish (Spain) and professional fluency in English.
• Deep familiarity with Spain-based internet culture and online communities.
• Active engagement with platforms such as YouTube, TikTok, Reddit, Discord, X, Instagram, Twitch, Forocoches, or similar.
• Strong understanding of Peninsular Spanish slang, memes, internet humor, and contemporary digital culture.
• Excellent writing, analytical, and critical thinking skills.
• Availability to commit 10, 20 hours per week.

• Experience in content moderation, localization, translation, linguistics, social media, journalism, or AI evaluation.
• Experience evaluating user-generated content or digital communications.
• Familiarity with differences between Spain Spanish and Latin American Spanish online discourse.
• Interest in AI, language models, and internet culture research.