Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Global AI Expert & Evaluator

Part-time

TELUS International

TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems .

We are looking for university students, graduates, researchers and experienced professionals with expertise across Artificial Intelligence, Machine Learning, LLMs, Mathematics, Science, Engineering, Linguistics, Cybersecurity, Psychology, Law, Healthcare, Finance, Education and other specialist disciplines.

You do not need a degree specifically called “Artificial Intelligence.” We are looking for people with strong subject-matter expertise, analytical thinking and the ability to assess whether AI is accurate, logical, safe and fit for purpose.

What you may work on:

Depending on your expertise, you could evaluate:

AI & Machine Learning

  • AI/ML concepts and technical outputs
  • Model reasoning and performance
  • Data and technical accuracy
  • Coding and computational outputs

LLM & NLP

  • AI-generated text and conversations
  • Language, meaning, context and reasoning
  • Hallucinations and factual accuracy
  • LLM responses and instruction following

Mathematical & Logical Reasoning

  • Mathematical calculations
  • Statistics and probability
  • Logic and multi-step reasoning
  • Scientific and quantitative problem solving

AI Safety & Red Teaming

  • AI failure modes
  • Unsafe or inappropriate outputs
  • Model vulnerabilities and weaknesses
  • Adversarial and edge-case scenarios
  • Responsible AI behaviour

Domain-Specific AI Evaluation

  • Healthcare & Medicine
  • Law
  • Finance, Economics & Accounting
  • Education
  • Engineering & Robotics
  • Physics & Science
  • Business
  • Humanities & Social Sciences
  • Linguistics and other specialist domains

You may be asked to:

  • Evaluate AI-generated responses against defined criteria
  • Identify factual, technical, linguistic or reasoning errors
  • Compare multiple AI responses and determine which is stronger
  • Assess whether an AI solution is accurate, relevant and logically sound
  • Identify hallucinations, inconsistencies and potential risks
  • Apply evaluation guidelines consistently
  • Provide clear, structured expert feedback
  • Help establish and maintain high-quality evaluation standards
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Global AI Expert & Evaluator in Washington DC vacancy
  •  ...As a Thai Linguist in our Global AI Community, you evaluate and validate speech AI systems from a linguistic perspective—ensuring machine-generated voices communicate with natural language flow and prosody, speech recognition captures intent with linguistic accuracy, and... 
    Suggested
    Part time

    TELUS International

    Washington DC
    2 days ago
  •  ...At TELUS Digital , we know that as AI becomes more powerful, the need for robust...  ...avoid cultural "blind spots" in diverse global markets. Synthesize safety findings into...  ...Teams to update model safety guardrails. Evaluate the model’s ethical decision-making in "... 
    Suggested
    Part time

    TELUS International

    Washington DC
    2 days ago
  •  ...we are building the "Shield of Trust" for global digital identity. You will join an elite freelance pool focused on training AI to detect fraud, verify identity documents,...  ...tampering. Liveness & Biometric Verification: Evaluate "Liveness" test data to help AI detect... 
    Suggested
    Temporary work
    Freelance

    TELUS International

    Washington DC
    2 days ago
  • $70 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .... Position: Generalist Expert Type: Contract Compensation...  ...Role Responsibilities Evaluate AI-generated responses to strengthen...  ...'s degree from a top-500 globally ranked university preferred.... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Washington DC
    17 days ago
  •  ...skilled and security-cleared Artificial Intelligence Ethics Subject Matter Expert (SME) to lead and advise on the ethical implementation, integration, and governance of artificial intelligence (AI) platforms across the enterprise. This position provides expert-level... 
    Suggested

    ANALYTICA

    Washington DC
    4 days ago
  •  ...position which is “on site.” Job Description: SimIS, Inc. seeks an AI Subject Matter Expert to provide Systems Engineering and technical assistance (SETA) support to the Test and Evaluation Science and Technology (T&E/S&T) Program, the Department's only S&T program... 
    Full time
    Temporary work

    SimIS Inc.

    Alexandria, VA
    a month ago
  •  ...About the Role: Do you have a degree in Geography or Urban Planning ? AI models power the maps we use every day for delivery and travel, but they often struggle to understand the real world. At TELUS Digital , we are looking for Geography enthusiasts to be the... 
    Part time
    Local area

    TELUS International

    Washington DC
    2 days ago
  •  ...a human thinks and how a machine writes code. As a Full-Stack AI Logic Specialist , you will join an elite squad of developers tasked...  ...and follows clean-code principles. Security Auditing: Evaluate code for common vulnerabilities, such as SQL injection or buffer... 
    Part time

    TELUS International

    Washington DC
    2 days ago
  •  ...About the Role: Do you have a background in Physics or Mechanical Engineering ? AI models are getting smarter, but they often struggle with "common sense" physics—like how gravity works, how objects move, or how much force is needed to lift something. At TELUS... 
    Part time

    TELUS International

    Washington DC
    2 days ago
  •  ...we are building the future of software development. As a expert in our Core Engineering & AI Development Community , you are the architect behind...  ..., Java, and C++ . Code Quality & Security Auditing: Evaluate AI-generated code for security vulnerabilities (e.g., SQL... 
    Part time

    TELUS International

    Washington DC
    2 days ago
  • $8 - $65 per hour

    Prolific is looking for Mental Health Professionals in Washington, DC to help train advanced AI models. Participants will review AI-generated content, analyze psychological scenarios, and provide feedback to enhance AI responses. Ideal candidates should have verified mental... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Washington DC
    3 days ago
  •  ...teams bring together the talents of nearly 190 professionals globally to complete a wide variety of engagements for Private Companies...  ...Seeks a Enterprise Assessment Protection System Performance Test Evaluator (SCA Code: -) in CONUS - Mid Atlantic Washington Metropolitan... 
    Full time
    Temporary work
    For contractors
    Work at office
    Flexible hours

    Prosidian Consultng

    Washington DC
    5 days ago
  • $120 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Economics Research Expert Type: Contract Compensation...  .../week Role Responsibilities Evaluate the accuracy and depth of AI-generated... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Washington DC
    17 days ago
  •  ...AI/ML Subject Matter Expert (SME) / Analytics Team Lead Nationwide IT Services, NIS, is seeking an AI/ML Subject Matter Expert (SME) / Analytics...  ...Support data exploration, feature engineering, model evaluation, and performance improvement efforts. Recommend and... 
    Full time
    For contractors
    Work at office

    Nationwide IT Services

    Arlington, VA
    more than 2 months ago
  • $120 per hour

    Prolific is looking for Licensed Pharmacists to join as Domain Experts, influencing AI development by evaluating pharmaceutical scenarios. Applicants should have a current pharmacy license, clinical expertise, and strong attention to detail. The role offers competitive... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Washington DC
    4 days ago
  • What you'll do: Complete realistic, multi-step scientific data-analysis tasks in bioinformatics Write original bioinformatics questions where each answer is exact and objective Choose and anonymize data (e.g. from public archives such as GEO, SRA/ENA, ArrayExpress...

    Mercor Inc

    Washington DC
    2 days ago
  •  ...multidisciplinary teams bring together the talents of global professionals to complete a wide range of...  ...at DescriptionProSidian Seeks a Lead Evaluator | DOL ILAB Monitoring, Evaluation,...  ...for verifying the accuracy of AI-assisted analysis or content prior to inclusion... 
    Full time
    Contract work
    Interim role
    Work at office
    Flexible hours

    Prosidian Consultng

    Washington DC
    4 days ago
  • $90 - $110 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...Larry Summers and Jack Dorsey . Position: BioInformatics Experts Type: Contract Compensation: $90$110/hour... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Washington DC
    1 day ago
  • $60 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...hour Location: Remote Role Responsibilities Evaluate high-resolution images to test frontier AI models . Identify gaps... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Washington DC
    9 days ago
  •  ...use Reinforcement Learning from Human Feedback (RLHF) to align AI with human values, and in this role, you act as our "Logical Compass...  ...Conceptualize and draft multi-dimensional grading rubrics that evaluate AI responses for tone, logic, and instructional following.... 
    Part time

    TELUS International

    Washington DC
    2 days ago
  • $120 - $170 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...through rigorous data analysis. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.... 
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Washington DC
    17 days ago
  • $120 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Economics Research Expert Type: Contract Compensation: $...  ...+ hours/week Role Responsibilities Evaluate the accuracy and depth of AI-generated content... 
    Contract work
    Summer work
    Remote work

    Mercor

    Washington DC
    9 days ago
  •  ...About ProSidian Consulting at DescriptionProSidian Consulting Seeks a Mid Level Energy Programs Procurement Expert to support requirements that address the global demand for, and use of, modern energy services by fostering sustainable energy development in countries... 
    Full time
    Contract work
    Temporary work
    For contractors
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Washington DC
    4 days ago
  •  ...the talents of nearly 190 professionals globally to complete a wide variety of engagements...  ...Seeks a Job Training and Education Expert (AER7) [Key Personnel | Program Manager...  ...policies and proceduresAnalyze data and evaluate program effectiveness to make recommendations... 
    Hourly pay
    Full time
    Temporary work
    For contractors
    H1b
    Work at office
    Remote work
    Flexible hours
    Night shift

    Prosidian Consultng

    Washington DC
    4 days ago
  •  ...the talents of nearly 190 professionals globally to complete a wide variety of engagements...  ...Seeks a Subject Matter Expert | Nuclear Energy Subject Matter Expert (...  ...development and licensing.Support DOE in the evaluation of enrichment capability deployment projects... 
    Full time
    Contract work
    For contractors
    H1b
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Washington DC
    4 days ago
  • IBM Consulting in Maryland seeks an experienced AI Architect to design AI solutions using setting foundation models and NLP/ML techniques. You will lead cognitive projects from research to production, collaborating with diverse teams to deliver scalable AI capabilities... 

    IBM

    Bethesda, MD
    2 days ago
  • $22.14 - $24.6 per hour

     ...Event Support Expert Our jobs aren't just about setting up tables and chairs for our guests to use during a banquet or meeting. Instead...  ...can do your best work, begin your purpose, belong to an amazing global team, and become the best version of you. Job Info Job... 
    Hourly pay
    Full time
    Work experience placement
    Afternoon shift

    Marriott International Inc

    Arlington, VA
    3 days ago
  • A global leader in customer experience is seeking luxury brand evaluators to provide feedback on customer experiences with premium brands. Join a community of evaluators to assess the quality of service, both in-store and online, for leading luxury brands like Louis Vuitton... 
    Flexible hours

    CXG

    Arlington, VA
    1 day ago
  •  ...impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic names...  ..., Prada, Versace, and more. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... 
    Contract work
    Freelance
    Worldwide
    Flexible hours

    CXG

    Arlington, VA
    5 days ago
  •  ...multidisciplinary teams bring together the talents of nearly 190 professionals globally to complete a wide variety of engagements for Private Companies...  ...: Job DescriptionProSidian Seeks a DOE - NNSA Subject Matter Expert - Environmental Management and Sustainability (TEPSIII28)... 
    Full time
    Temporary work
    For contractors
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Washington DC
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Global AI Expert & Evaluator. Be the first to apply!