Global AI Expert & Evaluator
Part-time
TELUS International
TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems .
We are looking for university students, graduates, researchers and experienced professionals with expertise across Artificial Intelligence, Machine Learning, LLMs, Mathematics, Science, Engineering, Linguistics, Cybersecurity, Psychology, Law, Healthcare, Finance, Education and other specialist disciplines.
You do not need a degree specifically called “Artificial Intelligence.” We are looking for people with strong subject-matter expertise, analytical thinking and the ability to assess whether AI is accurate, logical, safe and fit for purpose.
What you may work on:
Depending on your expertise, you could evaluate:
AI & Machine Learning
- AI/ML concepts and technical outputs
- Model reasoning and performance
- Data and technical accuracy
- Coding and computational outputs
LLM & NLP
- AI-generated text and conversations
- Language, meaning, context and reasoning
- Hallucinations and factual accuracy
- LLM responses and instruction following
Mathematical & Logical Reasoning
- Mathematical calculations
- Statistics and probability
- Logic and multi-step reasoning
- Scientific and quantitative problem solving
AI Safety & Red Teaming
- AI failure modes
- Unsafe or inappropriate outputs
- Model vulnerabilities and weaknesses
- Adversarial and edge-case scenarios
- Responsible AI behaviour
Domain-Specific AI Evaluation
- Healthcare & Medicine
- Law
- Finance, Economics & Accounting
- Education
- Engineering & Robotics
- Physics & Science
- Business
- Humanities & Social Sciences
- Linguistics and other specialist domains
You may be asked to:
- Evaluate AI-generated responses against defined criteria
- Identify factual, technical, linguistic or reasoning errors
- Compare multiple AI responses and determine which is stronger
- Assess whether an AI solution is accurate, relevant and logically sound
- Identify hallucinations, inconsistencies and potential risks
- Apply evaluation guidelines consistently
- Provide clear, structured expert feedback
- Help establish and maintain high-quality evaluation standards
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Global AI Expert & Evaluator in Vancouver, WA vacancy
- ...TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for university students, graduates, researchers and experienced professionals with expertise across Artificial Intelligence, Machine...SuggestedPart time
TELUS International
Vancouver, WA14 days ago - ...As a Thai Linguist in our Global AI Community, you evaluate and validate speech AI systems from a linguistic perspective—ensuring machine-generated voices communicate with natural language flow and prosody, speech recognition captures intent with linguistic accuracy, and...SuggestedPart time
TELUS International
Vancouver, WA1 day ago $98.04k - $227.82k
...because it is an investment in our people, our future, and what we stand for as a firm.KPMG is currently seeking a Manager to join our Global Trade Technology Services practice. Responsibilities:Support implementation of Global Trade Technology solutions, including the...SuggestedLocal areaKPMG
Portland, OR3 days ago- ...a human thinks and how a machine writes code. As a Full-Stack AI Logic Specialist , you will join an elite squad of developers tasked... ...and follows clean-code principles. Security Auditing: Evaluate code for common vulnerabilities, such as SQL injection or buffer...SuggestedPart time
TELUS International
Vancouver, WA1 day ago - ...At TELUS Digital , we know that as AI becomes more powerful, the need for robust... ...avoid cultural "blind spots" in diverse global markets. Synthesize safety findings into... ...Teams to update model safety guardrails. Evaluate the model’s ethical decision-making in "...SuggestedPart time
TELUS International
Vancouver, WA14 days ago - ...Digital , we believe Python is the language of the AI revolution. As a Python AI Logic Expert in our Global Community, you are the architect of algorithmic... ...Tuning (SFT) . Scientific & ML Library Validation: Evaluate how models utilize advanced Python libraries such...Part time
TELUS International
Vancouver, WA14 days ago - ..., we don't just build smart AI; we build intuitive AI . As... ...Human-AI Interaction (HAI) & UX Expert , you are the architect of the... ...Accessibility & Inclusivity Design: Evaluate how models handle diverse... ..., and accessibility needs to ensure the AI is truly global....Part time
TELUS International
Vancouver, WA14 days ago - ...we are building the "Shield of Trust" for global digital identity. You will join an elite freelance pool focused on training AI to detect fraud, verify identity documents,... ...tampering. Liveness & Biometric Verification: Evaluate "Liveness" test data to help AI detect...Contract workFreelance
TELUS International
Vancouver, WA14 days ago - ...use Reinforcement Learning from Human Feedback (RLHF) to align AI with human values, and in this role, you act as our "Logical Compass... ...Conceptualize and draft multi-dimensional grading rubrics that evaluate AI responses for tone, logic, and instructional following....Part time
TELUS International
Vancouver, WA1 day ago - ...About the Role Join our global AI Community as a Bioinformatics AI Expert specializing in advanced benchmark dataset creation and AI model evaluation. In this role, you will design complex, reasoning-intensive, "information-reversal" evaluation tasks to measure...Part time
TELUS International
Vancouver, WA14 days ago - ...TELUS Digital AI Community Our global AI Community is a vibrant network of more than one million contributors from... ...and Computational Biology Subject Matter Experts (SMEs) to support the development of advanced evaluation content for next-generation AI systems. This...Temporary workFreelanceRemote workFlexible hours
TELUS International
Vancouver, WA1 day ago $8 - $65 per hour
...Oregon is looking for Mental Health Professionals to help train AI models. You will review AI-generated responses, complete psychology... ...Professional is required, and you will need to complete a skills screener to join Prolific's Domain Expert pool. #J-18808-Ljbffr ProlificRemote jobHourly payFlexible hours$10k
...'s changing lives every day! Job Summary The Sales and Service Expert (SSE) delivers an outstanding and well-rounded sales and service... ...new business opportunities. Communicates and promotes local and global marketing campaigns to leads and members. Manages and follows...Full timePart timeWork experience placementWork at officeLocal area$100 per hour
Prolific in Portland, Oregon is seeking Legal Professionals to help train AI models by providing expert legal insights. Candidates will evaluate documents for accuracy, guide AI model development with legal content, and ensure that AI outputs meet professional standards...Remote jobHourly payFlexible hours$120 per hour
Prolific is seeking Licensed Pharmacists to join as Domain Experts, helping to train AI models in healthcare. This role requires current... ...earn up to $120 USD/hr, with responsibilities including evaluating AI responses, conducting comparative analyses, and providing...Remote jobFlexible hours- ...About the Role: At TELUS Digital , we believe that when AI enters the healthcare space, accuracy is a matter of life and death. As a Clinical & Medical AI Expert , you are the guardian of medical truth. You will join an elite circle of healthcare professionals...Part time
TELUS International
Vancouver, WA14 days ago - ...About the Role: Do you have a background in Physics or Mechanical Engineering ? AI models are getting smarter, but they often struggle with "common sense" physics—like how gravity works, how objects move, or how much force is needed to lift something. At TELUS...Part time
TELUS International
Vancouver, WA14 days ago - ...About the Role: AI is great at writing, but it often makes legal documents too confusing or misses simple rules. As a Legal Content Expert , your job is to read AI-generated legal text—like simple contracts, privacy policies, or terms of service—and make sure they...Contract work
TELUS International
Vancouver, WA14 days ago - ...About the Role: Do you have a degree in Geography or Urban Planning ? AI models power the maps we use every day for delivery and travel, but they often struggle to understand the real world. At TELUS Digital , we are looking for Geography enthusiasts to be the...Part timeLocal area
TELUS International
Vancouver, WA14 days ago - ...freelancers to help make the internet a safer place. You don't need to be a tech expert or a computer scientist. Your job is to use your understanding of human behavior and mental health to check if AI-generated content is safe, helpful, and responsible. You are the "Human...Contract workFreelance
TELUS International
Vancouver, WA14 days ago - ...TELUS Digital is building a global community of experts to support the development and evaluation of advanced Artificial Intelligence systems. We are seeking AI, Machine Learning, Research and Subject-Matter Experts to support an upcoming Recursive Self-Improvement...Part time
TELUS International
Vancouver, WA14 days ago - ...we are building the future of software development. As a expert in our Core Engineering & AI Development Community , you are the architect behind... ..., Java, and C++ . Code Quality & Security Auditing: Evaluate AI-generated code for security vulnerabilities (e.g., SQL...Part time
TELUS International
Vancouver, WA14 days ago - ...About the Role: Do you have a background in Medicine, Nursing, or Biology ? AI is being used more and more in healthcare, but it needs experts to make sure the information it gives is safe and accurate. At TELUS Digital , we are looking for people with medical...Part timeImmediate start
TELUS International
Vancouver, WA14 days ago - ...impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic names... ...personal preferences and profile Visit luxury stores or evaluate online - engage with sales associates in the stores or online from...Contract workFreelanceWorldwideFlexible hours
CXG
Portland, OR12 hours ago $65 per hour
Prolific is seeking registered nurses in Portland, Oregon, to help train AI models. As a Domain Expert, you will evaluate AI responses to clinical scenarios and provide feedback. This position requires a current nursing license and recent clinical experience. The role...Hourly paySelf employmentFlexible hours- ...impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic names... ...your personal preferences and profile Visit luxury stores or evaluate online - engage with sales associates in the stores or online...Contract workFreelanceWorldwideFlexible hours
$40 per hour
Prolific is looking for Neuroscience Experts to join an AI verification project. This remote position allows flexibility and pays $40+/hour for evaluating AI-generated outputs to maintain scientific integrity. The role involves reviewing scientific literature, identifying...Remote job- ...in a dynamic environment. Candidates should have over 10 years of scheduling experience, proficiency in Primavera P6 and MS Project, and strong communication skills. Full-time role with opportunities to impact project outcomes significantly. #J-18808-Ljbffr DSJ GlobalFull time
$17.13 per hour
...Delivery Expert Vancouver, Washington, Van Pizza, Inc. About Us Company Description All driver positions are paid hourly at minimum pay $17.13 - maximum pay $17.13 Advancement Many of our team members began their careers as delivery drivers and today are...Hourly payExtra incomeFull timePart timeSecond jobWork at officeFlexible hoursShift workNight shift- ...Delivery Expert Vancouver, Washington, Van Pizza, Inc. Orientation and training provided on the job. All driver positions are paid hourly at minimum wage Washington $17.13 and maximum $17.13. Credit card tips, cash tips and a partial mileage reimbursement are paid...Hourly payMinimum wageExtra incomeFull timePart timeSecond jobWork at officeFlexible hoursShift workNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Global AI Expert & Evaluator. Be the first to apply!
