Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Cloud Architect & AI Evaluation Specialist

Jobleads-US

Kansas City, MO
  • Remote job

AfterQuery is hiring cloud engineers to author and grade infrastructure and automation scenarios used in frontier AI evaluations. This fully remote, async contractor role requires crafting realistic cloud scenarios and providing justification for architectural choices.

You will grade model outputs on correctness, security, and cost efficiency, and flag risky configurations. The work is ongoing, with weekly Stripe payments and hours you set each week.

#J-18808-Ljbffr Jobleads-US
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Cloud Architect & AI Evaluation Specialist in Kansas City, MO vacancy
  • $30 - $90 per hour

     ...Role Overview Help improve enterprise AI assistants by evaluating their outputs, identifying weaknesses, and delivering feedback that strengthens...  ...matter expertise and careful judgment are central to this remote contract role. Prior AI experience is not required. Key... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    SaidGig

    Remote
    22 days ago
  •  ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...(MD) — Clinical Image Interpretation & AI Evaluation Type: Contract Compensation: $270/hour Location: Remote Role Responsibilities Evaluate and... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    4 days ago
  •  ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    3 days ago
  •  ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    2 days ago
  • $60 - $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy,... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    4 days ago
  • $20 per hour

    A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing...  ..., writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent... 
    Remote work
    Hourly pay
    Flexible hours

    SupportFinity

    United States
    18 hours ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate the relevance... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    4 days ago
  • $20 - $80 per hour

     ...Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on how AI models learn, reason, and perform across diverse subject areas. Key Responsibilities Evaluate... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    SaidGig

    United States
    more than 2 months ago
  • $30 per hour

    Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in...  ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    1 day ago
  •  ...Position Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project...  ...content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy, reasoning... 
    Remote work
    Hourly pay
    For contractors
    Flexible hours

    CNTXT AI

    Brooklyn, NY
    15 days ago
  •  ...AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios used to test model judgment. You will design realistic cloud scenarios from architecture through incident response and write reference answers with the architectural... 
    Remote job
    For contractors

    Jobleads-US

    Warren, MI
    1 day ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $90/hour Location: Remote Role Responsibilities Render a reference...  ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel... 
    Remote work
    Contract work
    Summer work
    Local area

    Mercor

    San Francisco, CA
    4 days ago
  • $80 per hour

     ...part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic...  ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    1 day ago
  • $60 per hour

    Prolific is looking for Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly from home, earning up to $60 per hour for paid tasks. Responsibilities include reviewing scientific data accuracy... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    1 day ago
  • $80 per hour

    A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates...  ...analytical thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive... 
    Remote job
    Flexible hours

    Mindrift

    Providence, RI
    1 day ago
  • $60 per hour

     ...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical...  ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Kansas City, MO
    1 day ago
  • Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model... 
    Remote job
    Full time

    Rex.zone

    Seattle, WA
    1 day ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... 
    Remote work
    Contract work
    Summer work

    Mercor

    Philadelphia, PA
    4 days ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience...  ...Compensation: $85/hour Location: Remote Role Responsibilities...  ...agents to complete and evaluate complex infrastructure engineering... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    4 days ago
  •  ...To support high-quality AI evaluations at scale, the full-time AI Evaluation Infrastructure Engineer will build infrastructure and tooling that enables rapid and reliable assessment of AI models and products, ensuring meaningful results and effective feedback loops. Key... 
    Remote work
    Full time

    Virtual Vocations Inc

    United States
    3 days ago
  • $180k

     ...US Recruitment Consultant: Guiding GenAI professionals towards their dream careers AI Evaluation Engineer $180,000 Remote (US-based) Are you passionate about shaping how AI is deployed safely, reliably, and at scale? This is a rare opportunity to join a mission... 
    Remote work
    Full time

    DeepRec.ai

    Denver, CO
    3 days ago
  • YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to evaluating and improving next‑generation AI systems. In this contractor role, you will create and validate... 
    Remote job
    For contractors

    YO AI Labs

    Seattle, WA
    1 day ago
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  .... Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Dallas, TX
    20 days ago
  • $100 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Mental Health Expert — AI Conversation Evaluation Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Review pairs of simulated... 
    Remote work
    Contract work
    Summer work

    Mercor

    Houston, TX
    3 days ago
  • YO AI Labs is seeking an experienced Management Consultant to support AI training and evaluation projects on a remote basis. This contractor role emphasizes structured problem-solving, business analysis, and clear client communication to improve model performance. You... 
    Remote job
    For contractors

    YO AI Labs

    Austin, TX
    3 days ago
  • $85 - $165 per hour

     ...AfterQuery is a research lab that builds evaluation data and experiments to measure AI models in real professional tasks. We are hiring cloud engineers as contractors to author...  ...and cost efficiency. This is fully remote and async, with a minimum of 10 hours per... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    Jobleads-US

    Omaha, NE
    1 day ago
  • $100 - $150 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in the finance... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Charlotte, NC
    12 days ago
  • $141.02k - $204.53k

     ...City Rochester State MN Remote NO Department Information Technology...  ...Responsibilities As the Senior AI/ML Engineer - Validation & Evaluation within AI Validation & Monitoring (...  ...stakeholders. Demonstrated expertise in cloud infrastructure environment and... 
    Remote work
    Full time
    Work at office
    Flexible hours
    Weekend work

    Mayo Clinic

    Rochester, MN
    25 days ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $80–$150/hour Location: Remote Role Responsibilities Design...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote work
    Contract work
    Summer work

    Mercor

    Boston, MA
    4 days ago
  • $75 - $85 per hour

    DescriptionThe Enterprise Cloud Platform team is seeking a Platform...  ...cloud infrastructure for AI, Machine Learning, Generative...  ...Workplace TypeThis is a fully remote position.Application DeadlineThis...  ...including sourcing, screening, and evaluating candidates. AI helps assess... 
    Remote work
    Contract work
    Temporary work

    TEKsystems

    Farmington, CT
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Cloud Architect & AI Evaluation Specialist. Be the first to apply!