Remote Cloud Engineer & AI Evaluation Specialist

$85 - $165 per hour

Jobleads-US

Remote job

AfterQuery is seeking cloud engineers as contractors to author and grade the infrastructure and automation scenarios used to test model judgment. This is a fully remote, async role with no fixed hours and a minimum of 10 hours per week.

You will design cloud scenarios across AWS, Azure or GCP, write reference answers explaining architectural reasoning, and evaluate model outputs for correctness, security, and cost efficiency. Compensation ranges $85 to $165 per hour, paid weekly via Stripe.

#J-18808-Ljbffr Jobleads-US

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Remote Cloud Engineer & AI Evaluation Specialist in Portland, OR vacancy

Remote Cloud Architect & AI Evaluation Specialist
...AfterQuery is hiring cloud engineers to author and grade infrastructure and automation scenarios used in frontier AI evaluations. This fully remote, async contractor role requires crafting realistic cloud scenarios and providing justification for architectural choices...
Remote job
Weekly pay
For contractors
Jobleads-US
Kansas City, MO
2 days ago
Remote Cloud Engineer & AI Evaluation Trainer
$85 - $165 per hour
...AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure... ...automation scenarios used in frontier AI evaluations. You’ll design realistic cloud scenarios... ...and cost efficiency. We offer full remote work with async collaboration, a pay range...
Remote job
Hourly pay
Weekly pay
For contractors
Flexible hours
Jobleads-US
Puerto Rico
1 day ago
Remote Cloud Architect & AI Evaluation Engineer
...AfterQuery is hiring cloud engineers to author and grade the infrastructure and automation scenarios used to test frontier AI models. This is a fully remote contractor role with no fixed hours, paying hourly rates between $85 and $165 and weekly Stripe payments. Work...
Remote job
Hourly pay
Weekly pay
For contractors
Jobleads-US
Herndon, VA
1 day ago
Remote Cloud Engineer & AI Evaluation Specialist
...AfterQuery is hiring cloud engineers as contractors to author and grade the infrastructure and automation scenarios used to test model judgment. You will design realistic cloud scenarios from architecture through incident response and write reference answers with the architectural...
Remote job
For contractors
Jobleads-US
Warren, MI
2 days ago
AI Evaluation Specialist
$30 - $90 per hour
...Role Overview Help improve enterprise AI assistants by evaluating their outputs, identifying weaknesses, and delivering feedback that strengthens... ...matter expertise and careful judgment are central to this remote contract role. Prior AI experience is not required. Key...
Remote work
Hourly pay
Contract work
For contractors
SaidGig
Remote
23 days ago
AI Design Evaluator & UX Specialist - Remote
...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...
Remote work
Work from home
Flexible hours
Prolific
Tucson, AZ
3 days ago
AI Design Evaluator & UX Specialist - Remote
...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...
Remote work
Work from home
Flexible hours
Prolific
Arizona City, AZ
4 days ago
AI Platform Engineer
...building the technical layer of the AI platform, the full-time AI Platform Engineer will manage integration surfaces,... ...gateways while working remotely. Key responsibilities Design and... ..., addressing capability gaps and evaluating vendor solutions Own the governed...
Remote work
Full time
Virtual Vocations Inc
United States
1 day ago
Remote AI Chatbot Trainer & Evaluator
$20 per hour
A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing... ..., writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent...
Remote work
Hourly pay
Flexible hours
SupportFinity
United States
1 day ago
Senior AI Protocol Engineer - Developer Reputation Platform
$75 per hour
...technical contributions, and AI-based analysis. We’re looking... ...experienced Senior AI Protocol Engineer to design and improve the AI systems... ...classification, and technical evaluation pipelines * Integrate LLMs... ...or built. Pay: $75 Hours: 40hr/wk Remote: Fully Remote...
Remote work
Contract work
AntfarmDAO
Washington DC
21 days ago
AI Platform Engineer
...Description Role : Senior Agentic AI Developer Location : Remote Schedule : EST Hours... ...workflows, and deploying cloud-native applications that... ...Collaborate with product, engineering, and business teams to... ...AI-driven solutions. Evaluate, test, and optimize LLM performance...
Remote work
CEI
West Chester, PA
9 days ago
Remote Senior AI Engineer, Voice Platform
...future of work: the first truly converged AI workspace unifying tasks, docs, chat,... ...is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process.... ...an employment visa for roles outside of engineering and product at this time. Sponsorship for...
Remote work
Full time
Visa sponsorship
Work visa
ClickUp
Remote
29 days ago
AI Platform Engineer
$100k - $150k
...software development company delivering cloud, AI, data, and enterprise solutions... ...potential. Job Title: AI Platform Engineer Location: 100% Remote (Continental United States)... ...engineering and cloud-native development. Evaluate emerging AI infrastructure...
Remote work
Full time
H1b
Local area
Immediate start
Visa sponsorship
Bright Vision Technologies
Powell, OH
more than 2 months ago
AI/ML Cloud Engineer (TS/SCI Polygraph Required)
...Role: Senior AI/ML Cloud Engineer (TS/SCI Polygraph Required) Location: Remote w/ occasional travel D.C A high-growth AI infrastructure company is hiring a... ...own technical pre-sales engagements, run complex evaluations, and help agencies deploy secure cloud-development...
Remote work
Full time
Colossus Technologies Group
Washington DC
3 days ago
Azure AI Engineer
...are currently seeking a Azure AI Engineer to join our team in Bangalore... ...and decision-making. Evaluate and integrate foundation models... ...accelerators. Azure AI & Cloud Development Develop AI... .... While many positions offer remote or hybrid work options, these...
Remote work
Work at office
Flexible hours
NTT DATA, Inc.
Indiana
13 days ago
AI Engineer - Trust & Explainability (AI Platform)
$104.15k - $177.6k
...Our partner is looking for an AI Engineer – Trust & Explainability (AI... ...for tracing agent workflows, evaluating non-deterministic outputs, and... ..., Azure OpenAI, or other cloud-managed model services is beneficial... ...-related factors. ~ Fully remote work within the United States...
Remote work
Full time
Flexible hours
jobgether
United States
6 days ago
Health AI Conversation Evaluator - AI Trainer
$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate the relevance...
Remote work
Contract work
Summer work
Mercor
New York, NY
5 days ago
AI Trainer & Evaluator
$20 - $80 per hour
...Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on how AI models learn, reason, and perform across diverse subject areas. Key Responsibilities Evaluate...
Remote work
Hourly pay
Contract work
For contractors
SaidGig
United States
more than 2 months ago
Senior Staff AI Engineer - Agentic AI Platform (Remote Eligible)
$286.2k - $326.7k
Senior Staff AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and... ...similarity search, guardrails, model evaluation, experimentation, governance, and... ...scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud,...
Remote work
Full time
Part time
Local area
Capital One
New York, NY
14 hours ago
Senior AI Platform Engineer
$190k - $230k
...Platform unites agentic AI solutions with the... ...exposures across code, cloud, and AI systems. Through... ...accountability. Senior Software Engineer, AI PlatformLocation:... ...the benefits of remote work. Must be able and... ...red teaming agents and evaluation tools that help identify...
Remote work
Apprenticeship
Work at office
Local area
Flexible hours
Shift work
1 day per week
HackerOne
Washington DC
1 day ago
Staff AI Engineer - Enterprise Analysis Platform (Remote Eligible)
$244.7k - $279.2k
Staff AI Engineer - Enterprise Analysis Platform (Remote Eligible) At Capital One, we are creating responsible and reliable... ...search, guardrails, model evaluation, experimentation, governance, and... ...and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud...
Remote work
Full time
Part time
Local area
Capital One
McLean, VA
14 hours ago
Senior ML/AI Platform Engineer (Databricks )
$130k - $147k
...every decision. Our AI-first platform... ...is open to hybrid/ remote candidates based in... ...Senior ML/AI Platform Engineer to help build and... ...scalable evaluation and monitoring frameworks... ...ML, AI, data, or cloud platforms in production... ...Experts and specialist products Regular...
Remote work
Part time
Work at office
Work from home
Flexible hours
Curinos Inc
New York, NY
a month ago
Frontend Code Evaluation Specialist - AI Trainer
$90 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Frontend Engineer Type: Contract Compensation... ...: $90/hour Location: Remote Role Responsibilities... ..., preference-labeling, model-evaluation, or structured code-review work...
Remote work
Contract work
Summer work
Local area
Mercor
San Francisco, CA
5 days ago
AI/ML Engineer, Internal Platforms
$130 - $160 per hour
...Build production AI capabilities for a next generation... ...and scalable engineering. Key Responsibilities... ...agent orchestration. Evaluate model performance and improve... ...GCP, Azure, or another cloud platform. Strong... ...Work Terms ~ Full time, remote role. Compensation...
Remote work
Full time
SaidGig
United States
more than 2 months ago
Staff AI Engineer - AI Infrastructure & Agentic Platform
...Staff AI Engineer ShiftKey is a healthcare workforce marketplace operating... ...operating AI agents in the cloud, and the retrieval layer that... ..., but we're open to hiring remote within Poland for this role.... ...-window management, and evaluation of retrieval quality in production...
Remote work
Contract work
Work experience placement
Work at office
Shift Key
United States
20 hours ago
Principal AI Platform Engineer
$139.7k - $232.9k
...Role Summary The Principal AI Platform Engineer serves as a senior technical authority responsible... ...prompt engineering standards, evaluation methodologies, and testing frameworks... ...AI Services, OpenAI technologies, and cloud-native AI platforms. Experience establishing...
Remote work
Work experience placement
M&T Bank
United States
2 days ago
AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)
$229.9k - $262.4k
AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable AI systems, changing banking for good... ...scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent...
Full time
Part time
Local area
Capital One
McLean, VA
14 hours ago
Data Engineer - AI Model Evaluator - AI Trainer
$80 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: Data Engineer (Coding Agent Experience) Type... ...: $80/hour Location: Remote Role Responsibilities... ...coding agents to complete and evaluate complex data engineering tasks...
Remote work
Contract work
Summer work
Mercor
Philadelphia, PA
5 days ago
Cloud Engineer - AI Trainer
...Cloud engineers to build the infrastructure and automation scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve... ...you start. ~ Fully remote, fully async. No fixed hours...
Remote work
Weekly pay
Contract work
For contractors
10 hours per week
Jobleads-US
Jersey City, NJ
1 day ago
Staff Engineer, AI & Platform Engineering
$200k - $220k
...We are looking for a Staff Engineer with deep technical experience... ...team, including our adoption of AI assisted development practices... ...practices across the team, including evaluating tools, establishing best... ...design, agile development, and remote collaboration tools such as...
Remote work
Full time
Jobleads-US
San Francisco, CA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Cloud Engineer & AI Evaluation Specialist. Be the first to apply!