Remote DevOps Engineer for AI Model Evaluation
Mercor Inc
Mercor is hiring a DevOps/SRE/Cloud Engineer (Coding Agent Experience) to work remotely on frontier AI coding agents for infrastructure tasks. The role covers evaluating model-generated infrastructure, cloud platforms, Kubernetes, CI/CD, observability, and automation. Candidates should have 2+ years in DevOps/SRE/Cloud Eng and hands-on cloud and tooling experience. As a contractor, you will collaborate asynchronously to meet sprint goals, with compensation tied to accepted tasks and performance. #J-18808-Ljbffr
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote DevOps Engineer for AI Model Evaluation in San Francisco, CA vacancy
$85 per hour
...talent with leading AI research labs. Headquartered... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent... ...: $85/hour Location: Remote Role Responsibilities... ...agents to complete and evaluate complex infrastructure... ...engineering tasks. Review model-generated...Remote workContract workSummer workMercor Inc
San Francisco, CA5 days ago$85 per hour
...talent with leading AI research labs. Headquartered... .... Position: DevOps / SRE / Cloud Engineer (Coding Agent... ...hour Location: Remote Role Responsibilities... ...agents to complete and evaluate complex infrastructure... ...tasks. Review model-generated implementations...Remote workContract workSummer work$15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier... ...projects, from generating training data to evaluating the performance of models. About the opportunity: We are... ...what looked or sounded wrong, all remotely and on your own schedule. At...Remote workHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shiftOutlier AI
State College, PA14 hours ago- ...DataAnnotation is seeking an Accountant - AI Model Evaluator to help train AI models by solving complex finance problems and evaluating chatbot... ..., a bachelor's degree, and prefers a master's or PhD. Remote work from home, with hourly pay and potential bonuses on select...Remote workHourly payWork from homeFlexible hours
DataAnnotation
New York, NY8 hours ago $150 per hour
...experts train the world’s leading AI models. The role invites you to run... ...coding sessions on real engineering tasks, fix bugs, extend APIs, ship features, and evaluate how far the model progresses on... ..., more reliable AI. Flexible, remote, project-based work with compensation...Remote workHourly payFlexible hoursDataAnnotation
Bismarck, ND1 day ago- ...oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models, compare generated media, and provide... ...schedule. Responsibilities include evaluating images, videos, and audio, rating outputs...Remote work
Outlier
Cheyenne, WY2 days ago - ...International Certified Professional Accountants seeks an Accountant - AI Model Evaluator to train AI models by solving complex finance problems and... ...preferred. Fluent English, strong financial reasoning, and remote contracting from the United States with hourly pay apply. #J-...Remote workHourly pay
Association of International Certified Professional Accounta...
New York, NY10 hours ago - ...-oriented English speakers to review AI-generated media on a remote, flexible schedule. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain... ...include scoring exchanges, evaluating accuracy against prompts, and producing...Remote workWeekly payFlexible hours
Outlier
Jacksonville, FL2 days ago $15 per hour
...Outlier is hiring remote evaluators to review AI-generated media and rate how well outputs follow prompts. You will conduct live conversations with AI voice models, compare image and video pairs, and explain in writing what went off. This is a flexible, remote, 1099 contract...Remote workHourly payWeekly payContract workFlexible hoursOutlier
United States2 days ago$15 per hour
...Outlier is hiring for remote, flexible, paid-evaluation roles where you engage in live conversations with AI voice models, compare AI-generated media, and explain discrepancies in writing. The role supports your schedule and pays up to $15 per hour, with weekly payments...Remote workHourly payWeekly payFlexible hoursOutlier
United States2 days ago- ...oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare images and videos, and explain what’s off in writing, remotely and on your own schedule. Tasks include evaluating realism and adherence to prompts,...Remote workFlexible hours
Outlier
North Las Vegas, NV2 days ago - ...seeks trading professionals to work with researchers to improve AI model performance in finance. You will apply your expertise in trade... ..., market analysis, order flow dynamics, and risk management to evaluate and train AI systems. No prior AI experience required. Daily activities...Remote work
Turing Enterprises, Inc.
Chicago, IL5 days ago - ...Softechub is seeking a Research Evaluation Specialist (PhD or Masters, or Researcher/Professor) to contribute expert insight for rigorous AI model evaluation projects. This is a remote, worldwide contractor role (~15 hours per week) with competitive hourly pay and a flexible...Remote workHourly payPart timeFor contractorsWorldwideFlexible hours
Softechub
New York, NY2 days ago - ...oriented English speakers to review AI-generated media through live conversations with AI voice models. You will compare image and... ...or sounded off. Work remotely on your own schedule and help... ...include assessing conversations, evaluating media quality, and providing concise...Remote work
Outlier
Scottsdale, AZ2 days ago - ...oriented English speakers to review AI-generated media. You will hold... ...conversations with AI voice models, compare image/video pairs, and explain what’s off, all remotely and on your own schedule. Earn... ...include live demonstrations, evaluating outputs for realism and...Remote workWeekly payFreelance
Outlier
United States2 days ago $15 per hour
...Outlier is hiring evaluators to review AI-generated media by holding live conversations with AI voice models and comparing outputs. Work remotely on your own schedule and earn up to $15 per hour with weekly payments and performance incentives. You’ll assess image and video...Remote workHourly payWeekly payFlexible hoursOutlier
Honolulu, HI2 days ago$15 per hour
...is hiring detail-oriented reviewers to evaluate AI-generated media from the comfort of your... ...engage in live conversations with AI voice models, compare image and video outputs to... ...written explanations of issues observed. Work remotely with flexible hours and weekly pay,...Remote workHourly payWeekly payFlexible hoursOutlier
Cambridge, MA2 days ago- ...oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on your own schedule. Through Outlier’s evaluation process, your scoring and written explanations...Remote workWeekly payFreelanceFlexible hours
Outlier
Santa Barbara, CA2 days ago - ...DataAnnotation is seeking an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring judgment from years designing, debugging, and shipping hardware, while we provide engineering problems the...Remote work
DataAnnotation
United States10 hours ago - ...Prolific is seeking Materials Science Specialists to join its Expert Network for AI training and evaluation. You will be tested briefly and, if selected, paid to work on tasks that require focused attention and technical accuracy from home. Applicants should hold a...Remote workWorldwide
Prolific
United States2 days ago - ...detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay with AI voice models, score exchanges, and explain in writing... .... Responsibilities include evaluating images, videos, and audio against prompts...Remote workWeekly payContract workFreelanceFlexible hours
Outlier
United States2 days ago - ...oriented English speakers to review AI-generated media. You will hold... ...conversations with AI voice models, score exchanges, and explain what looks or sounds off, all remotely and on your own schedule.... ...generated images and videos to evaluate adherence to prompts, and writing...Remote workFlexible hours
Outlier
New Haven, CT1 day ago $15 per hour
...Get paid to spot what AI-generated media gets wrong Hold... ...live conversations with AI voice models, compare image and video pairs... ...and explain what’s off. Fully remote, flexible hours. Rates... ...and improve. Through Outlier's evaluation and feedback loop, your work...Remote workWeekly payContract workFreelanceInternshipFlexible hoursOutlier
Salem, OR2 days ago$70 - $100 per hour
...chemistry expertise to help develop and evaluate advanced AI models for scientific work. This part-time... ...Guide research and engineering teams in resolving chemistry knowledge... ...models or agents. Work Terms Remote work, available to candidates based in...Remote workHourly payContract workPart timeWeekday workConfidential
Four Oaks, NC2 days ago$15 - $35 per hour
Remote | United States | Project-Based Independent Contractor Compensation... ...Help Shape the Future of AI in Healthcare What if the... ...complex healthcare information, evaluates medical scenarios, and delivers... ...Artificial Intelligence (AI) models. We're seeking individuals currently...Remote workHourly payFor contractorsTraineeshipFreelanceInternshipWeekday work$15 per hour
Outlier is an AI training platform owned and operated by Scale AI. Outlier... ...projects, from generating training data to evaluating the performance of models. About the opportunity: We are... ...what looked or sounded wrong, all remotely and on your own schedule. At Outlier...Remote jobHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift- ...The Ai Training Company seeks experienced AI Product Evaluators, QA Testers, and Model Evaluation Specialists to contribute to a remote project focused on testing advanced AI models and agents. You will follow predefined scenarios, document anomalies, and submit high-quality...Remote workWork from home
The Ai Training Company
United States2 days ago $15 per hour
Outlier invites you to join a remote, on-demand role where you evaluate AI-generated media. You’ll engage in live conversations with voice models, compare outputs, and write concise explanations on what went wrong, all from your preferred location and schedule. The position...Remote jobHourly payWeekly payFlexible hours- ...seeking board-certified critical care physicians (MDs/DOs) to evaluate health AI models in partnership with a leading AI lab. You will read de-... ...standards of care, and writing structured rationales. This is a remote, hourly, part-time engagement with immediate start. #J-18...Remote workHourly payPart timeImmediate start
Mercor Inc
United States4 days ago - Outlier is recruiting detail-oriented English speakers to evaluate AI-generated media fully remotely, on a flexible schedule. You will engage in live conversations with AI voice models, score exchanges, compare AI-generated images and videos, and describe what looked or...Remote jobContract workFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote DevOps Engineer for AI Model Evaluation. Be the first to apply!
Related searches
- devops engineer remote San Francisco, CA
- senior devops cloud engineer San Francisco, CA
- big data devops engineer San Francisco, CA
- devops engineer San Francisco, CA
- senior devops engineer San Francisco, CA
- devops engineer sre San Francisco, CA
- senior devops engineer remote San Francisco, CA
- devops engineer full time San Francisco, CA
- devops aws developer (remote) San Francisco, CA
- support specialist remote San Francisco, CA