DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$400 per month
...partnering with a leading AI research lab to support a... .... Contributors help evaluate and improve frontier AI coding models through structured technical... ...realistic infrastructure engineering workflows and model evaluation... ...2+ years of professional DevOps, SRE, or Cloud...Suggested- ...relevance. This is a great opportunity for professionals with strong analytical skills and domain expertise to contribute to high-impact evaluation projects. Basic Qualifications Bachelor’s degree (minimum) At least 3+ years of professional experience in a relevant domain...Suggested
$80 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...SuggestedContract workSummer workRemote workMercor
Miami, FL4 days ago$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $... ...independently to meet deadlines and improve AI model performance. Qualifications Must-...SuggestedContract workSummer workWork at officeRemote work$160k - $200k
...LinkedIn, X (Twitter), and Instagram. Role OverviewBlackstone's DevOps Engineering team enables application teams to securely build, deploy, and... ...solutions, and standardized development environments.Manage AI coding assistants, including Claude, and context management platforms...SuggestedFull timeLocal areaRemote work$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...fluency in R and Python . Strong foundation in statistical modeling and experimental design. Experience with multi-step computational...Contract workSummer workRemote workMercor
Miami, FL8 days ago- YO AI Labs is seeking an experienced Developer & Infrastructure Expert for a remote contractor role. You will test AI-powered workflows across DevOps, cloud infrastructure, SRE, and platform engineering, evaluating AI-generated commands, configurations, and deployment workflows...Remote jobFor contractors
- ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...Full timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
- ...PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering... ...research problems that today's frontier models cannot solve. Domains - depth required... ...Prior scientific software or research engineering experience Engagement Duration: 6 weeks...Part timeImmediate start
$100k - $160k
...the place for you!We are looking for a DevOps Engineer to join our amazing Cloud Engineering team... ...smooth operations.Participate in evaluating and integrating new technologies to enhance... ...role.We may use artificial intelligence (AI) tools to support parts of the hiring process...Full timeWork experience placementLocal areaImmediate startRemote work$105.4k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...you'll doAs a Senior Engineering Management Specialist - DevOps Engineer on the Industry Solutions team, you will be...Local area- ...Outlier connects subject matter experts with AI training projects Outlier is one of the world's largest expert platforms, connecting... ...700,000 MAs, PhDs, and college graduates worldwide to improve AI models by providing expert human feedback. Experts on Outlier work wherever...Weekly paySelf employmentFreelanceWorldwide
Outlier AI
Miami, FL1 day ago - Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You...Remote jobFull time
- Mercor is seeking experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong...Remote jobHourly payWork at office
$40 per hour
AI Trainer - Materials Science Specialists (Remote Advisory) We are seeking AI Trainers - Materials Science Specialists to join our expert... ...graphical abstract doesn't accurately represent the scientific paper. Improving cutting‑edge AI models. #J-18808-Ljbffr ProlificRemote job- ...defining it. Harnessing the full power of AI and digital innovation, we deliver... ...cloud infrastructure solutions using modern DevOps IaC and CICD processes; integrate solutions... ...recent experience working in a DevOps/System Engineering roleBachelor's Degree from an accredited...H1bLocal area
$70 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate the quality, fidelity, and completeness... ...and remediation tasks for AI model training. Assess CVE... ...design, or QA for security-focused engineering tasks. Application Process...Contract workSummer workRemote workMercor
Miami, FL4 days ago- ...information: We are looking for a Senior DevOps Engineer to join one of our international banking clients under a hybrid work model. In this role, you will play a key part in... .... We may use artificial intelligence (AI) tools to support parts of the hiring process...
Coderio
Miami, FL4 days ago $40 per hour
A leading AI research organization is seeking AI Trainers specializing in Materials Science for remote advisory roles. Candidates should possess a Masters... ...reviewing scientific papers for accuracy and enhancing AI models. Participants can earn $40+/hr for tasks requiring...Remote job$400 per month
...Mercor is partnering with a leading AI research lab to support a Frontier... ...project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments... ...on realistic machine learning engineering workflows and model evaluation. Spots...$200k
...growing technology company who is in search for an seasoned Senior DevOps Engineer to join a crucial team that is integral for the day-to-day... ...in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr Forsyth BarnesFull timeRemote workRelocation package- ...relevance. This is a great opportunity for professionals with strong analytical skills and domain expertise to contribute to high-impact evaluation projects. Basic Qualifications Bachelor's degree (minimum) At least 2+ years of professional experience in a relevant domain...
- ...a strong, hands‑on developer who can take internally built AI tools and turn them into secure, production‑ready applications... ...for Strong experience as a full‑stack developer, software engineer, or dev/devops hybrid Experience taking prototypes or messy internal tools...Immediate startRemote work
- Mercor is partnering with a leading AI research lab to support a Frontier... ...Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical... ...focuses on realistic machine learning engineering workflows and model evaluation. As...For contractors
- ...is looking for fluent Spanish speakers from Spain, Argentina, Chile, Mexico, or Colombia for a remote freelance role in a high-impact AI training initiative for Hume. Participants will engage in live, conversational video calls to help train AI on human emotions and...Remote jobFreelance
- ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
- (Hiring) DevOps EngineerWe are seeking a DevOps Engineer to join our team! You will design and develop solutions to complex application problems or network concerns.Responsibilities:Oversee the installation of operating systems, network systems, software, and hardwareMonitor...
Viper Staffing Services L.L.C.
Miami, FL3 days ago - ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
- ...technology and leadership in cloud, data and AI with unmatched industry experience,... ...industry knowledge and applied AI and data engineering. We help the world’s leading Resources and... ..., AI platforms, and governance models that turn data into trusted, production-grade...Full timeWork experience placementLive inWork at officeLocal area
$76.73k - $127.88k
...environment? As an experienced Data Engineer, you will have the ability to... ...under our Project Talent Model. Project Talent Model (PTM) is... ...outcomes The TeamAI & Data - AI & Engineering leverages cutting... ...and ELT patterns.Knowledge of DevOps principles: CI/CD pipelines, version...Local areaVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches
- senior devops cloud engineer Miami, FL
- devops engineer Miami, FL
- devops engineer remote Miami, FL
- senior devops engineer remote Miami, FL
- devops aws developer (remote) Miami, FL
- big data devops engineer Miami, FL
- ai evaluator Miami, FL
- social media evaluator Miami, FL
- evaluator Miami, FL
- education evaluator Miami, FL