DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$80 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...SuggestedContract workSummer workRemote work$160k - $200k
...LinkedIn, X (Twitter), and Instagram. Role OverviewBlackstone's DevOps Engineering team enables application teams to securely build, deploy, and... ...solutions, and standardized development environments.Manage AI coding assistants, including Claude, and context management platforms...SuggestedFull timeLocal areaRemote workBlackstone Group
Miami, FL18 hours ago$500 per unit
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...improve your own real project using the open-weight and Gemini models we provide. Choose which AI model to use for each task and...SuggestedContract workSummer workImmediate startRemote workFlexible hoursMercor
Miami, FL3 days ago$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...fluency in R and Python . Strong foundation in statistical modeling and experimental design. Experience with multi-step computational...SuggestedContract workSummer workRemote workMercor
Miami, FL12 days ago$18 per hour
Prolific seeks AI Trainers in the United States to contribute to academic and applied research studies. You will be paid to participate in a wide range of projects, from AI training to behavioral experiments, with flexible hours and the convenience of working from home....SuggestedRemote jobWork from homeFlexible hours$500 per month
Role Overview Mercor is partnering with a leading AI research organization to understand how people build with AI coding assistants.... ...or improve your own real project using the open-weight and Gemini models we provide Choose which model to use for each task, and switch whenever...Immediate startRemote workFlexible hours- ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...Full timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
Carnival Cruise Line
Miami, FL2 days ago $116.2k - $229.1k
Position Summary AI & Engineering/EaaS - DevOps Engineer IIIBuild and scale modern DevOps capabilities that help clients accelerate delivery... ...engineering processes and define target-state DevOps operating models, tooling, and workflowsBuilding and maintaining cloud...Local areaDeloitte
Miami, FL4 days ago$80 - $110 per hour
About the work CritPt is a public benchmark of research-level physics challenges, built to test whether frontier AI models can carry out genuine physics research reasoning rather than textbook problem solving. The benchmark paper is arXiv:2509.26574 and we recommend reading...Hourly payImmediate startRemote work10 hours per week- ...your Excel expertise at the core of how the next generation of AI models learns to work in spreadsheets. 1. Overview We're seeking... ...professional experience, and write accurate, well-structured solutions. Evaluate Excel tasks and solutions and provide clear, written feedback....Contract workWeekday work
- ...PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with... ...problems that today's frontier models cannot solve. Domains - depth required... ...Prior scientific software or research engineering experience Engagement Duration: 6 weeks...Part timeImmediate start
$105.4k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...you'll doAs a Senior Engineering Management Specialist - DevOps Engineer on the Industry Solutions team, you will be...Local areaDeloitte
Miami, FL18 hours ago$85k - $120k
...advanced analytics, Generative AI, transformative technologies,... ...operators, creatives, designers, engineers, and architects. Our team... .... The Project Delivery Talent Model is designed for professionals... ...Web Services (AWS), MS Azure DevOps, Git, CI / CD PipelineMust be...Local areaDeloitte
Miami, FL18 hours ago- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You...Remote jobFull time
$120 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote workMercor
Miami, FL12 days ago- Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale...Remote jobHourly payContract workFlexible hours
- Mercor is seeking experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong...Remote jobHourly payWork at office
$130k - $140k
...DO: We are seeking a highly skilled and experienced Senior DevOps Engineer to join our dynamic and innovative team. In this role, you will... ...communication and collaboration abilities. ~ Generative AI experience is preferred (integrating AI workflows, automation,...EOS
Miami, FL10 days ago$80 - $110 per hour
About the work CritPt is a public benchmark of research-level physics challenges, built to test whether frontier AI models can carry out genuine physics research reasoning rather than textbook problem solving. The benchmark paper is arXiv:2509.26574 and we recommend reading...Hourly payImmediate startRemote work10 hours per week- About KaseyaKaseya is the leading provider of AI-powered IT management and cybersecurity software, serving Managed Service Providers... ...plays a role in shaping the future of IT: whether you're in engineering, product, sales, marketing, customer support, or operations, your...Second jobWorldwide
Kaseya
Miami, FL1 day ago - ...reports, including Power Query transformations, DAX measures, data models, and reporting logic. Prepare and distribute a biweekly Risk... ...analysis, statistical techniques, and advanced Excel tools to evaluate business drivers, support dynamic pricing, and contribute to...Full time
StevenDouglas
Miami, FL2 days ago $170k
...lifecycle. You'll own and evolve production models that shape: Lead valuation &... ...monitoring, partnering closely with Product, Engineering, and Business leaders. You'll likely... ...to-end ownership Strong investment in AI/ML Exposure across marketing, pricing...Harnham
Miami, FL3 days ago$140k
...Principal Network Automation / DevOps Engineer Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button. Location: Miami (Doral), FL, Hybrid Monday-Thursday with Fridays Remote...Contract workRemote workMonday to FridayInsight Global
Miami, FL1 day ago$86.7k - $170.9k
...strategies, advanced analytics, Generative AI, transformative technologies, and... ...scientists, operators, creatives, designers, engineers, and architects. Our team balances business... ...goals into machine learning use cases and model design approaches.Performing exploratory...Local areaDeloitte
Miami, FL1 day ago$91.1k - $179.5k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving... ...& data platforms. Our delivery models are tailored to meet each client's unique... ...orchestration, tool integration, state management, evaluation, guardrails, and human-in-the-loop...Local areaVisa sponsorshipDeloitte
Miami, FL2 days ago- ...Position Title: DevOps Engineer Location: Miami, FL (Hybrid) Need Local, Onsite interview!! Position Summary: Key Responsibilities... ...to operate effectively in Agile, Scrum, or Kanban delivery models. Strong analytical, troubleshooting, and problem-solving...Full timeLocal area
Marlabs
Miami, FL3 days ago $46 - $63 per hour
DescriptionKforce has a client that is seeking an AI Cloud Platform Engineer in Miami, FL (Florida).Summary:Join a global organization building the... ...to production.Key Responsibilities:* Design and build Model Context Protocol (MCP) services that securely connect AI agents...KForce
Miami, FL18 hours ago$101k - $194k
...mission of Verizon, our team provides cutting-edge AI tooling and capabilities to empower over 15,000... ...are seeking a highly skilled and innovative AI Engineer to focus on evaluating, fine-tuning, and deploying open-source models, LLMs, and foundational models, building...Full timeTemporary workPart timeWork experience placementWork at officeWork from homeShift work3 days per weekVerizon
Miami, FL2 days ago- (Hiring) DevOps EngineerWe are seeking a DevOps Engineer to join our team! You will design and develop solutions to complex application problems or network concerns.Responsibilities:Oversee the installation of operating systems, network systems, software, and hardwareMonitor...
Viper Staffing Services L.L.C.
Miami, FL2 days ago - ...Description:Design and implement advanced ML models and statistical methods to optimize... ...summarizing transformation workflows, feature engineering processes, and audit compliance.Job... ...model explainability, and bias mitigation in AI/ML applications is required. Personnel...
Prescient Edge
Miami, FL3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches