DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$400 per month
...partnering with a leading AI research lab to support a... .... Contributors help evaluate and improve frontier AI coding models through structured technical... ...realistic infrastructure engineering workflows and model evaluation... ...2+ years of professional DevOps, SRE, or Cloud...Suggested- ...relevance. This is a great opportunity for professionals with strong analytical skills and domain expertise to contribute to high-impact evaluation projects. Basic Qualifications Bachelor’s degree (minimum) At least 3+ years of professional experience in a relevant domain...Suggested
$80 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...SuggestedContract workSummer workRemote work$100 per hour
Mercor is recruiting expert US/Europe-based senior SWEs for a highly challenging project with a leading foundational model AI lab. You are a good fit if you: Have 10+ years of experience working at top US tech firms Are passionate about improving model capabilities at...SuggestedOdd jobContract work$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...fluency in R and Python . Strong foundation in statistical modeling and experimental design. Experience with multi-step computational...SuggestedContract workSummer workRemote workMercor
Miami, FL2 days ago$116.2k - $229.1k
Position Summary AI & Engineering/EaaS - DevOps Engineer IIIBuild and scale modern DevOps capabilities that help clients accelerate delivery... ...engineering processes and define target-state DevOps operating models, tooling, and workflowsBuilding and maintaining cloud...Local areaDeloitte
Miami, FL4 days ago$55 - $65 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$55–$65/hour Location: Remote Role Responsibilities Evaluate and utilize Visual Studio Code on macOS for specialized applications...Contract workSummer workRemote workMercor
Miami, FL2 days ago- ...your Excel expertise at the core of how the next generation of AI models learns to work in spreadsheets. 1. Overview We're seeking... ...professional experience, and write accurate, well-structured solutions. Evaluate Excel tasks and solutions and provide clear, written feedback....Contract workWeekday work
- ...Kaseya Kaseya is the leading provider of AI-powered IT management and cybersecurity... ...the future of IT: whether you're in engineering, product, sales, marketing, customer support... ...dependencies in tooling (Jira, Azure DevOps, or equivalent) Understand and manage...Live inWorldwide
Kaseya Careers
Miami, FL4 days ago - Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale...Remote jobHourly payContract workFlexible hours
$40 per hour
AI Trainer - Materials Science Specialists (Remote Advisory) We are seeking AI Trainers - Materials Science Specialists to join our expert... ...graphical abstract doesn't accurately represent the scientific paper. Improving cutting‑edge AI models. #J-18808-Ljbffr ProlificRemote job$120 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote workMercor
Miami, FL2 days ago$130k - $140k
...: We are seeking a highly skilled and experienced Senior DevOps Engineer to join our dynamic and innovative team. In this role, you will... ...communication and collaboration abilities. ~ Generative AI experience is preferred (integrating AI workflows, automation,...Full time- YO AI Labs is seeking a PhD and academic expert to support AI research projects remotely. You will apply subject-matter expertise to evaluate and improve AI model responses across technical and humanities disciplines. You will design expert prompts, reference answers, and...Remote job
- ...a strong, hands‑on developer who can take internally built AI tools and turn them into secure, production‑ready applications... ...for Strong experience as a full‑stack developer, software engineer, or dev/devops hybrid Experience taking prototypes or messy internal tools...Immediate startRemote work
- Mercor is partnering with a leading AI research lab to support a Frontier... ...Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical... ...focuses on realistic machine learning engineering workflows and model evaluation. As...For contractors
$55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: Remote Role Responsibilities Evaluate VMware Fusion applications on macOS... ...IT administrators , sysadmins , and DevOps engineers to enhance cross-platform development....Contract workSummer workRemote work$46 - $63 per hour
DescriptionKforce has a client that is seeking an AI Cloud Platform Engineer in Miami, FL (Florida).Summary:Join a global organization building the... ...to production.Key Responsibilities:* Design and build Model Context Protocol (MCP) services that securely connect AI agents...KForce
Miami, FL12 hours ago- ...is looking for fluent Spanish speakers from Spain, Argentina, Chile, Mexico, or Colombia for a remote freelance role in a high-impact AI training initiative for Hume. Participants will engage in live, conversational video calls to help train AI on human emotions and...Remote jobFreelance
$176k - $179.5k
...Apply: be on the global Life Sciences AI team, fully integrated with... ..., develop advanced machine learning models, design agentic flows, evaluate agentic outputs, write optimized code... ...learning, applied statistics, mathematics, engineering, or artificial intelligence5+ years...ApprenticeshipWorldwideEasy workMcKinsey & Company
Miami, FL1 day ago$15 per hour
...Description Job Description Job description: What if your knowledge Spanish language?could help improve the AI.? ?? WHAT YOU’LL DO ? Review, evaluate, and validate AI-generated content and data according to project guidelines. Compare AI-generated outputs...Hourly payFreelanceWork at officeRemote work- ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Miami, FL1 day ago $130 per unit
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: Software Engineer, Python — Codebase Q&A Type: Contract Compensation: $...Contract workSummer workRemote workMercor
Miami, FL2 days ago- ...DevSecOps Engineer Location: Miami, Florida (In-Office) The DevSecOps Engineer is responsible for integrating security practices... ...Integrate security tools, monitoring, and automated testing into DevOps workflows. Collaborate with development, operations, and...Work at office
Dupont Registry
Miami, FL1 day ago - ...DevSecOps Senior Engineer Empresa: Zemsania Ubicación: Monterrey, México (Modalidad Híbrida) Tipo de Contrato: Indefinido... ...Indispensables: Más de 5 años de experiencia comprobada en roles de DevOps y/o DevSecOps. Sólida experiencia en la implementación y...Full timeShift work
Zemsania
Miami, FLa month ago - ...innovative company dedicated to delivering exceptional solutions to our clients. We are seeking a highly skilled and versatile DevOps Engineer to join our growing team. This role is hands-on and deeply technical — ideal for someone experienced in infrastructure automation...
duPont REGISTRY
Miami, FLa month ago - ...bases de datos SQL y NoSQL. Cloud Computing: Experiencia sólida en Google Cloud Platform (GCP), incluyendo servicios como BigQuery, AI Platform, Vertex AI, Cloud Storage. Inteligencia Artificial y Machine Learning: Profundo conocimiento de algoritmos de ML (...Full timeRemote work
Zemsania
Miami, FL28 days ago - ..., and turn complex data into models, insights, and decision-support... ...Data Operations and Software Engineering to ensure reliable access to... ..., energy, infrastructure, AI, colocation, cloud, and mining... ...inference, and scenario modeling to evaluate decisions and quantify...Work at office
Hut 8
Miami, FL6 days ago $176k - $179.5k
...8-20Apply: be on the global Life Sciences AI team, fully integrated with QuantumBlack, AI by McKinsey, as a senior software engineer, building AI that transforms Pharma and MedTech... ...support McKinsey’s asset-based consulting model and help clients harness the full potential...ApprenticeshipEasy workShift workMcKinsey & Company
Miami, FL1 day ago$86.7k - $170.9k
Position Summary Join Deloitte’s Core AI & Data practice and help organizations... ...capabilities. As a Databricks Data Engineer, you will support the design, build, and... ...data architecture, integration, and data modeling practices to improve data quality, scalability...Local areaVisa sponsorshipDeloitte
Miami, FL12 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
