DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$20 per hour
...Job Description Job Description We are hiring remote AI Model Evaluators and AI Trainers to support multiple ongoing AI training projects. We are building an in-house contributor team for work across AI model evaluations, computer-use tasks, response ranking, red...SuggestedPart timeFor contractorsWork experience placementRemote workFlexible hoursDraft labs
Miami, FL9 days ago$17 per hour
...creates the examples and feedback that make advanced systems more accurate, consistent, and useful. What You'll Do Evaluate outputs from AI models, text, images, video, and documents against detailed criteria. Assess quality, spot errors and inconsistencies, and...SuggestedContract workRemote workFlexible hoursWorkada
Key Biscayne, FL1 day ago- ...Overview We are looking for Generalists with strong analytical and critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information across different topics while maintaining high accuracy and quality....SuggestedRemote jobFor contractors
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $... ...independently to meet deadlines and improve AI model performance. Qualifications Must-...SuggestedContract workSummer workWork at officeRemote work$80 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...SuggestedContract workSummer workRemote work$160k - $200k
...LinkedIn, X (Twitter), and Instagram. Role OverviewBlackstone's DevOps Engineering team enables application teams to securely build, deploy, and... ...solutions, and standardized development environments.Manage AI coding assistants, including Claude, and context management platforms...Full timeLocal areaRemote workBlackstone Group
Miami, FL6 days ago- ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...Full timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
Carnival Cruise Line
Miami, FL3 days ago $116.2k - $229.1k
Position Summary AI & Engineering/EaaS - DevOps Engineer IIIBuild and scale modern DevOps capabilities that help clients accelerate delivery... ...engineering processes and define target-state DevOps operating models, tooling, and workflowsBuilding and maintaining cloud...Local areaDeloitte
Miami, FL5 days ago$105.4k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...you'll doAs a Senior Engineering Management Specialist - DevOps Engineer on the Industry Solutions team, you will be...Local areaDeloitte
Miami, FL6 days ago$15 per hour
...Description Job Description Job description: What if your knowledge Spanish language?could help improve the AI.? ?? WHAT YOU’LL DO ? Review, evaluate, and validate AI-generated content and data according to project guidelines. Compare AI-generated outputs...Hourly payFreelanceWork at officeRemote workWelo Data
Miami, FLa month ago$85k - $120k
...advanced analytics, Generative AI, transformative technologies,... ...operators, creatives, designers, engineers, and architects. Our team... .... The Project Delivery Talent Model is designed for professionals... ...Web Services (AWS), MS Azure DevOps, Git, CI / CD PipelineMust be...Local areaDeloitte
Miami, FL1 day ago$80 - $110 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 10 hours/week Role Responsibilities Evaluate AI model training and improve model outputs in research-level physics...Contract workSummer workRemote workMercor
Miami, FL6 days ago- About KaseyaKaseya is the leading provider of AI-powered IT management and cybersecurity software, serving Managed Service Providers... ...plays a role in shaping the future of IT: whether you're in engineering, product, sales, marketing, customer support, or operations, your...Second jobWorldwide
Kaseya
Miami, FL2 days ago $116.2k - $229.1k
...optimization, simulation, forecasting, scheduling, inventory, and network-design models.· Build and integrate analytical solutions using Python, SQL, data pipelines, and enterprise systems.· Evaluate scenarios and trade-offs to quantify impacts on service, cost, capacity,...Local areaDeloitte
Miami, FL3 days ago$170k
...lifecycle. You'll own and evolve production models that shape: Lead valuation &... ...monitoring, partnering closely with Product, Engineering, and Business leaders. You'll likely... ...to-end ownership Strong investment in AI/ML Exposure across marketing, pricing...Harnham
Miami, FL4 days ago- ...downstream business outcomes. Develop and enhance marketing attribution, measurement frameworks, and customer acquisition models. Design and evaluate A/B tests and experiments to measure marketing effectiveness and identify growth opportunities. Leverage SQL, Python...
Harnham
Miami, FL3 days ago $91.1k - $179.5k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving... ...& data platforms. Our delivery models are tailored to meet each client's unique... ...orchestration, tool integration, state management, evaluation, guardrails, and human-in-the-loop...Local areaVisa sponsorshipDeloitte
Miami, FL4 days ago$137.5k - $193.6k
...strategies, advanced analytics, Generative AI, transformative technologies, and... ...scientists, operators, creatives, designers, engineers, and architects. Our team balances business... ...goals into machine learning use cases and model design approaches.Performing exploratory...Local areaDeloitte
Miami, FL5 days ago$34 - $46 per hour
DescriptionKforce has a client seeking an AI Cloud Platform Engineer in Miami, FL.Key Responsibilities:AI... ...:* Design, develop, and maintain Model Context Protocol (MCP) services that securely... ..., monitoring, and data protection* Evaluate and mitigate risks such as prompt...KForce
Miami, FL4 days ago$112.8k - $257k
...The world can’t wait. You Have:Experience leading AI/ML analytics programsExperience developing, deploying... ...collaboration between data science and data engineering teamsExperience building and validating AI/ML models using Python, TensorFlow, PyTorch, or Scikit-learnExperience...Full timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Miami, FL4 days ago$101k - $194k
...mission of Verizon, our team provides cutting-edge AI tooling and capabilities to empower over 15,000... ...are seeking a highly skilled and innovative AI Engineer to focus on evaluating, fine-tuning, and deploying open-source models, LLMs, and foundational models, building...Full timeTemporary workPart timeWork experience placementWork at officeWork from homeShift work3 days per weekVerizon
Miami, FL4 days ago- ...Description:Design and implement advanced ML models and statistical methods to optimize... ...summarizing transformation workflows, feature engineering processes, and audit compliance.Job... ...model explainability, and bias mitigation in AI/ML applications is required. Personnel...
Prescient Edge
Miami, FL4 days ago $176k - $179.5k
...Apply: be on the global Life Sciences AI team, fully integrated with... ..., develop advanced machine learning models, design agentic flows, evaluate agentic outputs, write optimized code... ...learning, applied statistics, mathematics, engineering, or artificial intelligence5+ years...ApprenticeshipWorldwideEasy workMcKinsey & Company
Miami, FL3 days ago$99k - $225k
...camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools....Full timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Miami, FL4 days ago- ...We are in search of a highly motivated candidate to join our talented Team.Job Title: DevOps Senior EngineerLocation(s): Miami, FL Job Summary We are seeking a Senior DevOps Engineer with strong Harness.io, CI/CD, Infrastructure as Code (IaC), and platform automation...Immediate startRemote work
Ampcus
Miami, FL4 days ago - ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Miami, FL6 days ago - ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Miami, FL2 days ago $77k - $202k
...The Opportunity As an AI & GenAI Data Scientist-Senior Associate... ...analytics, statistical modeling, exploratory analysis, and data... ...our Data and Analytics Engineering practice. As a Senior Associate... ...closely with team members. We evaluate these factors thoughtfully to...H1bShift workPwC
Miami, FL5 days ago$128k - $249k
....We are seeking a Senior Data Engineer to join the firm. The Senior Data... ...Applications, Data, and AI Platforms group, designing scalable... ...schema design, dimensional modeling, Medallion Architecture implementation... ...collaborating within an Agile DevOps model. Supporting CI/CD...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shiftK&L Gates
Miami, FL2 days ago$127k - $150k
Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology... ...Informatica, Airflow, GitHub, and Azure DevOps. The successful candidate would possess... ...clear guidance to others The Team AI & Data offers a full spectrum of solutions...Local areaVisa sponsorshipDeloitte
Miami, FL1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches