DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $... ...independently to meet deadlines and improve AI model performance. Qualifications Must-...SuggestedContract workSummer workWork at officeRemote work$80 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...SuggestedContract workSummer workRemote work$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...answers. Calibrate tasks against frontier models, ensuring tasks ship only when strong models... ...Prior scientific software or research engineering experience. Start Date ~ Immediate...SuggestedContract workSummer workImmediate startRemote workMercor
Miami, FLa month ago- Alignerr Corp. seeks chemistry experts to train and improve AI models. This remote, flexible contract role lets you contribute your chemistry expertise while we handle the rest. You’ll design advanced problems and assess AI reasoning across multiple chemistry domains, with...SuggestedRemote jobContract work10 hours per weekFlexible hours
- Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale...SuggestedRemote jobHourly payContract workFlexible hours
$180k - $200k
...Lead DevOps Engineer / Lead SRE – Manufacturing Orchestration Platform $180K–$200K base + equity | Remote (US), or hybrid if based in Miami You own how a fast-growing AI platform gets deployed inside the factories of some of the world’s biggest aerospace and industrial...Work at officeRemote workSaragossa
Miami, FL8 days ago$45k - $60k
AI Design Evaluator / Design Quality SpecialistAbout the Role We are seeking a detail-oriented design professional to evaluate and improve the... ...quality benchmarks. Compare outputs from different AI models using identical prompts and assets, identifying strengths, weaknesses...Permanent employmentFor contractorsRemote work- ...data science, machine learning, statistical modeling, or advanced analytics. ~ Strong hands-... ..., machine learning, automation, and AI application development. ~ Strong proficiency... ...using LLMs, including prompt engineering and integration of AI capabilities into business...Contract work
Techvilla Solutions
Miami, FL18 days ago $4,500 - $5,800 per week
...play a key role in this mission by developing next-generation models and trading approaches for a range of investment strategies. You... ...talented and accomplished investment professionals, researchers and engineers in the world. Our colleagues are empowered to test their ideas...InternshipFlexible hoursCitadel
Miami, FL2 days ago$4,500 - $5,800 per week
...maker, our team of quantitative researchers models the markets and brings trading strategies... ...of financial products. Our teams of engineers, traders and researchers harness leading-... ...accelerating power of compute, machine learning and AI to power our analytics and tackle the...InternshipFlexible hoursCitadel Securities
Miami, FL5 days ago- Alignerr is seeking a Biochemist — AI Data Trainer to work remotely on an hourly contract. You will design advanced biochemistry problems, author gold-standard solutions, and audit AI outputs to ensure scientific accuracy and safety. PhD-level expertise and independent,...Remote jobHourly payContract workPart timeFlexible hours
- ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...Full timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
Carnival Cruise Line
Miami, FL1 day ago - ...Boeing, Safran, Eaton, and Cartier. Our AI connects fragmented supply chain, production... ...own that frontier. You'll lead a small DevOps team (≈3–5) and own how Pelico is packaged... ...–50% infra work), set the bar, grow your engineers, and bring AI tooling into the team the...Full timeWorldwide
pelico
Miami, FL2 days ago - (Hiring) DevOps EngineerWe are seeking a DevOps Engineer to join our team! You will design and develop solutions to complex application problems or network concerns.Responsibilities:Oversee the installation of operating systems, network systems, software, and hardwareMonitor...
Viper Staffing Services L.L.C.
Miami, FL2 days ago $55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: Remote Role Responsibilities Evaluate VMware Fusion applications on macOS... ...IT administrators , sysadmins , and DevOps engineers to enhance cross-platform development....Contract workSummer workRemote work- ...DevOps EngineerProject Details – Size, Scale, Scope? How does candidate fit into this?“Data Operations” team but they are the DevOps team because they are already having a DevOps teamThe team is a traditional DevOps team with a few differences. Doesn’t have a lot of developers...
Software Technology Inc
Miami, FL3 days ago - Aston Carter seeks an AI Design Evaluator and Design Quality Specialist to assess and improve AI-generated design outputs across UI/UX, web, graphics, and presentations. You will provide structured critique based on professional design standards and briefs. Ideal candidates...Remote job
$85k - $120k
...advanced analytics, Generative AI, transformative technologies,... ...operators, creatives, designers, engineers, and architects. Our team... .... The Project Delivery Talent Model is designed for professionals... ...Web Services (AWS), MS Azure DevOps, Git, CI / CD PipelineMust be...Local areaDeloitte
Miami, FL4 days ago- ...Systems & DevOps EngineerRequired Skills & Experience• FreeBSD Expertise: Deep, hands-on administrative experience with production FreeBSD... ...zpool status).Job DescriptionWe are seeking a Systems & DevOps Engineer to manage, secure, and scale our bare-metal infrastructure and...
Insight Global
Miami, FL4 days ago - ...Description: Design and implement advanced ML models and statistical methods to optimize... ...summarizing transformation workflows, feature engineering processes, and audit compliance. Job... ...model explainability, and bias mitigation in AI/ML applications is required. Personnel...Full time
Prescient Edge
Miami, FL2 days ago - ...Junior DevOps EngineerThe Junior DevOps Engineer is a hands-on Engineer that will be responsible for provisioning, configuring and automating cloud services and cloud native solutions as well as designing and implementing automated software delivery pipelines for enterprise...Contract workImmediate start
Software Technology Inc
Miami, FL4 days ago - ...Kforce has a client seeking an AI Cloud Platform Engineer in Miami, FL. Key... ...Design, develop, and maintain Model Context Protocol (MCP) services... ..., and data protection * Evaluate and mitigate risks such as... ...Code, Codex, and Cursor DevOps & Platform Engineering: *...Hourly payContract work
- ...training, and deploying advanced statistical models and machine learning algorithms to solve... ...cross-functional technical teams, data engineers, and stakeholders to translate... ...findings to decision-makers.Conducting model evaluation, baseline testing, and continuous optimization...Work at office
Hackajob
Miami, FL5 days ago - ...is seeking a Data Scientist / Engineer to support the design,... ...operational deployment of scalable, AI-enabled data solutions within... ...a hybrid of statistical modeling fluency and hands-on software... ...model testing, and performance evaluation techniques.Experience with data...
Agile Defense
Miami, FL5 days ago - ...DevOps EngineerMantech seeks a motivated, career and customer-oriented DevOps Engineer to join our team in Doral, FL.Responsibilities include but are not limited to:Designing, implementing, and maintaining automated CI/CD pipelines for deployment and testing workflows...Work at office
Hackajob
Miami, FL3 days ago - ...DescriptionDescription: Trax USA Corp is seeking a skilled and motivated DevOps Engineer to lead the optimization and automation of Java-based... ...functional and/or technical specifications.Analyses and evaluates detailed business and technical requirements.Self-starter/self...Full timeWorldwideFlexible hours
Trax
Coral Gables, FL1 day ago $150 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 20 hours/week Role Responsibilities Evaluate and enhance AI model capabilities in complex SWE tasks . Collaborate with...Hourly payWeekly payContract workFor contractorsSummer workRemote work$40 - $125 per hour
...Job Description Remote AI Trainer, Data Science Contract | Part... ...to test how well advanced AI models handle real data science work... ...by running your tasks and evaluating the analyses, code, models,... ..., or analysis-adjacent data engineering). Undergraduate study doesn’...Remote jobHourly payFull timeContract workPart timeWork at officeFlexible hours$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...fluency in R and Python . Strong foundation in statistical modeling and experimental design. Experience with multi-step computational...Contract workSummer workRemote work- ...Health Facility Evaluator II The primary function of the Health Facility Evaluator II is to conduct inspections utilizing an established survey process. The survey process includes evaluation of health care facilities for state licensure and federal certification requirements...Flexible hoursNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches