DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$80 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...SuggestedContract workSummer workRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $... ...independently to meet deadlines and improve AI model performance. Qualifications Must-...SuggestedContract workSummer workWork at officeRemote work$55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: Remote Role Responsibilities Evaluate VMware Fusion applications on macOS... ...IT administrators , sysadmins , and DevOps engineers to enhance cross-platform development....SuggestedContract workSummer workRemote workMercor
Miami, FL7 days ago- Alignerr Corp. seeks chemistry experts to train and improve AI models. This remote, flexible contract role lets you contribute your chemistry expertise while we handle the rest. You’ll design advanced problems and assess AI reasoning across multiple chemistry domains, with...SuggestedRemote jobContract work10 hours per weekFlexible hours
$180k - $200k
...Lead DevOps Engineer / Lead SRE – Manufacturing Orchestration Platform $180K–$200K base + equity | Remote (US), or hybrid if based in Miami You own how a fast-growing AI platform gets deployed inside the factories of some of the world’s biggest aerospace and industrial...SuggestedWork at officeRemote workSaragossa
Miami, FL7 days ago- Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale...Remote jobHourly payContract workFlexible hours
$45k - $60k
AI Design Evaluator / Design Quality SpecialistAbout the Role We are seeking a detail-oriented design professional to evaluate and improve the... ...quality benchmarks. Compare outputs from different AI models using identical prompts and assets, identifying strengths, weaknesses...Permanent employmentFor contractorsRemote work- ...data science, machine learning, statistical modeling, or advanced analytics. ~ Strong hands-... ..., machine learning, automation, and AI application development. ~ Strong proficiency... ...using LLMs, including prompt engineering and integration of AI capabilities into business...Contract work
Techvilla Solutions
Miami, FL17 days ago - Alignerr is seeking a Biochemist — AI Data Trainer to work remotely on an hourly contract. You will design advanced biochemistry problems, author gold-standard solutions, and audit AI outputs to ensure scientific accuracy and safety. PhD-level expertise and independent,...Remote jobHourly payContract workPart timeFlexible hours
$4,500 - $5,800 per week
...play a key role in this mission by developing next-generation models and trading approaches for a range of investment strategies. You... ...talented and accomplished investment professionals, researchers and engineers in the world. Our colleagues are empowered to test their ideas...InternshipFlexible hoursCitadel
Miami, FL1 day ago$4,500 - $5,800 per week
...maker, our team of quantitative researchers models the markets and brings trading strategies... ...of financial products. Our teams of engineers, traders and researchers harness leading-... ...accelerating power of compute, machine learning and AI to power our analytics and tackle the...InternshipFlexible hoursCitadel Securities
Miami, FL13 hours ago- ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...Full timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
Carnival Cruise Line
Miami, FL13 hours ago - (Hiring) DevOps EngineerWe are seeking a DevOps Engineer to join our team! You will design and develop solutions to complex application problems or network concerns.Responsibilities:Oversee the installation of operating systems, network systems, software, and hardwareMonitor...
Viper Staffing Services L.L.C.
Miami, FL3 days ago - ...DevOps EngineerProject Details – Size, Scale, Scope? How does candidate fit into this?“Data Operations” team but they are the DevOps team because they are already having a DevOps teamThe team is a traditional DevOps team with a few differences. Doesn’t have a lot of developers...
Software Technology Inc
Miami, FL3 days ago - Aston Carter seeks an AI Design Evaluator and Design Quality Specialist to assess and improve AI-generated design outputs across UI/UX, web, graphics, and presentations. You will provide structured critique based on professional design standards and briefs. Ideal candidates...Remote job
- ...Systems & DevOps EngineerRequired Skills & Experience• FreeBSD Expertise: Deep, hands-on administrative experience with production FreeBSD... ...zpool status).Job DescriptionWe are seeking a Systems & DevOps Engineer to manage, secure, and scale our bare-metal infrastructure and...
Insight Global
Miami, FL3 days ago - ...Junior DevOps EngineerThe Junior DevOps Engineer is a hands-on Engineer that will be responsible for provisioning, configuring and automating cloud services and cloud native solutions as well as designing and implementing automated software delivery pipelines for enterprise...Contract workImmediate start
Software Technology Inc
Miami, FL3 days ago $85k - $120k
...advanced analytics, Generative AI, transformative technologies,... ...operators, creatives, designers, engineers, and architects. Our team... .... The Project Delivery Talent Model is designed for professionals... ...Web Services (AWS), MS Azure DevOps, Git, CI / CD PipelineMust be...Local areaDeloitte
Miami, FL3 days ago- ...Kforce has a client seeking an AI Cloud Platform Engineer in Miami, FL. Key... ...Design, develop, and maintain Model Context Protocol (MCP) services... ..., and data protection * Evaluate and mitigate risks such as... ...Code, Codex, and Cursor DevOps & Platform Engineering: *...Hourly payContract work
- ...Description:Design and implement advanced ML models and statistical methods to optimize... ...summarizing transformation workflows, feature engineering processes, and audit compliance.Job... ...model explainability, and bias mitigation in AI/ML applications is required. Personnel...
Prescient Edge
Miami, FL1 day ago - ...DevOps EngineerMantech seeks a motivated, career and customer-oriented DevOps Engineer to join our team in Doral, FL.Responsibilities include but are not limited to:Designing, implementing, and maintaining automated CI/CD pipelines for deployment and testing workflows...Work at office
Hackajob
Miami, FL3 days ago - ...training, and deploying advanced statistical models and machine learning algorithms to solve... ...cross-functional technical teams, data engineers, and stakeholders to translate... ...findings to decision-makers.Conducting model evaluation, baseline testing, and continuous optimization...Work at office
Hackajob
Miami, FL4 days ago - ...is seeking a Data Scientist / Engineer to support the design,... ...operational deployment of scalable, AI-enabled data solutions within... ...a hybrid of statistical modeling fluency and hands-on software... ...model testing, and performance evaluation techniques.Experience with data...
Agile Defense
Miami, FL4 days ago - ...DescriptionDescription: Trax USA Corp is seeking a skilled and motivated DevOps Engineer to lead the optimization and automation of Java-based... ...functional and/or technical specifications.Analyses and evaluates detailed business and technical requirements.Self-starter/self...Full timeWorldwideFlexible hours
Trax
Coral Gables, FL13 hours ago $150 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 20 hours/week Role Responsibilities Evaluate and enhance AI model capabilities in complex SWE tasks . Collaborate with...Hourly payWeekly payContract workFor contractorsSummer workRemote work$40 - $125 per hour
...Job Description Remote AI Trainer, Data Science Contract | Part... ...to test how well advanced AI models handle real data science work... ...by running your tasks and evaluating the analyses, code, models,... ..., or analysis-adjacent data engineering). Undergraduate study doesn’...Remote jobHourly payFull timeContract workPart timeWork at officeFlexible hours- ...Job Description Job Description Position Overview The AI Implementation Coach helps client teams identify, adopt, and embed practical... ...tools in a business or marketing context (not required to be an engineer or data scientist). ~ Strong working knowledge of current...
Cardone Enterprises Inc
Miami, FL19 days ago $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...fluency in R and Python . Strong foundation in statistical modeling and experimental design. Experience with multi-step computational...Contract workSummer workRemote work- ...DevOps EngineerThe University of Miami/UHealth, Department of Public Health has an exciting... ...opportunity for a full time DevOps Engineer to work in Miami, FL.We are seeking a skilled... ...JSON/XML data exchanges.Perform data modeling, schema design, and database...Full timeWork experience placementWork at officeWorldwide
University of Miami
Miami, FL4 days ago $80 - $95 per hour
...optimization, and generative AI solutions, and ensuring their... ...actionable business decisions, drive model explainability and trust, and... ...commercial outcomes.Build and evaluate GenAI workflows leveraging GPT... ..., RAG, embeddings, prompt engineering, and evaluation routines to enhance...Work at officeEight Eleven Group
Miami, FL3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches