DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$160k - $200k
...LinkedIn, X (Twitter), and Instagram. Role OverviewBlackstone's DevOps Engineering team enables application teams to securely build, deploy, and... ...solutions, and standardized development environments.Manage AI coding assistants, including Claude, and context management platforms...SuggestedFull timeLocal areaRemote work- ...information: We are looking for a Senior DevOps Engineer to join one of our international banking clients under a hybrid work model. In this role, you will play a key part in... .... We may use artificial intelligence (AI) tools to support parts of the hiring process...Suggested
Coderio
Miami, FL19 days ago - ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...SuggestedFull timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
$100k - $160k
...the place for you!We are looking for a DevOps Engineer to join our amazing Cloud Engineering team... ...smooth operations.Participate in evaluating and integrating new technologies to enhance... ...role.We may use artificial intelligence (AI) tools to support parts of the hiring process...SuggestedFull timeWork experience placementLocal areaImmediate startRemote work- ...defining it. Harnessing the full power of AI and digital innovation, we deliver... ...cloud infrastructure solutions using modern DevOps IaC and CICD processes; integrate solutions... ...recent experience working in a DevOps/System Engineering roleBachelor's Degree from an accredited...SuggestedH1bLocal area
- ...Trax USA Corp is seeking a skilled and motivated DevOps Engineer to lead the optimization and automation of Java-based application development... ...functional and/or technical specifications. Analyses and evaluates detailed business and technical requirements. Self-starter...Full timeRemote workWorldwideFlexible hoursShift work
Trax USA Corp
Coral Gables, FL12 days ago $118.7k - $218.6k
Position Summary Lead AI and Data Science Engineer II Drive the design and delivery of advanced analytics, artificial intelligence (AI), and... ...methods, including regression, structural equation modeling, factor analysis, decision trees, clustering, and dimension...- ...technology and leadership in cloud, data and AI with unmatched industry experience,... ...industry knowledge and applied AI and data engineering. We help the world’s leading Resources and... ..., AI platforms, and governance models that turn data into trusted, production-grade...Full timeWork experience placementLive inWork at officeLocal area
- ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
$165k - $195k
...DevSecOps Engineer Washington D.C, Sarasota, Miami, New York City, Toronto, ON RUM Group Inc. is an AI infrastructure and video company. Its Quake AI business delivers AI compute... ...secure coding standards, threat modeling, security gates, policy-as-code, and documentation...Rumble
Miami, FL1 day ago$30 - $35 per hour
Data Engineer- DatabricksLocation: Remote - CST HoursEmployment... ...-regional delivery model ("all-shore") and... ...handoffs. * Apply agentic AI in day-to-day E&O... ...ServiceNow, Control-M, Azure DevOps, Git-based workflows,... ...or governed knowledge, evaluation and observability, access...Full timeContract workLocal areaRemote workShift work- ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
- ...An established industry player is seeking a Senior Security Development Engineer to join their Cybersecurity Team. In this pivotal role, you will lead efforts in application and infrastructure security, implementing DevSecOps principles and enhancing code quality. Your...
SherlockTalent
Miami, FL2 days ago $128k - $249k
....We are seeking a Senior Data Engineer to join the firm. The Senior Data... ...Applications, Data, and AI Platforms group, designing scalable... ...schema design, dimensional modeling, Medallion Architecture implementation... ...collaborating within an Agile DevOps model. Supporting CI/CD...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$50k - $120k
...Hiring DevOps Engineer $50,000-$120,000 + Benefits We are seeking a DevOps Engineer to join our team! You will design and develop solutions to complex application problems or network concerns. Responsibilities: Oversee the installation of operating systems...Viper Staffing Services L.L.C.
Miami, FL1 day ago$128k - $252.5k
...services covering valuation modeling, cost optimization, restructuring... ...of tools, products, and AI services. You will work closely... ...interdisciplinary data scientists, engineers, architects, and consultants,... ...helping them understand and evaluate new and essential areas for...Local area$95k - $150k
...environment? As an experienced Senior Data Engineer you will have the ability to share new... ...Deloitte under our Project Delivery Talent Model. Project Delivery Model (PDM) is a talent... ...Serverless Compute, event hubs) The Team AI & Engineering leverages cutting-edge engineering...Permanent employment- ...technology-driven organizations that drive true change.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial intelligence, and transformation. We embrace AI to scale with quality, innovate without fear, and use technology with...Temporary workLocal area
- ...experiences and drive long-term business growth.The Senior Data Engineer will play a key role in the design, development, and deployment... ...dbt to support business requirementsBuild and optimize data models and workflows to support analytics, reporting, machine learning...Full timeWork at office
$102.5k - $188.9k
...We invite applications from highly skilled and experienced AI and Data Science Engineer III professionals ready to drive the development of our... ...scalable data pipelines, application programming interfaces, and model deployment workflows in cloud environmentsPartnering with...Visa sponsorship$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...and modernizing technology & data platforms. Our delivery models are tailored to meet each client's unique requirements....Local areaVisa sponsorship$134.5k - $265.1k
...At Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help clients turn AI... ...quality, safety, latency, cost, and model risk.Deliver production-quality code... ...evaluationExperience with MLOps/LLMOps practices: evaluation frameworks, model monitoring, and...Local area- ...is looking for fluent Spanish speakers from Spain, Argentina, Chile, Mexico, or Colombia for a remote freelance role in a high-impact AI training initiative for Hume. Participants will engage in live, conversational video calls to help train AI on human emotions and...Remote jobFreelance
- ...DevSecOps Engineer Location: Miami, Florida (In-Office) The DevSecOps Engineer is responsible for integrating security practices... ...Integrate security tools, monitoring, and automated testing into DevOps workflows. Collaborate with development, operations, and...Work at office
Dupont Registry
Miami, FL4 days ago $105.4k - $207.8k
...power the next generation of AI-enabled cyber defense?If yes,... ...are looking for a hands-on Data Engineer to build and operate the governed... ...data stores.Designing data models for risk and controls domains,... ...retrieval, tool or function calling, evaluation or monitoring, prompt-...Local areaVisa sponsorship- ...extract valuable insights, build predictive models, and inform strategic business decisions. You will collaborate closely with data engineers, quantitative researchers, and business... ...accelerating power of compute, machine learning and AI to power our analytics and tackle the...Full time
Citadel
Miami, FL5 days ago - A leading tech talent firm is seeking a Senior DevOps Engineer specializing in AWS machine learning pipelines. The role involves designing and operating SageMaker-based ML pipelines while ensuring security and cost management for a U.S. bank's core platform modernization...Remote job
- ...DevOps Engineer Join the Nalley Consulting team at Southcom HQ. Position: DevOps Engineer Location: SOUTHCOM HQ, Doral, FL / Off-site Office: U.S. SOUTHERN Command Required clearance: No Required education: Bachelor's degree in Computer Science, Information Technology...Temporary workWork at officeFlexible hours
NALLEY CONSULTING, LLC
Miami, FL5 days ago $186k - $256k
...About the TeamAs a Senior+ Agentic Analytics Engineer at Opendoor, you will join the Data... ...intersection of data science, data engineering, and AI.Opendoor has adopted a "Default to AI"... ...Analytics-to-Action PipelineDesign data models that support automated analysis, pattern...Shift work- A leading AI research accelerator is seeking a contractor to evaluate North American teen humor. The ideal candidate will review and rate humorous content popular among teens and explain its appeal. This role offers flexible, project-based work with competitive pay and...Remote jobFor contractorsFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches
- devops engineer Miami, FL
- devops aws developer (remote) Miami, FL
- senior devops engineer remote Miami, FL
- devops engineer full time Miami, FL
- senior devops cloud engineer Miami, FL
- senior devops engineer Miami, FL
- devops engineer remote Miami, FL
- senior devops Miami, FL
- entry level devops Miami, FL
- devops Miami, FL