DevOps Engineer - AI Model Evaluator - AI Trainer
$400 per monthMercor
About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic infrastructure engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first serve basis. What You'll Do Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation. Identify bugs, edge cases, reliability issues, and failure modes. Compare outputs from multiple frontier models and assess their strengths and weaknesses. Apply professional engineering judgment to realistic infrastructure engineering scenarios. Time Commitment Sprint based project that runs in 12-24 hour stretches based on client requirement. Compensation $400 per accepted task. Typical tasks take approximately 2–3 hours after ramp-up. Compensation is tied to accepted work. Who Should Apply 2+ years of professional DevOps, SRE, or Cloud Engineering experience. Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling. Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools. Ability to evaluate model-generated infrastructure and reliability engineering solutions. Experience supporting production-scale systems is preferred. #J-18808-Ljbffr Mercor
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator - AI Trainer in Miami, FL vacancy
$85 per hour
...technical talent with leading AI research labs. Headquartered... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...SuggestedContract workSummer workRemote work$160k - $200k
...LinkedIn, X (Twitter), and Instagram. Role OverviewBlackstone's DevOps Engineering team enables application teams to securely build, deploy, and... ...solutions, and standardized development environments.Manage AI coding assistants, including Claude, and context management platforms...SuggestedFull timeLocal areaRemote work- ...information: We are looking for a Senior DevOps Engineer to join one of our international banking clients under a hybrid work model. In this role, you will play a key part in... .... We may use artificial intelligence (AI) tools to support parts of the hiring process...Suggested
Coderio
Miami, FL21 days ago - ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...SuggestedFull timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
$100k - $160k
...the place for you!We are looking for a DevOps Engineer to join our amazing Cloud Engineering team... ...smooth operations.Participate in evaluating and integrating new technologies to enhance... ...role.We may use artificial intelligence (AI) tools to support parts of the hiring process...SuggestedFull timeWork experience placementLocal areaImmediate startRemote work$16 - $17 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...independently and asynchronously to meet deadlines and improve AI model performance . Qualifications Must-Have Access to a personal...Contract workSummer workRemote work- ...defining it. Harnessing the full power of AI and digital innovation, we deliver... ...cloud infrastructure solutions using modern DevOps IaC and CICD processes; integrate solutions... ...recent experience working in a DevOps/System Engineering roleBachelor's Degree from an accredited...H1bLocal area
- ...Worth AI, a leader in the computer software industry, is looking for a Senior DevOps Engineer to join our Infrastructure team with a singular mission: to make our systems faster, more reliable, and more resilient while making life dramatically easier for engineers shipping...Full timeRemote workFlexible hoursShift work
- ...Trax USA Corp is seeking a skilled and motivated DevOps Engineer to lead the optimization and automation of Java-based application development... ...functional and/or technical specifications. Analyses and evaluates detailed business and technical requirements. Self-starter...Full timeRemote workWorldwideFlexible hoursShift work
Trax USA Corp
Coral Gables, FL14 days ago - ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
- ...digital core and unleashing the power of AI to create value at speed across the enterprise... ....We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs,... ...clients on their biggest business challenges.Evaluate actionable solutions to these challenges,...Full timeWork experience placementLive inWork at officeLocal area
$118.7k - $218.6k
Position Summary Lead AI and Data Science Engineer II Drive the design and delivery of advanced analytics, artificial intelligence (AI), and... ...methods, including regression, structural equation modeling, factor analysis, decision trees, clustering, and dimension...$30 - $35 per hour
Data Engineer- DatabricksLocation: Remote - CST HoursEmployment... ...-regional delivery model ("all-shore") and... ...handoffs. * Apply agentic AI in day-to-day E&O... ...ServiceNow, Control-M, Azure DevOps, Git-based workflows,... ...or governed knowledge, evaluation and observability, access...Full timeContract workLocal areaRemote workShift work$128k - $249k
....We are seeking a Senior Data Engineer to join the firm. The Senior Data... ...Applications, Data, and AI Platforms group, designing scalable... ...schema design, dimensional modeling, Medallion Architecture implementation... ...collaborating within an Agile DevOps model. Supporting CI/CD...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- ...technology and leadership in cloud, data and AI with unmatched industry experience,... ...industry knowledge and applied AI and data engineering. We help the world’s leading Resources and... ..., AI platforms, and governance models that turn data into trusted, production-grade...Full timeWork experience placementLive inWork at officeLocal area
- ...is looking for fluent Spanish speakers from Spain, Argentina, Chile, Mexico, or Colombia for a remote freelance role in a high-impact AI training initiative for Hume. Participants will engage in live, conversational video calls to help train AI on human emotions and...Remote jobFreelance
$50k - $120k
...Hiring DevOps Engineer $50,000-$120,000 + Benefits We are seeking a DevOps Engineer to join our team! You will design and develop solutions to complex application problems or network concerns. Responsibilities: Oversee the installation of operating systems...Viper Staffing Services L.L.C.
Miami, FL5 days ago$155.6k - $306.8k
...At Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help clients turn AI... ...quality, safety, latency, cost, and model risk.Deliver production-quality code... ...evaluationExperience with MLOps/LLMOps practices: evaluation frameworks, model monitoring, and...Local area$128k - $252.5k
...services covering valuation modeling, cost optimization, restructuring... ...of tools, products, and AI services. You will work closely... ...interdisciplinary data scientists, engineers, architects, and consultants,... ...helping them understand and evaluate new and essential areas for...Local area$95k - $150k
...environment? As an experienced Senior Data Engineer you will have the ability to share new... ...Deloitte under our Project Delivery Talent Model. Project Delivery Model (PDM) is a talent... ...Serverless Compute, event hubs) The Team AI & Engineering leverages cutting-edge engineering...Permanent employment- ...experiences and drive long-term business growth.The Senior Data Engineer will play a key role in the design, development, and deployment... ...dbt to support business requirementsBuild and optimize data models and workflows to support analytics, reporting, machine learning...Full timeWork at office
- ...technology-driven organizations that drive true change.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial intelligence, and transformation. We embrace AI to scale with quality, innovate without fear, and use technology with...Temporary workLocal area
$165k - $195k
...DevSecOps Engineer Washington D.C, Sarasota, Miami, New York City, Toronto, ON RUM Group Inc. is an AI infrastructure and video company. Its Quake AI business delivers AI compute... ...secure coding standards, threat modeling, security gates, policy-as-code, and documentation...Rumble
Miami, FL3 days ago$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...and modernizing technology & data platforms. Our delivery models are tailored to meet each client's unique requirements....Local areaVisa sponsorship- ...DevOps Engineer Project Details – Size, Scale, Scope? How does candidate fit into this? “Data Operations” team but they are the DevOps team because they are already having a DevOps team The team is a traditional DevOps team with a few differences. Doesn’t have...
Software Technology Inc
Miami, FL3 days ago - ...Role: DevOps Engineer Location: Miami, FL Duration: 6+ Months Job Description: Must Have Skills: • Jira,... ...the supported CI tools • Creating and updating life cycle models and schedules • Experience of working with IBM Urban code for...
3B Staffing LLC
Miami, FL1 day ago $105.4k - $207.8k
...power the next generation of AI-enabled cyber defense?If yes,... ...are looking for a hands-on Data Engineer to build and operate the governed... ...data stores.Designing data models for risk and controls domains,... ...retrieval, tool or function calling, evaluation or monitoring, prompt-...Local areaVisa sponsorship- ...Junior DevOps Engineer The Junior DevOps Engineer is a hands-on Engineer that will be responsible for provisioning, configuring and automating cloud services and cloud native solutions as well as designing and implementing automated software delivery pipelines for enterprise...Contract workImmediate start
Software Technology Inc
Miami, FL3 days ago - ...A.I.S., Inc. (AIS) is a national scientific services firm supporting maritime activities... ...Perform QA/QC on incoming datasets and evaluate suitability for inclusion in advanced analytical... ..., and evaluate analytical workflows and models to improve data processing efficiency...Hourly payFull timeContract workFor contractorsRemote workRelocation
GrabJobs
Miami, FL1 day ago - ...DevOps Engineer Join the Nalley Consulting team at Southcom HQ. Position: DevOps Engineer Location: SOUTHCOM HQ, Doral, FL / Off-site Office: U.S. SOUTHERN Command Required clearance: No Required education: Bachelor's degree in Computer Science, Information Technology...Temporary workWork at officeFlexible hours
NALLEY CONSULTING, LLC
Miami, FL2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!
Related searches