DevOps Engineer - AI Model Evaluator - AI Trainer
$85 per hourMercor
Job DescriptionJob DescriptionAbout the job\nMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.\nPosition: DevOps / SRE / Cloud Engineer (Coding Agent Experience)Type: ContractCompensation: $85/hourLocation: Remote\nRole Responsibilities\n\n Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.\n Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.\n Identify bugs, edge cases, reliability issues, and failure modes in model outputs.\n Compare outputs from multiple frontier models to assess their strengths and weaknesses.\n Apply professional engineering judgment to realistic infrastructure engineering scenarios.\n\nQualifications\nMust-Have\n\n 2+ years of professional DevOps, SRE, or Cloud Engineering experience.\n Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.\n Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.\n Ability to evaluate model-generated infrastructure and reliability engineering solutions.\n\nPreferred\n\n Experience supporting production-scale systems.\n\nCompensation & Legal\n\n $400 per accepted task\n Compensation tied to accepted work.\n\nApplication Process (Takes 20–30 mins to complete)\n\n Upload resume\n AI interview based on your resume\n Submit form\n\nResources & Support\n\n For details about the interview process and platform information, please check: For any help or support, reach out to: View email address on snaprecruit.com\n\nPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.\n\n\n#hiringmercor
$85 per hour
...technical talent with leading AI research labs. Headquartered... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...SuggestedContract workSummer workRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $... ...independently to meet deadlines and improve AI model performance. Qualifications Must-...SuggestedContract workSummer workWork at officeRemote work$80 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...SuggestedContract workSummer workRemote work$45k - $60k
Legal AI Evaluation Specialist About The Role We are seeking legal professionals to help evaluate the performance of advanced AI systems on real-world legal tasks. In this role, you will create realistic legal scenarios, assess AI-generated work products, and provide detailed...SuggestedHourly payPermanent employmentFull timeContract workPart timeFor contractorsRemote work10 hours per weekFlexible hours$40 - $125 per hour
...Job Description Remote AI Trainer, Data Science Contract | Part... ...to test how well advanced AI models handle real data science work... ...by running your tasks and evaluating the analyses, code, models,... ..., or analysis-adjacent data engineering). Undergraduate study doesn’...SuggestedRemote jobHourly payFull timeContract workPart timeWork at officeFlexible hours$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...fluency in R and Python . Strong foundation in statistical modeling and experimental design. Experience with multi-step computational...Contract workSummer workRemote work$150 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 20 hours/week Role Responsibilities Evaluate and enhance AI model capabilities in complex SWE tasks . Collaborate with...Hourly payWeekly payContract workFor contractorsSummer workRemote work- Aston Carter seeks a Legal AI Evaluation Specialist to design and evaluate AI-driven legal analysis across multiple practice areas. You will craft realistic tasks, grade AI outputs, and provide feedback to improve accuracy and reasoning. Ideal candidates have hands-on legal...Remote jobFull timeFlexible hours
$55 - $65 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$55–$65/hour Location: Remote Role Responsibilities Evaluate and utilize Visual Studio Code on macOS for specialized applications...Contract workSummer workRemote work$125 - $175 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...used in enterprise cyber defense work. Evaluate how AI assistance currently impacts your... ...analysts, incident responders, or security engineers. Experience with EDR and SIEM stacks...Hourly payContract workSummer workRemote work$80 - $110 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 10 hours/week Role Responsibilities Evaluate AI model training and improve model outputs in research-level physics...Contract workSummer workRemote work$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...answers. Calibrate tasks against frontier models, ensuring tasks ship only when strong models... ...Prior scientific software or research engineering experience. Start Date ~ Immediate...Contract workSummer workImmediate startRemote work$180k - $200k
DevOps Engineer Location: Miami, Florida | On-site Researched Miami-market benchmark: $180,000-$200,000 annually. Final compensation to be confirmed... ...services. Policy-controlled infrastructure automation and AI-assisted runbook support. Experience improving repeatable...- ...secures Carnival Corp’s adoption of AI by ensuring GenAI, model, and agentic systems are deployed, validated... .... This position is a hands-on engineering role focused on AI security posture,... ...build, and run model validation and evaluation harnesses to test AI models and...Full timePart timeWork at officeLocal areaWork from homeRelocationMonday to Thursday
$100 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Software Engineer – Retail Investing Platforms (Paid Expert... ...convenient time. Discuss how your team evaluated or shortlisted an external API or AI vendor...Contract workSummer workRemote work- ...data science, machine learning, statistical modeling, or advanced analytics. ~ Strong hands-... ..., machine learning, automation, and AI application development. ~ Strong proficiency... ...using LLMs, including prompt engineering and integration of AI capabilities into business...Contract work
$80 - $110 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...mathematics. Collaborate with peers to create problems and evaluate AI model performance in physics research reasoning. Utilize Python...Contract workSummer workRemote work$85 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: ML Engineer (Coding Agent Experience) Type... ...coding agents to complete and evaluate complex machine learning and... ...engineering tasks. Review model-generated implementations...Contract workSummer workRemote work$70 - $100 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Guide research and engineering teams to close knowledge gaps and improve AI model performance in synthetic chemistry... ...design and reaction optimization. Evaluate AI model outputs and step-by-step...Contract workSummer workRemote workWeekday work$70 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate the quality, fidelity, and completeness... ...and remediation tasks for AI model training. Assess CVE... ...design, or QA for security-focused engineering tasks. Application Process...Contract workSummer workRemote work$134.5k - $265.1k
Position Summary The Cloud Platform DevOps Engineer with designs, builds, and operates secure, compliant, and highly automated Google... ...cybersecurity, cloud, application, and risk teams, and applies AI to platform operations while enabling secure AI workloads on...Work at officeLocal areaVisa sponsorshipNight shift1 day per week$4,500 - $5,800 per week
...play a key role in this mission by developing next-generation models and trading approaches for a range of investment strategies. You... ...talented and accomplished investment professionals, researchers and engineers in the world. Our colleagues are empowered to test their ideas...InternshipFlexible hours$4,500 - $5,800 per week
...maker, our team of quantitative researchers models the markets and brings trading strategies... ...of financial products. Our teams of engineers, traders and researchers harness leading-... ...accelerating power of compute, machine learning and AI to power our analytics and tackle the...InternshipFlexible hours$85k - $120k
Project - Software Engineer II Our Deloitte Customer team empowers organizations... ...analytics, Generative AI, transformative technologies,... .... The Project Delivery Talent Model is designed for professionals... ...Web Services (AWS), MS Azure DevOps, Git, CI / CD Pipeline Must be...Local area$55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: Remote Role Responsibilities Evaluate VMware Fusion applications on macOS... ...IT administrators , sysadmins , and DevOps engineers to enhance cross-platform development....Contract workSummer workRemote work$134.5k - $265.1k
...seeking a Lead Managed Services Engineer II to design, automate, and... ..., infrastructure as code, and DevOps practices to build secure, scalable... ...and machine learning (AI/ML) teams to support evolving... ...Engine, Vertex AI Search, and Model Armor.A successful candidate would...Work at officeLocal areaVisa sponsorshipNight shift1 day per week$500 per unit
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...improve your own real project using the open-weight and Gemini models we provide. Choose which AI model to use for each task and...Contract workSummer workImmediate startRemote workFlexible hours- ...Our Senior Data Engineer will be responsible for leading the Business Analytics function... ...dashboards using Power BI Desktop. Data Modeling & Transformation: Import, clean, and... ...SQL DB, Azure Databricks, Power BI, Azure DevOps, Azure Synapse , Azure Fabric, Azure CI/...Full time
$400 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Cyber Engineer (3+ Years Experience) Type: Contract... ...review realistic code-security tasks for evaluating AI systems . Identify vulnerabilities...Contract workSummer workRemote work$116.2k - $229.1k
...optimization, simulation, forecasting, scheduling, inventory, and network-design models.· Build and integrate analytical solutions using Python, SQL, data pipelines, and enterprise systems.· Evaluate scenarios and trade-offs to quantify impacts on service, cost, capacity,...Local area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator - AI Trainer. Be the first to apply!





