Ai Evaluator - Software Expert
$80 - $120 per hourMercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in outputs.
- Provide clear, structured written feedback to improve quality.
- Work independently and asynchronously to meet deadlines.
- Utilize expertise in Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on click.appcast.io
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...SuggestedContract workSummer workRemote work$90 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Location: Remote Role Responsibilities Evaluate the quality and correctness of AI-assisted software-development traces to enhance model training and...SoftwareContract workSummer workRemote work$45 - $55 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate the functionality of Vivado on Windows... ...of tasks without the provision of software licenses or hardware. Collaborate asynchronously...SoftwareContract workSummer workRemote work- ...The ideal candidate will bridge the gap between data science and software engineering by automating the end-to-end machine learning... ..., and software developers to deliver reliable, production-ready AI solutions. Key Responsibilities Design, develop, and maintain...SoftwareFlexible hours
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work- ...Job Description Job Description We build AI agents that actually work in enterprise environments — not prototypes, not demos.... ...direct advantage on our engagements. Requirements ~4+ years of software engineering experience with at least 2 years building and...SoftwareTemporary work
$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote work$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...+ hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota plans... ...customer complaint resolution. Provide expert feedback on sales-performance analysis to...Hourly payContract workSummer workImmediate startRemote work$200k - $260k
...platform healthcare organizations use to build their own clinical AI agents. Our mission is to make excellent care accessible to... ...build what each customer actually needs on top of it, as durable software that runs in production. As a Senior Applied AI Engineer, you...SoftwareFull timeWork at officeFlexible hours- ...visas accepted. Job Description We are seeking a Software Engineer, Core Java to join our dynamic team. The ideal... ...experience with AWS infrastructure and services. Experience with AI tools for at least 1 year to enhance development or operations workflows...SoftwareLocal area
- ...Job Description Job Description Title: AI Data and Application Architect - Wealth Management Location: Remote Duration: 3 months, temp-to-perm for the right candidate Overview The role is responsible for designing and delivering end-to-end technology solutions...Permanent employmentTemporary workRemote work
- ...Description Do you want to be part of the core team building truly AI-native helpful experiences across the consumer space? Do you... ...of every day. We are looking for a stellar & highly ambitious Software Engineer specializing in Go as a core employee to help build...SoftwareVisa sponsorshipFlexible hours
$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen...Contract workSummer workRemote work$120k - $180k
...Job Description Job Description Our client is an early-stage industrial software company building an AI-driven production orchestration platform for aerospace, defense, and advanced-manufacturing customers. The company has raised approximately $11M, is preparing for...SoftwarePermanent employmentFull timeRelocation package$180k - $220k
...the only vertically integrated AI infrastructure company built... ...careers alongside a team of experts across energy, manufacturing,... ...Engineering Experience: 5+ years as a software engineer, ML engineer,... ...MCP, retrieval, memory, and evaluation, using one or more frameworks...SoftwareTemporary work$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...+ hours/week Role Responsibilities Evaluate AI-generated financial plans , budgets,... ...decisions, and financial reporting. Provide expert feedback to improve AI model performance...Hourly payContract workSummer workWork at officeImmediate startRemote work$244.7k - $279.2k
...Job Description Staff AI Engineer role (Remote Eligible) At Capital One, we are... ..., develop, test, deploy, and support AI software components including foundation model training... ..., similarity search, guardrails, model evaluation, experimentation, governance, and...SoftwareFull timePart timeLocal areaRemote work- ...in one of the fastest-growing areas of technology? We at Sigma Software are seeking a Middle Partner Sales Manager to help expand our partner... ...ecosystem across the US market, focusing on Cloud, Data, and AI collaborations. This is a remote role for a US-based...SoftwareRemote workWorldwide
- ...fault injection, and per-engagement cost attribution including AI spend. Delivery Pipelines, Security & Compliance Engineering... ...control, signed and attested artifacts, and an audit trail and software bill of materials, including AI components, on every build as SOC...SoftwareRemote work
$165k - $225k
...worldwide through cutting-edge AI-powered technology. Our... ...production-ready models, and evaluations that stand up in clinical workflows... ...with ML Engineering and software teams to translate research prototypes... ..., and pathology domain experts to integrate research into production...SoftwareRemote workWorldwide$90k - $120k
...who are curious, continue learning, share knowledge, document their work and take ownership. We also encourage the responsible use of AI, scripting and automation to improve troubleshooting, documentation and operational efficiency while maintaining appropriate security...Full timeCasual workRemote work$17 - $25 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Indonesian Type: Contract Compensation: $...Contract workSummer workRemote work$20 - $22 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: AI Safety Experts — English & Punjabi Type: Contract Compensation: $20–...Contract workSummer workRemote work- ...knowledge of fabrication techniques and material standards used in exhibit design ~ Proficiency in one or more relevant modelling softwares including:Vectorworks (preferred), Rhinoceros (preferred), Sketchup. (BIM experience is a plus) ~3-D rendering and...SoftwareFull timeFor subcontractorWork at office
$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $... ...question in understandable language for non-experts. Detect sycophancy in AI interactions....Contract workSummer workRemote work$224k - $245k
...and a wide range of global NGOs. With a 4.9/5 rating across top software review platforms, we're recognized not just for our impact - but... ...generosity potential by optimizing how people give. About the Role AI is only as good as the data underneath it. This role makes ours...SoftwareContract workTemporary workRemote workHome office- ...Rhino, Blender, SketchUp, Cinema 4D, Unreal Engine, or similar 3D software. Experience with V-Ray, Enscape, KeyShot, Twinmotion, or... ...sketching and illustration skills are a plus. Familiarity with AI-enabled visualization and creative tools is a plus. What We...SoftwareShift work
$197.3k - $225.1k
...you love building and pioneering in the AI and technology space? Do you enjoy solving... ...functional Agile team to create and enhance software that enables state-of-the-art big data... ...hyperparameters, regularization), and how to evaluate model accuracy and diagnose and address...SoftwareFull timePart timeH1bLocal area- ...Description Overview Tyndale is expanding our AI and automation capabilities and seeking... ...of experience in automation engineering, software engineering, cloud engineering,... ...automation platforms, AI agent testing/evaluation, containerization and operational tooling...SoftwareCasual workRemote work1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Evaluator - Software Expert. Be the first to apply!
- evaluator Abbeville, GA
- ai evaluator Abbeville, GA
- education evaluator Abbeville, GA
- quality evaluator Abbeville, GA
- social media evaluator Abbeville, GA
- technology expert Abbeville, GA
- guest service support expert Abbeville, GA
- fulfillment expert Abbeville, GA
- remote software sales Abbeville, GA
- entry level software sales Abbeville, GA


