AI Evaluator - Software Expert - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Evaluator - Software Expert - AI Trainer in Los Angeles, CA vacancy
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$128.5k - $171.5k
General Information Job Title Expert Consultant, Coro, AI Engineer Job ID 106501 Work Areas... ...to ensure commercial success. Coro’s software and data solutions are an innovative... ...skills as needed, including building evaluation approaches, working with data...SoftwarePermanent employmentFull timeTemporary workApprenticeshipLocal area$293.5k
General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work... ...research, model experimentation, and evaluation design to production system... ...For (Qualifications):8-12+ years in software engineering, ML engineering, or applied...SoftwarePermanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week$171.6k - $230.1k
...We are seeking a Manager, Software Engineering, focused on BI &... ...maintaining the data pipelines, AI-powered data solutions, and custom... ...reviews. Lead vendor/tool evaluations and oversee key integration... ...NiFi or Apache Airflow. Expert level knowledge in at least one...Software5014 Disney Entertainment & Sports LLC
Glendale, CA2 days ago$171.6k - $230.1k
...platforms.Job Summary:We are seeking a Manager, Software Engineering, focused on BI & Analytics to... ...and maintaining the data pipelines, AI-powered data solutions, and custom... ...and performance reviewsLead vendor/tool evaluations and oversee key integration effortsPartner...SoftwareWork at office- ...mission-critical functions, or activate AI-powered innovation, we connect strategy to... ...deserve better. As a Salesforce subject matter expert and healthcare technologist, you take... ...(3-5+ years) experience with declarative software configuration (Epic/Cerner, Veeva, etc.)...SoftwareLocal areaShift work
$116.88k - $158.13k
...professional achievement and career growth. The Innovation and AI Solutions Engineer position is part of the firm’s Innovation Department... ...solutions. The role will support our attorneys and staff with software development, low/no-code solutions, and data initiatives. The...SoftwareFull timeWork at officeRemote workWorldwide- ...into the data platform. Help ensure that AI-enabled tools inherit appropriate data security... ...using containerization technologies. Evaluate emerging technologies and recommend... ...discipline, such as C#/.NET development, software quality assurance, systems integration, or...SoftwareVisa sponsorship
Veritas Search Group
Glendale, CA2 days ago - ...mission-critical functions, or activate AI-powered innovation, we connect strategy to... ...This role combines solution architecture, software development, and technical thought... ...augmented generation, model orchestration, evaluation, and responsible AI controls. • Working knowledge...SoftwareTemporary workLocal area
- ..., Databricks, or similar ~ Experience with SQL Query optimization based on runtime and cost ~ Participate in driving best practices around data engineering software development processes Required Education: Bachelor degree in Computer Science, Mathematics...Software
RIT Solutions
Burbank, CA2 days ago - ...Senior Applied AI Engineer Paramount Skydance Corp. is seeking a Senior Applied AI... ...solutions that transform how we deliver software quality across the enterprise. This role... ...triage and quality insights. Develop model evaluation frameworks ensuring accuracy, robustness,...Software
Paramount Global Services
Los Angeles, CA17 hours ago $154.6k - $209.1k
We seek an AI Platform Builder—a Data Engineer focused on developing Platforms and Agentic AI solution—who embraces prompt-driven development... ..., and platform engineering—requiring partnership with software development engineers, scientists, data analysts, and business stakeholders...SoftwareLocal areaFlexible hours$134.5k - $265.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a... ...deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...SoftwareLocal areaVisa sponsorship- At Slalom, we co-create custom software, data, and cloud products with clients who are ready to accelerate their digital transformation.... ...making, artificial intelligence, and transformation. We embrace AI to scale with quality, innovate without fear, and use technology...SoftwareTemporary workLocal area
$137.4k - $161.7k
Are you ready to make an impact?Senior AI Software Engineer - Technology & Experience (TechEx) West Monroe is seeking a Senior AI Software... ...recommendations for clients, exercising sound judgment in evaluating outputs.Apply AI technologies (e.g., generative AI,...SoftwareLocal areaImmediate startFlexible hours$95k - $105k
...with a focus on streamlining and consolidating processes. Help evaluate and validate new and existing tools or development needs to suggest... ...for business intelligence tools. Help coach Data Analysts on software development best practices. Requirements Professional...SoftwareTemporary workBrilliant Corners
Los Angeles, CA4 days ago$137.4k - $161.7k
...Senior Data Engineer to join our Data & AI practice. In this role, you will design,... ...for clients, exercising sound judgment in evaluating outputs.Apply AI technologies (e.g., generative... ..., Infrastructure as Code, and agile software delivery practices.Strong analytical, problem...SoftwareLocal areaImmediate startFlexible hours$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a... ...deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...SoftwareLocal areaVisa sponsorship- ...era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the... ...ML supporting libraries (sklearn, xgboost, pytorch, pandas, etc.)Software development experience with Python, Java , Spark and other Scripting...Software
$109.9k - $243.9k
...enterprise reporting, advanced analytics, machine learning, generative AI, and operational intelligence. You'll work at the forefront of... ...Qualifications ~5+ years of experience in data engineering, software engineering, backend engineering, analytics engineering, or...SoftwareUniversity of California
Los Angeles, CA2 days ago$134k - $265k
...Infrastructure Patching Automation (Mainframe & AS/400)Join our AI & Engineering team by transforming technology platforms, driving... ...deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...SoftwareLocal area$133k - $150k
...multidisciplinary teams of science, engineering, and regulatory experts to empower our clients with solutions that create a safer,... ...performanceExperience collaborating with other developers on production-grade software using version control (Git, SVN, or others)High proficiency (3+...SoftwareWork at officeFlexible hours$155.7k - $208.7k
...because our targeting is that good. We are looking for a Staff Software Engineer to join the Performance Marketing arm of this media team... ...patterns and best practices. Strong opinions on how to best use AI/LLMs in the software development process; ability to quickly...SoftwareWork experience placementSummer workRemote work- ...knowledge of CI/CD pipelines and version control systems (e.g., GitHub, GitLab, Bitbucket) Experience using AI-assisted coding tools in professional software development (e.g., GitHub Copilot, Cursor, Claude, or similar) Experience working in regulated environments (...SoftwareWork at officeShift work2 days per week
$95.1k - $161k
...Information Technology (IT) strategy and transformation programs, agile software development/DevOps, business continuity and disaster recovery,... ...; data management/governance, emerging technology such as AI, automation (robotics, cognitive, and more), and projects, General...SoftwareH1bLocal area$125k - $145k
AI Automation EngineerLocations: New York City, NY | Fairfield, NJ | Los Angeles, CA (Hybrid: 3 days in-office)Compensation: $125,0... ...automation to transform internal business operations.We're looking for a Software Engineer who enjoys building production software and applying AI...SoftwareInternshipWork at office- ...A software development company based in California is seeking a SQL Reports Developer in Santa Monica, CA. The role requires over 3 years of experience in report development and strong SQL programming skills. Candidates should be proficient in ETL tools like SSIS and...Software
360 IT Professionals
Santa Monica, CA4 days ago - ...Senior Data & AI Engineer Join a high-impact, greenfield AI initiative where you will shape how accounting, legal, and compliance... ...: ~10+ years of data engineering, machine learning, software engineering, or applied AI experience. ~ Strong data engineering...Software
Mondo
Santa Monica, CA3 days ago $188.4k - $252.6k
.... We are looking for a Sr Manager, Software Data Engineering to join the Performance... ...with the broader team of media/marketing experts to rapidly iterate from prototypes to high... ...~ Strong opinions on how to best use AI/LLMs in the software development process;...SoftwareWork experience placementSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluator - Software Expert - AI Trainer. Be the first to apply!
Related searches
- work from home web search evaluator Los Angeles, CA
- evaluator Los Angeles, CA
- ai evaluator Los Angeles, CA
- education evaluator Los Angeles, CA
- social media evaluator Los Angeles, CA
- guest service support expert Los Angeles, CA
- technology expert Los Angeles, CA
- fulfillment expert Los Angeles, CA
- ai trainer Los Angeles, CA
- bank software Los Angeles, CA