Scala Expert - AI Evaluation
$120 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Expert Software Engineer – Scala / COBOL / ABAP / Verilog / Fortran / Slang
Type: Contract
Compensation: $120–$200/hour
Location: Remote
Role Responsibilities
- Evaluate complex technical tasks using deep language expertise in Scala , COBOL , ABAP , Verilog , Fortran , or Slang .
- Review intricate code-level situations and provide precise, structured written assessments.
- Assess technical outputs for correctness, idiomatic usage, and ecosystem-specific conventions.
- Provide clear written rationales that explain expert judgments.
- Complete well-defined, time-bounded tasks with clear evaluation criteria.
- Work independently and asynchronously to meet deadlines and contribute to high-impact technical evaluations.
Qualifications
Must-Have
- 5+ years of professional or research experience in Scala , COBOL , ABAP , Verilog , Fortran , or Slang .
- Experience in real production, enterprise, or research contexts.
- Ability to articulate technical reasoning clearly in writing.
Preferred
- Experience with Apache Spark , Akka , Cats , ZIO , JCL , CICS , VSAM , DB2 , BAPIs , BADIs , Enhancement Spots , Vivado , Quartus , Synopsys , Cadence , MPI , OpenMP , DirectX , Vulkan , CUDA , NVIDIA Falcor .
Compensation & Legal
- Hourly contractor
- Paid weekly via Stripe Connect
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Scala Expert - AI Evaluation in Remote vacancy
$150 - $180 per hour
...Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to... ...attention to detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work flexibly from...SuggestedRemote workWork from homeProlific
Virginia Beach, VA2 days ago$8 - $65 per hour
...Prolific is looking for Mental Health Professionals in Houston, Texas, to train and evaluate cutting-edge AI models. The role offers flexible hours and competitive pay rates ranging from $8 to $65 per hour for AI tasks. Candidates must have a verified status as a Mental...SuggestedHourly payRemote workFlexible hoursProlific
Houston, TX1 day ago- ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants...SuggestedHourly payRemote workWork from homeFlexible hours
Prolific
Nashville, TN1 day ago $8 - $65 per hour
Prolific is seeking Mental Health Professionals to train and evaluate AI models from home. Responsibilities include reviewing AI responses and enhancing model performance using psychological expertise. Ideal candidates will have verified professional status, a solid understanding...SuggestedRemote jobFlexible hours$8 - $65 per hour
Prolific is looking for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological responses, complete training tasks, and improve models utilizing your expertise. Competitive...SuggestedRemote jobFlexible hours$60 per hour
Prolific in Seattle, WA is searching for Chemistry Experts and Chemical Engineers to join our Expert Network to train AI models with your expertise. The role involves evaluating AI-generated chemistry, fact-checking chemical reactions, and auditing technical documentation...Remote jobHourly payWork from homeFlexible hours- Prolific is seeking Mental Health Professionals to train and evaluate AI models. Candidates will review psychological scenarios, analyze... ...health professionals and must complete a quick skills assessment to join Prolific’s Domain Expert Network. #J-18808-Ljbffr ProlificRemote jobFlexible hours
$60 per hour
Prolific is seeking Chemistry Experts and Chemical Engineers to join our Expert Network, helping train AI models with their knowledge. Candidates should hold a relevant... ...pharmaceutical R&D. Responsibilities include evaluating AI-generated chemistry responses, validating...Remote jobHourly pay$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote jobHourly payWork from homeFlexible hours$8 - $65 per unit
Prolific is seeking Mental Health Professionals to train and evaluate AI models. In this role, you will review AI responses, analyze psychology-related content, and provide feedback to improve models. Applicants must have verified status as a Mental Health Professional...Remote jobFlexible hours$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models...Remote jobHourly payFlexible hours$30 - $65 per hour
About OpenTrain OpenTrain AI is the hiring and contracting organization for this remote... ...6 months About AI Training and Creative Evaluation AI training is the human side of building... ...seeking experienced Creative and Design Experts to contribute to a project focused on design...Hourly payFor contractorsImmediate startRemote workFlexible hours- Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating...Remote jobWork from homeFlexible hours
$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach...Remote jobHourly payFlexible hours$30 - $80 per hour
...Role Overview Apply your specialized industry knowledge to test AI powered workflows for professional software and business systems... ...Prior AI experience is not required. Key Responsibilities Evaluate and test AI driven workflows in your area of expertise,...Hourly payContract workRemote workSaidGig
United States25 days ago- ...A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates...Hourly payTemporary workRemote workFlexible hours
CloudDevs
United States4 days ago - ...Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and... ...LLMs) through high-quality human feedback, evaluation, and training data. Role Overview We are seeking Board Game Reasoning Experts to help train and evaluate next-generation...Contract workTemporary workFor contractorsFreelanceRemote work
Turing
Remote7 days ago - ...About Us Join an innovative AI initiative dedicated to improving how advanced AI systems... ...contribute their real-world expertise by evaluating AI-generated content, providing subject-... ...multidisciplinary team of subject matter experts to improve AI performance across a...Part timeRemote work10 hours per weekFlexible hours
Weekday
Remotea month ago - Obsidian is seeking a Medical Expert to help train AI models with high-quality healthcare reasoning data. You will design clinical scenarios, evaluate model outputs, and provide essential feedback to improve AI-driven patient care. This remote, asynchronous role defaults...Remote jobFlexible hours
- A leading AI research accelerator is seeking an Associate to leverage expertise in internal or emergency medicine. This role involves designing and evaluating clinical scenarios to enhance AI diagnostics. Candidates should have an MD and active practice within the last...Remote job
- Prolific is seeking Mental Health Professionals in Indianapolis, Indiana, to assist in training and evaluating AI models. Ideal candidates will have a verified status as a Mental Health Professional, an understanding of psychological theory, and the ability to focus on...Remote jobHourly payFlexible hours
- YO AI Labs is seeking a Biology Expert to join a remote, contract-based project. You will evaluate biology-related data and craft scientific scenarios to improve AI training datasets. The role emphasizes accuracy, depth, and clear communication within interdisciplinary...Remote jobContract work
$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Remote jobHourly payWork from homeFlexible hours$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network to evaluate AI-generated science. This role allows you to work from home with flexible hours and offers a competitive pay rate of up to $60 per hour for reviewing model responses...Remote jobHourly payWork from homeFlexible hours- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...Remote jobContract workImmediate startFlexible hours
- Prolific is seeking Biology Experts and Life Science Professionals in Jacksonville, Florida, to join our Expert Network for evaluating AI-generated science models. Candidates should hold a BS, MS, or PhD in relevant fields and have experience in research or academia. Responsibilities...Remote jobHourly payFlexible hours
- YO AI Labs is seeking Turkish bilingual experts for a contract-based remote role focusing on language and AI training. You will evaluate Turkish audio samples, assess quality, and provide precise feedback to help improve AI systems. No prior AI experience is required, but...Remote jobContract work
- YO AI Labs seeks experienced Specialized Industries Experts to evaluate AI-powered workflows across Government Contracting, Grants, Nonprofit operations, and EdTech. You will test AI agents in real-world scenarios and provide practical feedback to improve next-generation...Remote job
- Mercor is hiring expert Evaluators in Healthcare operations to review AI-generated outputs (documents, spreadsheets, and slide decks) for accuracy and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter expertise to grade outputs, identify...Remote jobHourly pay
$35 - $42 per hour
...project availability Help Shape the Future of AI in Finance, Audit & Risk Volga Partners... ...join our growing network of on-call AI Evaluation Specialists supporting the development,... ...Partners' on-call network of subject matter experts. As client projects become available,...Hourly payExtra incomePermanent employmentFull timeContract workTemporary workRemote workFlexible hoursVolga Partners
Remote4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Scala Expert - AI Evaluation. Be the first to apply!
