Scala Expert - AI Evaluation [Remote]
$120 per hourMercor
San Francisco, CA
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Expert Software Engineer – Scala / COBOL / ABAP / Verilog / Fortran / Slang
Type: Contract
Compensation: $120–$200/hour
Location: Remote
Role Responsibilities
- Evaluate complex technical tasks using deep language expertise in Scala , COBOL , ABAP , Verilog , Fortran , or Slang .
- Review intricate code-level situations and provide precise, structured written assessments.
- Assess technical outputs for correctness, idiomatic usage, and ecosystem-specific conventions.
- Provide clear written rationales that explain expert judgments.
- Complete well-defined, time-bounded tasks with clear evaluation criteria.
- Work independently and asynchronously to meet deadlines and contribute to high-impact technical evaluations.
Qualifications
Must-Have
- 5+ years of professional or research experience in Scala , COBOL , ABAP , Verilog , Fortran , or Slang .
- Experience in real production, enterprise, or research contexts.
- Ability to articulate technical reasoning clearly in writing.
Preferred
- Experience with Apache Spark , Akka , Cats , ZIO , JCL , CICS , VSAM , DB2 , BAPIs , BADIs , Enhancement Spots , Vivado , Quartus , Synopsys , Cadence , MPI , OpenMP , DirectX , Vulkan , CUDA , NVIDIA Falcor .
Compensation & Legal
- Hourly contractor
- Paid weekly via Stripe Connect
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Scala Expert - AI Evaluation [Remote] in San Francisco, CA vacancy
$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach...SuggestedRemote jobHourly payFlexible hours$30 per hour
Prolific is seeking Professional Graphic and Visual Designers in San Francisco for a high-level AI evaluation project at $30/hour. You will act as Domain Experts to evaluate AI-generated designs, ensuring professionalism and readability. Candidates should have formal design...Suggested- ...Mercor is seeking experienced cybersecurity professionals to improve AI systems' reasoning for threat detection and security operations. Candidates will evaluate AI outputs, create cybersecurity scenarios, and provide feedback on AI accuracy. This project-based role offers...SuggestedHourly payRemote work
Mercor Inc
South San Francisco, CA19 hours ago - ...Mercor is seeking experienced cybersecurity professionals to improve AI systems for threat detection and vulnerability assessment. Candidates will evaluate AI performance on cybersecurity tasks and collaborate with research teams. The ideal candidate will have 3+ years...SuggestedRemote work
Mercor Inc
Berkeley, CA18 hours ago $130 per hour
...Obsidian is looking for Internal Medicine experts to assist in training AI models on healthcare reasoning data. Responsibilities include designing clinical scenarios, evaluating AI outputs, and providing feedback to improve model performance. Candidates must be board certified...SuggestedHourly payRemote workObsidian
San Francisco, CA3 days ago- ...A leading AI research lab is looking for a Bilingual Korean STEM Expert to design and evaluate complex STEM reasoning tasks used for AI training. This fully remote independent contractor role requires a bachelor's degree in a STEM field, along with native-level Korean...For contractorsRemote workFlexible hours
24-MAG
San Francisco, CA3 days ago - ...Obsidian is seeking healthcare back-office professionals to train AI systems for medical document comprehension. In this flexible, remote role, you'll evaluate AI performance on tasks including medical records, billing codes, and health information management. The ideal...Remote workFlexible hours
Obsidian
San Francisco, CA18 hours ago $70 - $95 per hour
...Obsidian is seeking a RevOps Expert based in the United States to partner with leading AI labs for better agent evaluations in revenue operations. The role requires building long-horizon tasks that mirror existing work and are graded against deterministic rubrics. With...Obsidian
San Francisco, CA3 days ago$100 per hour
Prolific is seeking Legal Subject Matter Experts to join its Expert Network to help train and evaluate AI models using legal insight. Candidates can earn up to $100 per hour. The role involves document evaluation, AI model guidance, and fact-checking. Successful applicants...Remote jobHourly payFlexible hours$60 per hour
Prolific is seeking Accountant Subject Matter Experts to join their Expert Network to provide professional insights in AI training. Responsibilities include evaluating financial documents, providing AI model guidance, and ensuring data integrity. The ideal candidates will...Remote jobHourly payWork from homeFlexible hours- Prolific is seeking Mental Health Professionals in San Francisco to train and evaluate cutting-edge AI models. Candidates must have verified status as a Mental Health Professional and a strong understanding of psychology. Responsibilities include reviewing AI-generated...Remote jobWork from homeFlexible hours
$1,150 - $1,450 per month
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Telecommunications Expert Type: Contract Compensation: $... ...Remote Role Responsibilities Review and evaluate AI-generated outputs related to...Hourly payContract workSummer workRemote workMercor
San Francisco, CA2 days ago$100 - $130 per hour
...Role Overview Mercor is seeking senior legal professionals to build evaluation tasks for AI systems operating in Fortune 500 legal contexts. The workflows are calibrated to the regulatory complexity, transaction scale, and risk posture of Fortune 500 and large public companies...Hourly payRemote workMercor Inc
San Francisco, CA2 days ago$80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and prioritize effectively. Run the agent against scenarios, evaluate performance, and guide it to success through structured hints....Contract workSummer workRemote work$180 per hour
...Mercor is looking for Cardiology experts to collaborate with an AI lab on high-quality healthcare data. You'll design clinical scenarios and evaluate AI outputs to direct future cardiovascular care advancements. This remote position offers a pay rate between $180-$...Hourly payRemote workMercor Inc
San Bruno, CA53 minutes ago- ...Turing is offering a remote contract position for PhDs in Physics to work on innovative projects with top AI labs. The role involves designing advanced physics problems to assess AI performance, documenting solutions, and collaborating with researchers. Candidates must...Contract workRemote workFlexible hours
Turing
San Francisco, CA3 days ago $150 per hour
...Mercor is seeking a Psychiatry Expert to design clinical prompts and analyze AI responses. The role requires board-certified physicians or final-year residents with an active license.This ongoing contract positions offers $150–$350/hour and can be performed remotely with...Ongoing contractContract workRemote workMercor Inc
San Francisco, CA1 day ago$100 - $150 per hour
...Obsidian is hiring Employment and Labor Attorneys to train AI models with realistic workplace scenarios. This remote position requires at least 15 hours per week, with a preference for 40+ hours. The ideal candidate will have 1-4 years of experience in employment/labor...Remote workObsidian
San Francisco, CA1 day ago$55 - $90 per hour
...Obsidian is seeking STEM PhDs and Technical Domain Experts for a premier project with a leading AI lab in San Francisco. This role offers a competitive pay between $55-90/hour and requires advanced expertise in fields such as Medicine, Data Science, AI/ML Research, and...Obsidian
San Francisco, CA1 day ago$350k
...Opportunity Overview – Founding AE, AI Expert Services (remote) A growth-stage AI data company is hiring a Founding AE for its AI Expert... ...the post-training prompts, answers, reasoning traces, and evaluations that leading foundation models need to reach expert-level performance...Hourly payWork at officeImmediate startRemote workRevsUp
San Francisco, CA1 day ago- YO IT Consulting is looking for an Electronics Expert - DesignSpark PCB to contribute expertise in analyzing and simulating electronic designs for next-generation AI systems. The ideal candidate will have expert knowledge of DesignSpark PCB and a solid background in electronics...Remote job
$40 - $60 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Cloud Storage Management Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate user journeys across migration options to...Remote jobContract workSummer workMercor
San Francisco, CAa month ago- Prolific Academic Ltd is seeking an AI Trainer fluent in German to work remotely from San Francisco. As an AI Trainer, you will complete various tasks such as analyzing, editing, and improving AI models, contributing your linguistic expertise for a better AI outcome. Applicants...Remote workFlexible hours
Prolific Academic Ltd
San Francisco, CA3 days ago - A biotechnology company in San Francisco is seeking a Scientist to innovate at the intersection of generative AI and biology. The successful candidate will develop and execute high-throughput assays to characterize novel protein designs and work within a cross-functional...
$90k - $110k
Mercor is seeking a Growth Associate to connect AI companies with specialized experts. You will source and recruit top professionals, manage talent pipelines, and drive the company's rapid expansion. Ideal candidates have 1-2 years of experience in lead generation or recruiting...Relocation package- Role Overview Mercor is partnering with a leading AI lab to engage experienced cybersecurity and low-level programming experts for a short-term, high-impact project. This engagement focuses on analyzing and reviewing content for security vulnerabilities, with an emphasis...Temporary work
- ...AI Solutions Product Owner Oakland, CA - Hybrid 5 Months The AI Solutions Product Owner will lead the development and delivery... ...outcomes. Key Responsibilities: Lead the intake, evaluation, and prioritization of AI use cases for Substation Operations....
Axelon
Oakland, CA4 days ago - Terac in San Francisco is looking for a Founding Marketing professional to drive expert acquisition and community engagement. This role requires a unique understanding of the B2C landscape and strong marketing capabilities. Key responsibilities include building and executing...Relocation package
- 1Sphere AI is seeking an AI Engineer to excel in orchestration and automation with Claude Code. This pioneering role involves extensive experimentation and building core architectures that shape future AI standards. The ideal candidate thrives on pushing boundaries, documenting...
- Prolific Academic Ltd is looking for self-employed AI Trainers with a background in Psychology to help train AI models. The role involves tasks like analyzing psychology-related content and judging AI performance on human cognition prompts. Candidates should have a degree...Remote jobSelf employmentFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Scala Expert - AI Evaluation [Remote]. Be the first to apply!
Related searches
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- technology expert San Francisco, CA
- sql expert San Francisco, CA
- subject matter expert San Francisco, CA
- remote sales consultant San Francisco, CA
- customer service associate remote San Francisco, CA
- remote financial planning San Francisco, CA
- remote sales jobs San Francisco, CA
- remote video game San Francisco, CA