Scala Expert - AI Evaluation
$120 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Expert Software Engineer – Scala / COBOL / ABAP / Verilog / Fortran / Slang
Type: Contract
Compensation: $120–$200/hour
Location: Remote
Role Responsibilities
- Evaluate complex technical tasks using deep language expertise in Scala , COBOL , ABAP , Verilog , Fortran , or Slang .
- Review intricate code-level situations and provide precise, structured written assessments.
- Assess technical outputs for correctness, idiomatic usage, and ecosystem-specific conventions.
- Provide clear written rationales that explain expert judgments.
- Complete well-defined, time-bounded tasks with clear evaluation criteria.
- Work independently and asynchronously to meet deadlines and contribute to high-impact technical evaluations.
Qualifications
Must-Have
- 5+ years of professional or research experience in Scala , COBOL , ABAP , Verilog , Fortran , or Slang .
- Experience in real production, enterprise, or research contexts.
- Ability to articulate technical reasoning clearly in writing.
Preferred
- Experience with Apache Spark , Akka , Cats , ZIO , JCL , CICS , VSAM , DB2 , BAPIs , BADIs , Enhancement Spots , Vivado , Quartus , Synopsys , Cadence , MPI , OpenMP , DirectX , Vulkan , CUDA , NVIDIA Falcor .
Compensation & Legal
- Hourly contractor
- Paid weekly via Stripe Connect
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Scala Expert - AI Evaluation in San Francisco, CA vacancy
$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach...SuggestedRemote jobHourly payFlexible hours$30 per hour
Prolific is seeking Professional Graphic and Visual Designers in San Francisco for a high-level AI evaluation project at $30/hour. You will act as Domain Experts to evaluate AI-generated designs, ensuring professionalism and readability. Candidates should have formal design...Suggested$130 per hour
...Obsidian is looking for Internal Medicine experts to assist in training AI models on healthcare reasoning data. Responsibilities include designing clinical scenarios, evaluating AI outputs, and providing feedback to improve model performance. Candidates must be board certified...SuggestedHourly payRemote workObsidian
San Francisco, CA1 day ago- ...A leading AI research lab is looking for a Bilingual Korean STEM Expert to design and evaluate complex STEM reasoning tasks used for AI training. This fully remote independent contractor role requires a bachelor's degree in a STEM field, along with native-level Korean...SuggestedFor contractorsRemote workFlexible hours
24-MAG
San Francisco, CA1 day ago $70 - $95 per hour
...Obsidian is seeking a RevOps Expert based in the United States to partner with leading AI labs for better agent evaluations in revenue operations. The role requires building long-horizon tasks that mirror existing work and are graded against deterministic rubrics. With...SuggestedObsidian
San Francisco, CA1 day ago$30 per hour
...Academic Ltd is seeking Advanced Italian Speakers to help train and evaluate AI models. The position offers $30/hr for AI tasks and requires a... ...pay rates, making this an ideal opportunity for language experts looking to influence AI development. #J-18808-Ljbffr Prolific...Remote jobFlexible hours$60 per hour
Prolific is seeking Accountant Subject Matter Experts to join their Expert Network to provide professional insights in AI training. Responsibilities include evaluating financial documents, providing AI model guidance, and ensuring data integrity. The ideal candidates will...Remote jobHourly payWork from homeFlexible hours- Prolific is seeking Mental Health Professionals in San Francisco to train and evaluate cutting-edge AI models. Candidates must have verified status as a Mental Health Professional and a strong understanding of psychology. Responsibilities include reviewing AI-generated...Remote jobWork from homeFlexible hours
$100 per hour
Prolific is seeking Legal Subject Matter Experts to join its Expert Network to help train and evaluate AI models using legal insight. Candidates can earn up to $100 per hour. The role involves document evaluation, AI model guidance, and fact-checking. Successful applicants...Remote jobHourly payFlexible hours$100 - $130 per hour
...Role Overview Mercor is seeking senior legal professionals to build evaluation tasks for AI systems operating in Fortune 500 legal contexts. The workflows are calibrated to the regulatory complexity, transaction scale, and risk posture of Fortune 500 and large public companies...Hourly payRemote workMercor Inc
San Francisco, CA8 hours ago$80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and prioritize effectively. Run the agent against scenarios, evaluate performance, and guide it to success through structured hints....Contract workSummer workRemote work- ...Turing is offering a remote contract position for PhDs in Physics to work on innovative projects with top AI labs. The role involves designing advanced physics problems to assess AI performance, documenting solutions, and collaborating with researchers. Candidates must...Contract workRemote workFlexible hours
Turing
San Francisco, CA1 day ago $150 per hour
...Mercor is seeking a Psychiatry Expert to design clinical prompts and analyze AI responses. The role requires board-certified physicians or final-year residents with an active license.This ongoing contract positions offers $150–$350/hour and can be performed remotely with...Ongoing contractContract workRemote workMercor Inc
San Francisco, CA4 days ago- Prolific is seeking Computer Science Domain Experts for an AI verification project, reviewing scientific papers and ensuring the accuracy of AI-generated summaries. Candidates should hold a Master’s or PhD in Computer Science and possess specialized STEM knowledge. This...Remote jobFlexible hours
- ...seeking experienced real estate sales agents to support a leading AI lab in advancing research and infrastructure for next-generation... .... About Mercor Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations Our investors...Remote jobHourly payWeekly payContract workFor contractorsSummer workImmediate start
- YO IT Consulting is looking for an Electronics Expert - DesignSpark PCB to contribute expertise in analyzing and simulating electronic designs for next-generation AI systems. The ideal candidate will have expert knowledge of DesignSpark PCB and a solid background in electronics...Remote job
- Prolific Academic Ltd is seeking an AI Trainer fluent in German to work remotely from San Francisco. As an AI Trainer, you will complete various tasks such as analyzing, editing, and improving AI models, contributing your linguistic expertise for a better AI outcome. Applicants...Remote workFlexible hours
Prolific Academic Ltd
San Francisco, CA1 day ago $1,150 - $1,450 per month
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Telecommunications Expert Type: Contract Compensation... ...Role Responsibilities Review and evaluate AI-generated outputs related to...Remote jobHourly payContract workSummer workMercor
San Francisco, CA1 day ago$40 - $60 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Cloud Storage Management Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate user journeys across migration options to...Remote jobContract workSummer workMercor
San Francisco, CAa month ago- A healthcare consulting firm in San Francisco is seeking a highly skilled Healthcare Data Scientist to leverage advanced AI models for real-world healthcare applications. The ideal candidate will develop machine learning models, analyze complex data, and collaborate across...
$90k - $110k
Mercor is seeking a Growth Associate to connect AI companies with specialized experts. You will source and recruit top professionals, manage talent pipelines, and drive the company's rapid expansion. Ideal candidates have 1-2 years of experience in lead generation or recruiting...Relocation package- A biotechnology company in San Francisco is seeking a Scientist to innovate at the intersection of generative AI and biology. The successful candidate will develop and execute high-throughput assays to characterize novel protein designs and work within a cross-functional...
- ...AI Solutions Product Owner Oakland, CA - Hybrid 5 Months The AI Solutions Product Owner will lead the development and delivery... ...outcomes. Key Responsibilities: Lead the intake, evaluation, and prioritization of AI use cases for Substation Operations....
Axelon
Oakland, CA2 days ago - 1Sphere AI is seeking an AI Engineer to excel in orchestration and automation with Claude Code. This pioneering role involves extensive experimentation and building core architectures that shape future AI standards. The ideal candidate thrives on pushing boundaries, documenting...
- Prolific Academic Ltd is looking for self-employed AI Trainers with a background in Psychology to help train AI models. The role involves tasks like analyzing psychology-related content and judging AI performance on human cognition prompts. Candidates should have a degree...Remote jobSelf employmentFlexible hours
- A leading product engineering firm is seeking an AI Engineer to work on LLM-powered systems. The ideal candidate will have deep Python skills and hands-on experience with LangGraph, LangChain, and FastAPI for building robust backend services. This role promises an innovative...
- Terac in San Francisco is looking for a Founding Marketing professional to drive expert acquisition and community engagement. This role requires a unique understanding of the B2C landscape and strong marketing capabilities. Key responsibilities include building and executing...Relocation package
$194k - $262.5k
...Francisco, California, to shape the future of QuickBooks Live. This role focuses on defining seamless experiences at the intersection of AI and human expertise. Responsibilities include strategizing design across product areas, leading design explorations, and using data...$100 per hour
.... Work on cutting‑edge projects with top AI labs while earning $100+/hour, fully remote... ...‑step solutions with rigorous logic. Evaluate AI outputs for accuracy and quality of... ...candidate expertise) Assessment: Shortlisted experts complete an evaluation before selection....Contract workRemote workFlexible hoursTuring
San Francisco, CA2 days ago$342k
...infrastructure solutions optimized for advanced AI workloads. We collaborate across research... ...silicon vendors and system partners to evaluate emerging technologies, validate... ...We are seeking a 3P Hardware Architecture Expert with deep expertise in GPU and accelerator...Work at officeRelocation packageOpenAI
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Scala Expert - AI Evaluation. Be the first to apply!
