Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Baseline Evaluator — Open-Ended Tasks

Mercor

Mercor is seeking experienced machine learning engineers and researchers to act as human baseliners for evaluating AI performance on challenging R&D tasks. Candidates are expected to execute machine learning tasks independently in a controlled environment, using their preferred tools. This position requires a minimum commitment of 20 hours per week and emphasizes expertise in machine learning frameworks and hands-on research abilities. Successful candidates will provide their complete work session recordings and responses to questionnaires as part of the evaluation process. #J-18808-Ljbffr Mercor

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior ML Baseline Evaluator — Open-Ended Tasks in Thousand Oaks, CA vacancy
  • $106.2k - $194.6k

     ...and ambitions.   As a Senior AI Native Engineer, you...  ...perform development tasks to ensure robust engineering...  ...with popular ML packages such as TensorFlow...  ...transforming data and evaluating results to make meaningful...  ...designing and deploying end to end ML workflows on... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Thousand Oaks, CA
    5 days ago
  • $102.5k - $187.9k

     ...build a better working world. AI Finance, Senior, Tech Consulting Whole industries...  ...interact with business stakeholders to evaluate business models, processes, and operations...  ...data management including data modeling and ML. What we look for We’re... 
    Senior
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Thousand Oaks, CA
    5 days ago
  • $106.9k - $176.5k

     ...build a better working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data...  ...communication skills, along with a proven track record of successful end-to-end implementations in data engineering projects. The opportunity... 
    Senior
    Summer holiday
    Flexible hours

    EY

    Thousand Oaks, CA
    4 days ago
  • Senior Manager, Agentic AI Business Solutions What you will do Let’s...  ...across assigned workstreams. End-to-End Management of NN Platform...  ...cycles in collaboration with AI/ML and Engineering teams to ensure...  ...agents or copilots that automate tasks or drive decision workflows.... 
    Senior
    Work at office
    Flexible hours
    Shift work
    2 days per week
    3 days per week

    Amgen SA

    Thousand Oaks, CA
    2 days ago
  • Guitar Center is seeking a hybrid Senior UX Designer to bridge user experience design and front-end engineering for our enterprise e-commerce platform. This role combines UX thinking with hands-on React development to create scalable and accessible digital experiences used... 
    Senior

    Guitar Center

    Westlake Village, CA
    6 days ago
  • $180k - $200k

     ...Senior Data Scientist Location: Hybrid (Westlake Village Corporate HQ) or Remote in...  ...product development frameworks that you’ll own end‑to‑end: discover & design → develop &...  ...strong readiness to adopt warehouse‑native ML platforms (Snowflake + Snowpark strongly preferred... 
    Senior
    Full time
    Remote work
    Shift work

    The Guitar Center Company

    Westlake Village, CA
    2 days ago
  •  ...Experience in Vignette and Java. Good understanding of Content management system, document store, digital asset management. Senior Developer experience in Open Text Vignette Implementation . If you are qualified, available, planning to make a change, and have an interest in... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Flexible hours

    E*Pro Inc

    Thousand Oaks, CA
    4 days ago
  • $102.5k - $187.9k

     ...improved outcomes and sustainable results. As a Senior Technology Analyst, you will play a...  ...with business stakeholders to evaluate business models and processes. Analyzing...  ...Experience with configuration, master data, and end‑to‑end planning processes, including Materials... 
    Senior
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Westlake Village, CA
    3 days ago
  • Initial Therapeutics, Inc. is seeking a Machine Learning Scientist in Thousand Oaks, California. In this role, you will work with a team to develop innovative machine learning solutions that advance therapeutic protein design and collaborate with researchers to facilitate...
    Senior

    Initial Therapeutics, Inc.

    Thousand Oaks, CA
    4 days ago
  • $140k - $175k

     ...a deep understanding of machine learning and quantitative finance. The ideal candidate will have over six years of experience in AI/ML development in financial services, a strong PM background, and hands-on coding proficiency in Python. The company offers a comprehensive... 
    Senior

    PennyMac Loan Services, LLC

    Westlake Village, CA
    3 days ago
  • $151.5k - $346k

     ...Managed Services AI, IT & Automation Architect (Senior Manager)to design, operationalize, and...  ...role is accountable for orchestrating the end‑to‑end tooling strategy across AI,...  ...Orchestrate the tooling story: Bring together AI/ML platforms, automation technologies,... 
    Senior
    Contract work
    Summer holiday
    Flexible hours

    EY

    Thousand Oaks, CA
    2 days ago
  • A leading mortgage lender in Westlake Village is seeking a Senior AI Product Manager to oversee and manage the AI product lifecycle for capital...  ...a strong quantitative background with at least 6 years in AI/ML product development, fluency in machine learning and quantitative... 
    Senior
    Work at office

    Pennymac

    Westlake Village, CA
    4 days ago
  • $140k - $175k

     ...Product Manager to oversee AI initiatives in capital markets. The role requires an advanced degree in data science and 6+ years in AI/ML product development within financial services. Responsibilities include managing AI product lifecycle, conducting market research,... 
    Senior
    Work at office

    Private National Mortgage Acceptance Company, LLC

    Westlake Village, CA
    3 days ago
  • $158.61k - $200.05k

    Initial Therapeutics, Inc. is seeking a Senior Machine Learning Engineer in Thousand Oaks, California. This role involves developing AI and ML solutions to improve patient outcomes by collaborating with engineers and scientists. Key responsibilities include architecting... 
    Senior
    Remote job
    Flexible hours

    Initial Therapeutics, Inc.

    Thousand Oaks, CA
    3 days ago
  •  ...Description The manager is seeking a Senior Associate, Quality Assurance...  ...not required. The manager is open to training strong candidates...  ...Responsibilities will include evaluation of compliance issues,...  ...and ability to manage multiple tasks at one time/ Effective communication... 
    Senior
    Flexible hours
    Shift work
    Rotating shift
    Day shift
    Afternoon shift

    US Tech Solutions

    Thousand Oaks, CA
    2 days ago
  •  ...essential in creating efficient and reliable ML pipelines. A background in data...  ...plus. Roles & Responsibilities: Lead the end-to-end design, development, and delivery of...  ...making systems. Define and institutionalize evaluation, validation, and governance frameworks for... 
    Flexible hours

    Amgen SA

    Thousand Oaks, CA
    5 days ago
  •  ...architectures, leading significant initiatives that deliver measurable business impacts. Ideal candidates will have substantial experience with ML systems, cloud platforms like AWS and Azure, and possess a strong command of Python and AI frameworks. The position includes robust... 

    Amgen SA

    Thousand Oaks, CA
    4 days ago
  • $161.7k - $258.8k

     ...Senior Software Engineer (Teradyne, Agoura Hills) Date: Apr 15, 2026...  ...you able to balance a variety of tasks related to software system...  ...process. Comfortable working with open source communities (Linux kernel...  ...and PowerPC processors and high‑end x86_64 servers. Experience... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Teradyne

    Agoura Hills, CA
    5 days ago
  • Mercor is searching for Internet‑Native Bilingual Evaluator Experts (Spanish‑English) to enhance AI research. This role involves analyzing online content and assessing AI responses for cultural appropriateness and fluency. Ideal candidates will have native proficiency in... 
    Remote job

    Mercor

    Thousand Oaks, CA
    3 days ago
  • $145k - $170k

     ...outcomes and business success. Senior Project Managers (SPMs) lead...  ...organization, ensuring disciplined end‑to‑end execution, governance,...  ...“speed to market” project tasks, creating task force teams, outlining...  ..., and continuous efforts to evaluate and simplify. Lead weekly... 
    Senior
    Work at office

    Dole Food

    Westlake Village, CA
    2 days ago
  • $60 - $70 per hour

     ...documentation versus project(s) timelines. Author/evaluate qualification/validation protocols...  .... Prior involvement working with ISPE baseline guide vol 3, vol 4 and vol 5 would be beneficial...  ...years of experience Why is the Position Open? Supplement additional workload on team... 
    Senior
    Contract work

    3key Consulting, Inc.

    Thousand Oaks, CA
    5 days ago
  • Job Title: Engineer Senior, DeltaV Automation - (JP10735) Location: Thousand Oaks, CA. (Hybrid...  ...for this role. Why is the Position Open? Supplement additional workload on team....  ...self-motivated, organized, and able to multi-task. Employee Value Proposition: The person in... 
    Senior
    Permanent employment
    Contract work
    Relocation

    3key Consulting, Inc.

    Thousand Oaks, CA
    6 days ago
  • Job Title: AutomationEngineer Senior, Software, Biotech DeltaV, SCADA, PLC - (JP5947) Location...  ...and regulations Why is the Position Open? Supplement additional workload on team....  ...self-motivated, organized, able to multi-task in project environments, and skilled in communication... 
    Senior
    Permanent employment
    Contract work
    Remote work

    3key Consulting, Inc.

    Thousand Oaks, CA
    2 days ago
  • $170.6k - $390k

     ...Cybersecurity consulting practice – the best place in the world to grow your career in information security! The opportunity The Senior Network Security Architect is a strategic and hands‑on technical leader responsible for designing, implementing, and governing... 
    Senior
    Summer holiday
    Remote work
    Flexible hours

    EY

    Thousand Oaks, CA
    5 days ago
  •  ...Village, CA. The role involves working closely with physicians and healthcare staff to ensure high-quality patient care and managing tasks within the clinical environment. Required qualifications include state licensure, BLS certification, and essential clinical skills... 
    Senior

    UCLA Health

    Westlake Village, CA
    5 days ago
  • $102.5k - $187.9k

     ...processes, technology, and operational impacts in tandem. As a Senior Technology Analyst, you will play a pivotal role in bridging the...  ...include: Interacting with business stakeholders to evaluate business models and processes. Analyzing newly implemented technology... 
    Senior
    Summer holiday
    Flexible hours

    EY

    Thousand Oaks, CA
    2 days ago
  • $102.5k - $187.9k

     ...Responsibilities Designing, configuring, and testing subscription and consumption billing solutions. Interacting with business stakeholders to evaluate business models and processes. Analyzing newly implemented technology solutions to verify they meet business requirements.... 
    Senior
    Summer holiday
    Flexible hours

    EY

    Westlake Village, CA
    5 days ago
  • Mercor is seeking Internet-Native Bilingual Evaluator Experts (Japanese-English) to enhance advanced AI research focused on multilingual communication and internet culture. The ideal candidate will evaluate content from diverse digital channels and participate in AI system... 
    Remote job

    Mercor

    Thousand Oaks, CA
    3 days ago
  • Mercor is looking for a Basque Audio Generalist Evaluator Expert to work on high-impact audio AI research. Responsibilities include transcribing audio and video content in Basque, developing clear evaluation standards, and running model prompts for testing. Candidates should... 
    Remote job
    10 hours per week

    Mercor

    Thousand Oaks, CA
    3 days ago
  • Job Overview Job Title: Senior Human Factors Engineer IFUs & Prototyping - Onsite (JP14072)...  ...permanent) Posting Date: 05/09/2025 Pay Rate: Open Notes: This is expected to be a contract...  ...is for 1 year; it may be renewed at the end of that period. Ideally, candidates are... 
    Senior
    Permanent employment
    Contract work
    Local area
    Remote work
    Relocation
    Flexible hours

    3key Consulting, Inc.

    Thousand Oaks, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Baseline Evaluator — Open-Ended Tasks. Be the first to apply!