Senior ML Baseline Evaluator — Open-Ended Tasks
Mercor
Mercor is looking for experienced machine learning engineers and researchers to act as human baseliners for evaluating AI agents on research tasks. Candidates must have at least 3 years of machine learning experience and a strong background in major ML frameworks like PyTorch or TensorFlow. This role requires you to work independently in a sandboxed environment, attempting tasks while adhering to fixed time and compute budgets. Your performance will inform evaluations of AI models. #J-18808-Ljbffr Mercor
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Baseline Evaluator — Open-Ended Tasks in Renton, WA vacancy
- Senior Principal Back-End Network Engineer, AI Infrastructure US About Nscale Nscale is the GPU cloud... ...an Nscaler, you’ll build trust through openness and transparency, where everyone is... ...required to perform additional duties, tasks, and responsibilities as assigned by management...Senior
- Senior Principal Front-End Network Engineer, AI Infrastructure Operations Houston; New York; San Francisco... ...Nscaler, you’ll build trust through openness and transparency, where everyone is... ...required to perform additional duties, tasks, and responsibilities as assigned by management...SeniorFlexible hours
- Senior Front-End Network Engineer, AI Infrastructure Operations Houston;... ...you’ll build trust through openness and transparency, where everyone... ...management, firmware baselines, and change safety Monitoring... ...perform additional duties, tasks, and responsibilities as assigned...SeniorFixed term contract
$173k - $242.5k
NLP PEOPLE is seeking a Senior Machine Learning Scientist in Seattle to lead the development of GenAI and LLM solutions, enhancing customer experiences post-booking. The role involves managing end-to-end ML projects, applying advanced techniques in machine learning and...Senior$105.8k - $174.8k
...skills and ambitions. As a Senior AI Native Engineer, you... ...perform development tasks to ensure robust... ...experience with popular ML packages such as TensorFlow... ...transforming data and evaluating results to make meaningful... ...and deploying end‑to‑end ML workflows on...SeniorFull timeWork experience placementSummer holidayFlexible hoursErnst & Young Oman
Seattle, WA4 days ago- Nscale is seeking a Senior Principal Front-End Network Engineer for its AI infrastructure, focusing on high-performance Ethernet networks. Located in Seattle, this role requires 12+ years of network engineering experience, particularly in hyperscale data centres. The successful...Senior
- ...the next generation of our ML/AI platform that doesn't... ..., sandboxes, and evaluation frameworks that let AI agents... ...model improvement Own the end-to-end lifecycle from... ...a combination of vendor, open source or in house built tools — covering task success, tool selection accuracy...
Salesforce
Seattle, WA4 days ago - ...and you “get stuff done” end-to-end. You use AI to... ...toil. What you'll do As a Senior/Staff Software Engineer... ...that handles routine DBA tasks — performance tuning, capacity... .... Experience with AI/ML technologies, LLM... ...with respect to specific open position(s). Search firms...SeniorWorldwide
$174k - $299k
...Senior Staff Software Engineer We exist to wow our... ...platform. This team is tasked with building a highly scalable... ...from Zero: Lead the end-to-end design of a distributed... ...: Integrate AI/ML models to automate system... ...Cassandra and TiDB preferred Open Source Leadership:...SeniorTemporary workFlexible hoursCoupang
Seattle, WA15 hours ago- ...for learning to build scalable ML systems that drive business impact... ...Key Responsibilities End-to-End Delivery: Build complete... ...with product, engineering, and senior researchers to translate requirements... ...in ML conferences or contributions to open-source projects...Senior
Warner Bros.
Bellevue, WA2 days ago $146.88k - $220.32k
...whether through a PhD in ML or equivalent hands‑on... ...training Ai2’s flagship open models (e.g. Olmo, Molmo... ...experiment release, you’ll own end‑to‑end delivery while... ..., training, and evaluating multimodal models (vision... ...planning, and long‑horizon tasks Scoping and leading research...SeniorFlexible hours$166k - $258k
## Senior Engineer 2: AI Agentic Platform (Hybrid... ...AI agents.* Own end-to-end solution... ...platform services; evaluate and adopt emerging... ...orchestration patterns: task decomposition, tool... ...) and integrating ML models into production... ...* Contributions to open-source AI or...SeniorTemporary work$144k - $329.1k
...world. Role AI & Data - Data Architecture – Senior Manager – Power & Utilities Sector EY is... ...in Data Architecture, Data Modernization, End to end Data capabilities, AI, Gen AI, Agentic... ...data to insights and enable the use of ML and AI at scale for your clients. This is...SeniorSummer holidayFlexible hoursErnst & Young Oman
Seattle, WA3 days ago- ...Senior DevOps Developer The Boeing Company is currently seeking a Senior DevOps Developer... ...releases Automating repetitive tasks, including provisioning, configuration, and... ...integrating DevOps, MLOps and expertise in AI/ML-driven observability or anomaly detection...Senior
Boeing
Renton, WA15 hours ago $93.9k - $154.2k
...Senior Data Engineer EXL is hiring a Senior Data Engineer to join a strategic AI / ML platform engagement with a leading specialty retailer.... ...the requirements; the lower end applies to those with less experience... ...be considered. EXL is open to sponsoring H1B transfers...SeniorH1bRemote work3 days per weekEXL
Seattle, WA15 hours ago- ...of the world’s most influential companies. As a Senior Principal Software Engineer at JPMorganChase within the CDAO AI/ML Data Platforms Team, you provide deep... ...qualifications, capabilities, and skills Familiarity with open‑source projects in the OLAP/data stack: Apache...Senior
Next Frontier Capital
Seattle, WA1 day ago $180k - $215k
...robots run in the field. As an ML Engineer at FieldAI, you will... ...capabilities that generalize across tasks and environments. Beyond model... ...machine learning models for end‑to‑end learning‑based... ...architectures, optimization, and evaluation, with a strong grasp of end‑to...SeniorLocal areaFieldAI
Seattle, WA3 days ago- ...Senior Full Stack Software Engineer Seattle, Washington, United States... ...make an impact? Build end-to-end features across a Node.... ...automate repetitive engineering tasks, and improve code quality.... ...preferred) Background in AI/ML-adjacent product development or...Senior
NICE
Seattle, WA4 days ago $290.25k
...specific hardware architectures. Evaluate the performance of LLM, MLLM,... ...Scientist, +8 years for Senior ML Scientist, or +10 years for Principal... ...models, and implementing end‑to‑end training pipelines. Leverage... ...publications, tech blogs, open‑source code and participation...SeniorRemote workNational Society for Black Engineers
Seattle, WA4 days ago- ...more information, please .Senior Staff Machine Learning... ...performance, multi-system AI/ML platforms, with hands-on... ...power large sets of end-to-end GenAI agentic... ...etc. • System & Platform Evaluation: Own technical decisions... ...AIML platform utilizing open-source/cloud-agnostic components...Senior
GEICO
Seattle, WA4 days ago - ...doing things. We are hiring a Senior Product Manager to design, develop... ...enable more Generative AI and ML use cases. This is a large,... ...trends in commercial products and open-source projects, specifically in... ...across feature teams. Own the end-to-end product life cycle from...Senior
$185k - $235k
...well every downstream ML model performs: better... ...looking for an experienced Senior Machine Learning... ...signal‑to‑model pipeline end to end: defining and building... ...execute well‑scoped tasks. Responsibilities Build... ..., offline/online evaluation, deployment, monitoring...Senior$165.2k - $306.8k
...for learning to build scalable ML systems that drive business impact... ...venues. Key Responsibilities End‑to‑End Delivery: Build complete... ...with product, engineering, and senior researchers to translate... ...conferences or contributions to open‑source projects How We Get Things...SeniorTemporary workLocal area- ...well‑positioned for future growth. As the Senior Principal / Principal Enterprise Architect... ...through cutting‑edge solutions. Embed AI and ML capabilities into the technology ecosystem... ...across the Technology Division to ensure end‑to‑end integration across retail and...SeniorWork at office
$170k - $210k
Senior Technical Recruiting Manager# Senior Technical... ...expense and accounting tasks for customers so they can... ...Sourcers focused on AI/ML, Specialized Tech, and... ...refine frameworks for evaluating candidates in specialized... .... You'll own the end-to-end health of your function...SeniorWork at officeRemote workWork from home$184k - $287.5k
Senior Solutions Architect, GPU - Cloud Service Providers page is loaded##... ...customers in building AI/ML and HPC software solutions at scale... ...strategic customers, providing end-to-end technology solutions and... ...performance aspects related to tasks like large scale LLM training...Senior- ...companies: NVIDIA, Stripe, DoorDash, Open AI, TMobile, Moderna, Workday,... ...where possible. The Role As a Senior Software Engineer, you'll have... ...design to delivery Own key ML and AI integrations into our... ...fluency across the stack Successful end to end ownership of complex...Senior
$155.12k - $288.08k
Senior Machine Learning Engineer - Video AI (Vision &... .... Work across the full ML lifecycle: data processing... ..., model development, evaluation, and production... ...application to multimodal tasks. Ability to implement and... ...). Experience building end‑to‑end ML pipelines (data...SeniorTemporary workLocal area$187k - $261.5k
Senior Machine Learning Scientist Introduction to the Team... ...: Design, build, and evaluate multi‑step agentic AI... ...defining how agents decompose tasks, delegate to sub‑agents,... .... Mentor junior ML engineers and scientists... ...issued. Contributions to open‑source ML projects. Experience...SeniorWorldwide$110k - $260k
...engineering underwriting at scale. As a Senior Staff Engineer , you will play... ...‑level workloads Drive end‑to‑end ownership of systems—from... ...experience integrating AI/ML solutions , including LLMs, prompts... ...contributing to or leveraging open‑source frameworks Annual Salary...SeniorHourly payWork experience placementLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Baseline Evaluator — Open-Ended Tasks. Be the first to apply!
Related searches
- senior game producer Renton, WA
- senior robotics software engineer Renton, WA
- senior consulting engineer Renton, WA
- senior application security Renton, WA
- senior manager diversity & inclusion Renton, WA
- senior manager creative operations Renton, WA
- senior creative Renton, WA
- senior software engineer Renton, WA
- senior project manager contract Renton, WA
- senior manager warehouse operations Renton, WA