Senior Foundation-Model Evaluation Scientist
Oracle
Oracle is seeking a Senior Applied Scientist to independently own end-to-end evaluations of foundation models, AI agents, and enterprise AI systems. You will translate customer needs into testable hypotheses, design benchmarks, and build reproducible evaluation pipelines. Seek to analyze data quality, latency, cost, and reliability while collaborating with science, engineering, product, and leadership teams. Strong Python and ML framework experience required. #J-18808-Ljbffr Oracle
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Senior Foundation-Model Evaluation Scientist in Seattle, WA vacancy
- ...responsible for building machine learning models and systems to protect our users from... ...frontier directions: (1) Multimodal moderation foundation model: We study large-scale MoE... ...similar technologies.- Experience with evaluation of AI systems, LLM application & agent development...FoundationFlexible hoursShift work
TikTok
Seattle, WA5 days ago $272k - $431.25k
NVIDIA's OmniDreams and FlashDreams are the foundation for a new generation of interactive world-model systems. With this release, NVIDIA has set the standard... ...Hands-on experience building, adapting, or deeply evaluating world models, video generation systems, neural rendering...SeniorFoundationFull timeNvidia
Seattle, WA4 days ago- ...Accenture's Enterprise Operating Model practice. We partner with Boards... ...strategy - serving as the foundation for total enterprise reinvention... ...best in teams.The Work:Engage with senior clients on their biggest business challenges.Evaluate actionable solutions to these challenges...SeniorFoundationFull timeWork experience placementLive inWork at officeLocal area
Accenture
Seattle, WA5 days ago - Sapience AI in Seattle, WA seeks a Foundational Model Research Data Scientist to study, adapt, and advance foundation models powering collective intelligence. You will design experiments, evaluate models for language understanding, grounding, and reasoning, and feed insights...Foundation
$192k - $304.75k
We are now looking for a Senior Robotics Research Scientist! NVIDIA is at the forefront of the AI and robotics... ...leverage the Cosmos and GR00T-N foundation models, as well as the Newton physics... ...workflows for model training and evaluation.Ways to stand out from the crowd:Prior...SeniorFoundationFull timeWork at officeNvidia
Seattle, WA3 days ago$192.2k - $260k
Amazon is hiring a Senior Applied Scientist within Customer Forecasting and Valuation (CFV). CFV... ...primary decision metrics Amazon uses to evaluate launches and investments — causal... ...team is developing transformer-based foundation models of customer behavior, learned...SeniorFoundationTemporary workFlexible hoursAmazon
Seattle, WA5 days ago- ...learning research team within modeling sophistication, DSE), we... ...service. You will fine-tune and evaluate small language models, build... ...and agentic tool use.Strong foundation in machine learning, statistics... ...to peers, management and less senior business leaders.Ability to use...SeniorFoundationWork at officeLocal areaRemote work2 days per week
Liberty Mutual
Seattle, WA6 days ago $192.2k - $260k
The Shopping Convo Foundations Team - Pre-purchases Science is looking for an Senior Applied Scientist with expertise in Artificial Intelligence... ...develop state-of-the-art ML models, conduct rigorous... ...entitlement, to designing and evaluating extraction strategies for ASINs...SeniorFoundationLocal areaFlexible hoursAmazon
Seattle, WA4 days ago- ...iteratively improves itself through feedback, evaluation, and automated learning loops. You will... ...evaluation harnesses and metrics before models — because a self-improving system is... ...harnesses. Reinforcement learning foundations and curiosity. Working knowledge...SeniorFoundation
Hippocratic AI
Seattle, WA4 days ago - ...Senior Applied Scientist The OCI AI Evaluation team builds the evidence behind model-selection, product-readiness, and launch decisions. We evaluate frontier foundation models and AI systems across capabilities such as reasoning, coding and agentic coding, retrieval...SeniorFoundation
Oracle
Seattle, WA1 day ago $192.2k - $260k
...we are seeking an experienced Applied Scientist to lead pioneering research and development... ...learning, knowledge representation, foundation models, and reinforcement learning, you will... ...sound solutions across teams, define evaluation methods, and lead complex reviews....SeniorFoundationLocal areaFlexible hoursAmazon
Seattle, WA4 days ago$140k - $175k
# Senior Applied ScientistOutreachSeattle, WA (Hybrid... ...AI systems. Building, evaluating, and deploying ML and... ...work of the role. The scientist will develop AI... ...key pain points, from model architecture to service... ...related disciplines• Strong foundation in statistics and...SeniorFoundationFull timeRemote workFlexible hoursWe Love AI Jobs
Seattle, WA3 days ago$192.2k - $260k
...Generative AI, Visual Language Models (VLMs), and multimodal... ...and customer-focused applied scientist to help us make the world's... ...leading models leveraging VLMs, foundation models, and agentic... ...multimodal data with rigorous evaluation frameworks* Define research...SeniorFoundationWorldwideFlexible hoursAmazon
Seattle, WA3 days ago$167.1k - $226.1k
Do you want to work on Tabular Foundational Model (TFM) to evolutionize how enterprises unlock insights from structured data? We're building... .... Our customers bring problems that will give Applied Scientists like you endless opportunities to see your research have a positive...FoundationImmediate startFlexible hoursAmazon
Seattle, WA5 days ago$173k
...Sr. Machine Learning Scientist, Agentic AI & GenAI Systems... ...for a hands‑on Senior Machine Learning Scientist... ..., etc) and advanced evaluation platforms leveraging LLM... ...targeting, propensity models, and next‑best‑action... ...and RAG systems. Solid foundation in NLP and experience...SeniorFoundationTemporary work$100k - $150k
...communication with a team of consulting scientists and engineers.... ...design, construction, testing, evaluation, and rehabilitation of large... ..., and numerical groundwater models to support contaminated site... ..., and scientists form the foundation for a comprehensive environmental...SeniorFoundationFlexible hours$167.1k - $226.1k
Interested in modeling and understanding customer behavior through... ...customers? Join our team of Scientists developing models to model... ...personalization, building GenAI foundation models, global scalability... ....Design, develop and evaluate highly innovative models and...SeniorFoundationTemporary workFlexible hoursAmazon
Seattle, WA3 days ago$192.2k - $260k
...revolution, come join Amazon's Fauna Robotics. As an Applied Scientist in this org, you'll push the state-of-the-art techniques in... ...responsibilities- Lead technical initiatives in areas such as robotics foundation models, reinforcement learning and manipulation - - Design...SeniorFoundationLocal areaFlexible hoursAmazon
Bellevue, WA5 days ago$167.1k - $226.1k
...work alongside world-class scientists to build AI that transforms... ...sciences. We apply biological foundation models large language models and agentic... .... You will design train and evaluate systems that reason over... ...You will work closely with senior and principal scientists on...SeniorFoundationFlexible hoursAmazon
Seattle, WA7 days ago$159.2k - $215.3k
...data and Artificial Intelligence (AI) foundations for CS to ensure Amazon delivers the... ...work with engineers and applied scientists to design models that leverage large scale and unstructured... ...- Design and conduct rigorous evaluations of CS actions- Develop experiments to...SeniorFoundationFlexible hoursAmazon
Seattle, WA6 days ago- Sapience AI is seeking a Senior AI/ML Data Model Architect to own data models, schemas, and representations that connect a community’s knowledge... ...structures across the platform. You will lead the data foundation across multiple teams, focusing on quality, lineage, and...SeniorFoundationRemote job
$140k - $175k
...Outreach. We are a team of applied data scientists who thrive on solving complex scientific... ...maximize ROI for key pain points, from model architecture to service orchestration. Contributing... ...learning, or related disciplines Strong foundation in statistics and experiment design, and...SeniorFoundationFull timeWork at officeFlexible hoursNight shiftOutreach
Seattle, WA7 days ago- The Bill & Melinda Gates Foundation invites applications for a Senior Research Scientist in Seattle, WA. The two-year limited-term role focuses on population health modeling, nutrition science, and disease research, requiring a PhD in a quantitative field and a minimum...SeniorFoundation
- Ai2, a Seattle-based AI research institute, is hiring a Senior Research Scientist to train and advance fully open foundation models. You will lead research, build training pipelines, curate data, and contribute to multimodal model development in a fast-paced environment...SeniorFoundation
- ...throughout the organization and sets the foundation for delivering our full suite of... ...facing problems. We are looking for an Senior Research Scientist who can work on different aspects of... ...high-precision, low latency prediction models and deliver an exceptional customer...SeniorFoundation
Comtech
Seattle, WA5 days ago $183.8k - $248.7k
...learning, causal inference, and product optimization, where your models directly shape how customers experience advertising on one of... ...Video in 2024 and are now in the process of building the science foundation to make our ad experience the most customer-centric in the...SeniorFoundationFlexible hoursShift workAmazon
Seattle, WA3 days ago- ...Allen Institute for Artificial Intelligence (Ai2) in Seattle, WA seeks a Senior Research Scientist for the Open Ecosystem. You will lead research on training and deploying fully open foundation models, emphasizing agentic training and multimodal data. This role combines...SeniorFoundation
$159.75k - $255.6k
...a skilled and innovative Senior AI Research Scientist to join a new team focusing... ...functional teams to train models and develop cutting-edge algorithms... ..., retrieval systems, foundation models, agentic systems,... ...model development, evaluation, deployment, and iteration...SeniorFoundationWork experience placementWork at officeRemote workAxon
Seattle, WA7 days ago- ...WA, seeks an experienced ML researcher to shape multimodal foundation models and build evals for real-world deployment. You’ll drive pretraining... ...ship telemetry-driven improvements. You'll design robust evaluation suites, scale data pipelines, and collaborate across...SeniorFoundation
$204k - $216k
...from and reasons over. You design the data models, schemas, and representations that... ...are the person who makes sure the data foundation is coherent, so everything built on top... ...many communities, without fragmenting. The Senior AI/ML Data Model Architect owns that foundation...SeniorFoundationLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Foundation-Model Evaluation Scientist. Be the first to apply!
Related searches
- support scientist Seattle, WA
- senior analytical scientist Seattle, WA
- decision scientist Seattle, WA
- senior research scientist Seattle, WA
- scientist 1 Seattle, WA
- scientist Seattle, WA
- research scientist Seattle, WA
- qc scientist Seattle, WA
- senior principal scientist Seattle, WA
- applied sports scientist Seattle, WA