Senior Responsible AI Evaluation Scientist (AGI)
Jobleads-US
Amazon.com Services LLC's AGI Responsible AI team seeks an Applied Scientist III to advance evaluation of frontier models, focusing on safety, fairness, and trust. You will design benchmarks, metrics, and scalable evaluation systems for large language models and generative AI.
You will collaborate with cross-functional teams, apply large-scale datasets and modern deep learning tools, and mentor colleagues to raise the scientific bar across the organization.
#J-18808-Ljbffr Jobleads-US$159.75k - $255.6k
...are seeking a skilled and innovative Senior AI Research Scientist to join a new team focusing on... ...your research findings to create new responsible AI capabilities for Axon products. You... ...strategy through model development, evaluation, deployment, and iteration in production...SeniorWork experience placementWork at officeRemote work$124k - $280k
...Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist - Senior Manager you will leverage advanced... ...and operational improvement.Responsibilities- Leading AI and GenAI data science... ...scalable solution delivery- Evaluating model performance, testing assumptions...SeniorFull timeH1b- Systems Planning and Analysis, Inc. seeks a Testing and Evaluation AI Subject Matter Expert to provide hybrid support for DHS customers in Washington, DC. The role focuses on integrating AI T&E into DHS acquisition programs, developing robust evaluation methods, and mentoring...SeniorTemporary work
- Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model...SeniorRemote jobFull time
$140k - $180k
...Position Title: Senior AI Enablement Specialist Role Purpose LevelTen Energy’... ...role isn't the right fit. Duties and Responsibilities ~ AI Building & Automation: Build, deploy... ...what's actually relevant to LevelTen. Evaluate new tools against our security and...SeniorCasual workWork at officeWork from homeVisa sponsorshipFlexible hours- ...Amazon Web Services, Inc. in Seattle is seeking a Senior Security Engineer for AI & AGI Security to ensure AI applications meet the highest security standards and protect hundreds of millions of customers. You will partner with software teams to design secure AI experiences...Senior
$130k - $162.5k
...everyone. From advanced data analytics and AI to cybersecurity, we use innovative... ...Group's enterprise AI team. We are AI/ML scientists and engineers with deep expertise in AI/... ...transforming the health care journey through responsible AI/ML innovation, our charter also...SeniorMinimum wageFull timeWork experience placementWork at officeLocal areaRemote work- ...post-training experiments, optimize models for edge and cloud targets, and ship telemetry-driven improvements. You'll design robust evaluation suites, scale data pipelines, and collaborate across engineering to align research with product needs. #J-18808-Ljbffr NoösphereSenior
$153.6k - $207.8k
...and support for Agentic AI/ML use cases.Are you a... ...to help customers evaluate, design, and adopt AWS... ...Solution Architect team as a Senior Generative AI & ML... ...organization, and is responsible for driving revenue and... ...product leaders, data scientists, and executives at...SeniorLocal areaWorldwideFlexible hours- Axon is seeking a Senior AI Research Scientist to advance agentic multimodal AI, focusing on video understanding and scalable inference across... ...translating findings into Axon products with a strong emphasis on responsible AI and privacy. #J-18808-Ljbffr University of Georgia-...Senior
$184k - $287.5k
...you interested in inventing human-level AI for navigation in the unconstrained world... ....Create training, fine-tuning, and evaluation pipelines for large-scale multimodal datasets... ...generation (e.g. traffic accidents are responsible for ~1.25 million deaths per year world-...SeniorFull timeRemote workShift work$122k - $240.5k
Position Summary Agentic AI is moving from... ...to figure out how to build it responsibly and at scale. We're growing a... ...integration, state management, evaluation, guardrails, and human-in-the... ...From entry-level employees to senior leaders, we believe there’s always...SeniorWork at officeLocal areaVisa sponsorshipShift work$122k - $240.5k
Position Summary Join our AI & Engineering team in... ...AI & Data team, you will be responsible for driving technology-focused... ...Bedrock (foundation models, model evaluation, and agent orchestration);... ...From entry-level employees to senior leaders, we believe there’s always...SeniorLocal areaVisa sponsorship- ...resisted innovation. Join us!We are hiring a Senior AI Security Engineer II to lead the... ...AI technologies are deployed securely, responsibly, and at scale.Responsibilities:Design and... ..., and agentic identity management.Evaluate, deploy, and operate AI-specific security...Senior
- Amazon Science in Seattle, WA seeks a Scientist to advance responsible AI across Amazon's AI initiatives. You will tackle controllability, privacy, safety, fairness, explainability, and governance while collaborating with teams deploying real-world AI solutions. The role...
- AI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced... ...enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and provide...Remote job
- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation guidelines compliance, content safety labeling, and...SeniorRemote jobFull time
$91k - $321.5k
...& SummaryThe OpportunityAs a CTIO - AI Engineer- Senior Manager, you will play a pivotal role... ...skills with a focus on staying relevant.Responsibilities- Leading the design and development... ...collaborating closely with team members. We evaluate these factors thoughtfully to...SeniorFull timeH1b$264k - $379.5k
...enterprise. To usher in this new era, we seek AI-native thinkers across every function who... ...how the Snowflake product is developed, evaluated and supported. The job is no less than... ...area, including on-call health, incident response, postmortems, and balancing project...Senior$191k - $253k
...powered by Lattice OS, an AI-powered operating... ...systems. The team is responsible for taking products like... ...We are looking for a Senior AI Infrastructure Engineer... ...required to train, evaluate, host, and serve complex... ...with AI Research Scientists and Platform Engineers...SeniorFull timeWork experience placementImmediate start$266.72k - $350.07k
...The Enterprise Data & AI organization is a strategic... ...data governance and responsible AI practices from the... ...Applied AI/ML Scientist, you define and drive... ...portfolio. You guide senior leaders on where and how... ...production AI systems, evaluation frameworks, and responsible...Permanent employmentFull timePart timeWork visa$155k - $200k
...is hiring a hands-on, client-facing Senior AI Security Engineer to help protect AI workloads... ...’ll strengthen production security by evaluating AI and LLM attack surfaces, deploying... ...aligned to industry frameworks. Responsibilities Assess and address the AI and...SeniorContract work$293.5k
General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335... ...applied AI research, product strategy, and responsible AI governance. You will own the full... ...research, model experimentation, and evaluation design to production system deploymentOversee...SeniorPermanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week$176.76k - $232k
...The Enterprise Data & AI team is a strategic and... ...data governance and responsible AI practices from the... ...responsibilities As a Senior AI/ML Engineer, you will... ...practices, implement rigorous evaluation frameworks, and design... ...partner with applied scientists, software engineers,...SeniorPermanent employmentFull timeContract workPart timeWork visa$170k - $200k
...the artificial intelligence to make it responsive. We are pioneering the Recognition Economy... ...it. Who You Are Metropolis is seeking a Senior AI Engineer to join our Applied AI... ...outputs to ensure continuous value delivery Evaluate and integrate emerging AI tooling (models...SeniorTemporary workWork at officeLocal area- ...gap. We're building the first AI‑powered platform for hardware... ...fast. You’re comfortable evaluating new frameworks, models, and techniques... ...approaches emerge. This senior engineer will work alongside... ...You'll Do Your day‑to‑day responsibilities will include: Designing,...SeniorPermanent employmentContract workRemote workShift work
$150k - $220k
...leveraging data, digital tools, and AI to modernize a historically... ...are seeking a highly skilled Senior Software Eng AI to design,... ...business environments. Responsibilities Architect, build, and optimize... ...including automated testing, evaluation harnesses, and regression...SeniorFlexible hours- ...thinking services company at the forefront of AI-native innovation. We partner with... ..., Java, or equivalent; familiarity with evaluation tooling, logging, monitoring, and agent... ...imperative, every person at Accenture has the responsibility to create and sustain an inclusive...SeniorFull timeWork experience placementLive inWork at officeLocal area
$176.6k - $239k
...adoption of Amazon Quick and AWS's generative AI platform. This is a principal-level... ...completion- 7+ years of experience in senior customer-facing roles including customer... ...position. These include the duties and responsibilities listed above, as well as the abilities to...SeniorLocal areaFlexible hours- ...We are seeking a highly experienced Senior AI Solutions Engineer to design, develop,... ...teams directly AWS/Azure/GCP Key Responsibilities AI/GenAI Solution Development Design... ...databases, APIs, and enterprise systems. Evaluate and optimize model performance, latency...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Responsible AI Evaluation Scientist (AGI). Be the first to apply!
- ai scientist Seattle, WA
- senior service associate Seattle, WA
- senior safety specialist Seattle, WA
- senior vice president of business development Seattle, WA
- senior service designer Seattle, WA
- senior sales recruiter Seattle, WA
- senior mulesoft developer Seattle, WA
- senior media manager Seattle, WA
- senior business manager Seattle, WA
- senior linux systems engineer Seattle, WA




