Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied Science Manager, Artificial General Intelligence , Frontier AI Assets: Assessments

$183.8k - $248.7k

Amazon Locker

The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Science Manager with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to lead a team ensuring the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems.Key job responsibilitiesAs part of the AGI team, an Applied Science Manager will lead and mentor a team of Applied Scientists who develop comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. The manager will guide the team in designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that align with core scientist team developing Amazon Nova models. The Applied Science Manager will oversee expert-level manual audits, meta-audits to evaluate auditor performance, and provide coaching to uplift overall quality capabilities across the team. A critical aspect of this role involves managing the development and maintenance of LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Science Manager will also oversee the configuration of data collection workflows and ensure effective communication of quality feedback to stakeholders. The manager will have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services.The Applied Science Manager will be responsible for recruiting, hiring, and developing team members, conducting performance reviews, setting clear expectations and growth plans, and fostering a culture of scientific excellence and innovation. The manager will communicate with senior leadership, cross-functional technical teams, and customers to collect requirements, describe product features and technical designs, and articulate product strategy.A day in the lifeAn Applied Science Manager with the AGI team will lead quality solution design, guide root cause analysis on data quality issues, drive research into new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. The manager will work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice. The manager will also conduct regular 1:1s with team members, provide mentorship and coaching, and ensure the team delivers high-impact results aligned with organizational goals.Basic qualifications- 3+ years of scientists or machine learning engineers management experience- Knowledge of ML, NLP, Information Retrieval and AnalyticsPreferred qualification - Experience building machine learning models or developing algorithms for business application- Experience building complex software systems, especially involving deep learning, machine learning and computer vision, that have been successfully delivered to customersAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .USA, MA, Boston - 183,800.00 - 248,700.00 USD annuallyUSA, WA, BELLEVUE - 183,800.00 - 248,700.00 USD annually

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Applied Science Manager, Artificial General Intelligence , Frontier AI Assets: Assessments in Bellevue, WA vacancy
  • $167.1k - $226.1k

    Amazon's Artificial General Intelligence (AGI) organization builds frontier models and the AI agents on top of them, and...  ...AI (FAI) Assessment team owns the science of dataset quality...  ...for frontier AI assets- Build the automated...  ...country/region you’re applying in isn’t listed,... 
    Asset
    Flexible hours

    Amazon

    Bellevue, WA
    3 days ago
  • $166k - $195k

     ...Security Operations Manager Join us in...  ...4 trillion of assets will be...  ...an elite team, applying frontier technologies to...  ...facility risk assessments, and lead training...  ...and emotional intelligence Experience in...  ...Access to the best AI tools on the...  ...uses artificial intelligence (... 
    Asset
    For contractors
    Internship
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Robinhood Markets, Inc.

    Bellevue, WA
    4 days ago
  • $148.7k - $201.2k

    Description Amazon's Frontier AI Assets (FAI) team works to improve...  ...of sources to help assess and improve the data...  ...effective dependency management, and continuous...  ...will work closely with science and engineering teams...  ...country/region you’re applying in isn’t listed, please... 
    Asset
    Flexible hours

    Amazon Inc.

    Bellevue, WA
    5 days ago
  • $135.66k

     ...Unleash Your Potential as an AI Trailblazer At Amazon, we're...  ...and access information. Our Applied Science team is at the forefront of this...  ...of machine learning assets, from data to deployed models...  ...the intersection of Knowledge Management within Machine Learning. You... 
    Asset
    Full time
    Internship
    Worldwide
    Relocation

    Amazon

    Bellevue, WA
    2 days ago
  • $135.66k

     ...Potential at the Forefront of AI Innovation At Amazon, we're on...  ...into awe-inspiring reality. As an Applied Science Intern focused on Information and Knowledge Management in Machine Learning, you will...  ...lifecycle of machine learning assets, from data to deployed models in... 
    Asset
    Full time
    Internship
    Summer internship
    Relocation

    Amazon

    Bellevue, WA
    2 days ago
  • $129k - $152k

    Jobs / Senior Product Manager, Security AI Senior Product...  ...estimated $124 trillion of assets will be inherited by...  ...an elite team, applying frontier technologies to the...  ...Engineering, and Data Science to ensure AI systems...  ...such as model risk assessments, red-teaming, adversarial... 
    Asset
    Full time
    Work at office
    Shift work
    3 days per week

    AIToolboard

    Bellevue, WA
    5 days ago
  • $136k - $184k

     ...working with data, science, business and...  ...Topology design..-Manage several, high impact...  ...Models, for scientific assets) - Mentor team...  ...provide promotion assessments; contribute hiring...  ...with or evaluating AI systems experience...  ...STEM)- Experience applying theoretical models... 
    Asset
    Flexible hours

    Amazon

    Bellevue, WA
    5 days ago
  •  ...nuclear energy and related sciences are yielding...  ...state, or local law. Manager, Facilities Technology...  ...management, space reservation, asset tracking, and related...  ...and networking — applied primarily to diagnosis...  ...the portfolio grows, assessing business requirements,... 
    Asset
    For contractors
    Local area
    Remote work
    Relocation

    Terrapower

    Bellevue, WA
    4 days ago
  • $110k - $220k

     ...execute the data science roadmap for the experimentation...  ...data systems, and AI evaluation. You...  ...team owns and manages Walmart’s...  ...experimentation data assets.Establish and govern...  ...AI evaluation, or applied machine learning....  ...completion of one or more assessments in Python, Spark,... 
    Asset
    Full time
    Temporary work
    Part time

    Walmart

    Bellevue, WA
    4 days ago
  • $258.8k - $304.2k

     ...make an impact?Applied AI Engineer/Architect...  ...and West Monroe assets, defining AI...  ...Stay current on frontier AI models, enterprise...  ...and access management, security, data...  ...critical thinking to assess accuracy,...  ...use of generative artificial intelligence during the application... 
    Asset
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    Seattle, WA
    2 days ago
  • $142.8k - $193.2k

     ...through self-service and managed channels with a goal...  ..., and content intelligence that do not exist today...  ...We are looking for an Applied Scientist to join the...  ...producing scored creative assets at scale.- Develop ranking...  ....- Contribute to the science community through internal... 
    Asset
    Flexible hours

    Amazon

    Seattle, WA
    5 days ago
  •  ...About the Role We are hiring a Applied AI Engineer for a leading fintech company's AI Team...  ...exploration and dogfooding — building small, frontier prototypes in internal scenarios that...  ...best practices into durable team assets. Architecture review participation —... 
    Asset

    ByLabs

    Seattle, WA
    a month ago
  • $134.73k - $174.97k

     ...nuclear energy and related sciences are yielding...  ...state, or local law. Manager, Security Operations –...  ...to protect personnel, assets, intellectual property...  ...surveys, and venue security assessments. Coordinate with...  ...enforcement, military, intelligence, or related... 
    Asset
    Permanent employment
    Contract work
    Temporary work
    For contractors
    Local area
    Relocation package
    Shift work

    TerraPower

    Bellevue, WA
    4 days ago
  • $145k - $170k

     ...estimated $124 trillion of assets will be inherited by...  ...an elite team, applying frontier technologies to the...  ...with fluency in Artificial Intelligence, to amplify your impact...  ...Excellent program/project management skills with a...  ...your application. AI Usage Disclosure: Robinhood... 
    Asset
    Work at office
    Shift work
    3 days per week

    Robinhood Markets, Inc.

    Bellevue, WA
    5 days ago
  •  ...WRITER is the AI platform built for...  ...teams, bringing the frontier of AI to the people...  ...signals and enterprise intelligence to grow revenue...  ...agent action and asset is grounded in trust...  ...Ph.D. in Computer Science, Machine Learning,...  ...a track record of applying them to real,... 
    Asset
    Full time
    Local area
    Flexible hours

    AItoolnavio

    Seattle, WA
    3 days ago
  • $200k - $270k

     ...usher in this new era, we seek AI-native thinkers across every...  ...Staff Forward Deployed Engineer, Applied AI on our Cortex AI team, you...  ...advisor to customer data science and engineering leadership. Set...  ...patterns and turn them into reusable assets - reference architectures,... 
    Asset

    Snowflake

    Bellevue, WA
    3 days ago
  • $94.4k - $266.3k

     ...of Advanced Technology and Intelligent Operations centers. Our 738...  ...are seeking an experienced Manager, DC Facilities: Assess, Engineer & Design to lead...  .../fiber), and DCIM platform asset tracking (Nlyte, Sunbird, Vertiv...  ...in cloud, data and AI with unmatched industry experience... 
    Asset
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture Global

    Kirkland, WA
    3 days ago
  • $166k - $195k

     ...124 trillion of assets will be inherited...  ...an elite team, applying frontier technologies to...  ...through talent assessments, performance calibration...  ...teams Build AI-powered tools...  ...design, talent management, performance management...  ...Robinhood uses artificial intelligence (AI) tools to... 
    Asset
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood Markets, Inc.

    Bellevue, WA
    6 days ago
  • $217k - $255k

     ...4 trillion of assets will be inherited...  ...elite team, applying frontier technologies...  ...The Talent Management & Analytics team...  ...and tactical AI into our workforce...  ...of data science, product development...  ...of talent intelligence: Take the team...  ...Robinhood uses artificial intelligence (... 
    Asset
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood

    Bellevue, WA
    2 hours ago
  • Amazon.com Services LLC seeks a Sr. Technical Program Manager for the Frontier AI Assets (FAI) team in Bellevue, WA. You will define program strategy...  ...from design through delivery. You’ll coordinate with science and engineering teams, report to senior leadership, and... 
    Asset

    Amazon Inc.

    Bellevue, WA
    5 days ago
  • $297.5k - $350k

     ...is Amazon's new AI-powered shopping...  ...personalized and intelligent shopping experience...  ...seeking a Director, Applied Science to lead the...  ...Amazon's vast data assets into rich context...  ...and RL that match frontier model quality at...  ...years of people management experience, including... 
    Asset
    Local area
    Flexible hours

    Amazon

    Seattle, WA
    1 day ago
  •  ...Washington EdTech Artificial Intelligence Energy Storage Machine...  ...Specialties Information Management Librarianship Informatics Information Science About the Role The Company...  ...requires the ability to assess asset condition, infrastructure needs... 
    Asset

    Confidential

    Seattle, WA
    6 days ago
  • $142.8k - $193.2k

     ...different ways that the transportation assets can be used to delight the customer...  ...Services, North America Sort Center Science team is for you . We manage the delivery of tens of millions of...  ...an enthusiastic, customer obsessed Applied Scientist with strong scientific thinking... 
    Asset
    Flexible hours

    Amazon

    Bellevue, WA
    1 day ago
  • $94.32k

     ...passionate about AI, and its...  ...help accelerate science? Ai2's Asta Project...  ...and intelligent interfaces, data...  ...problems at the frontier of AI for science...  ...2027, please apply by December 1,...  ...Accessibility (ASSETS). A portion of...  ...judgment required to assess data quality and... 
    Asset
    Contract work
    Summer work
    Internship
    Work at office
    Flexible hours
    Weekend work

    The Allen Institute for Artificial Intelligence

    Seattle, WA
    2 hours ago
  • $142.8k - $193.2k

     ...Mile transportation network runs on physical assets and operations that generate an enormous...  ..., Scheduling, Technology (NEST) Science team within the Amazon Transportation Services organization is looking for an Applied Scientist with deep Computer Vision (CV) expertise... 
    Asset
    Flexible hours

    Amazon

    Bellevue, WA
    3 days ago
  • $134.5k - $265.1k

     ...Deloitte Consulting that manages a portfolio of emerging...  ...an experienced Senior Applied Research Scientist -...  ...prototypes, reusable software assets, technical roadmaps,...  ...Mathematics, Computer Science, Quantum Information...  ...real-world problems and assess when structural characteristics... 
    Asset
    Local area

    Deloitte

    Seattle, WA
    3 days ago
  • $22.5 - $31 per hour

     ...technician personnel. Leads training, coaching, and performance management of pharmacy technicians. Makes decisions regarding...  ...of Good Faith Dispensing are met. Maintains and applies knowledge of Company asset protection techniques. Supports Pharmacy Manager with diversion... 
    Asset
    Hourly pay
    Full time
    Work experience placement
    Local area
    Flexible hours
    Afternoon shift

    Walgreens

    Bellevue, WA
    1 day ago
  • $132.5k - $338.3k

     ...in enterprise AI — one defined not...  ..., and routing intelligence required to make...  .... Our applied research function...  ...intersection of frontier AI research and...  ...reduction, context management at scale, and retrieval...  ...) in Computer Science, Computer...  ...solutions and assets across Strategy... 
    Asset
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Relocation

    Accenture Global

    Kirkland, WA
    3 days ago
  • $217k - $255k

     ...estimated $124 trillion of assets will be inherited by younger...  ...building an elite team, applying frontier technologies to the world’s...  ...Modernize how we make. Put AI at the center of how we design...  ...Disclosure: Robinhood uses artificial intelligence (AI) tools to support parts... 
    Asset
    Freelance
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood Markets, Inc.

    Bellevue, WA
    1 day ago
  •  ...semantic modeling, AI?ready datasets,...  ...reliability of production assets. Good...  ...Unify Data ? Unify Intelligence solution using Microsoft...  ...Data reporting, KPI management, and enterprise...  ...monitoring, data quality assessment, and domain?...  ...sellers. Identified and applied techniques to... 
    Asset

    Xoriant Corporation

    Bellevue, WA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied Science Manager, Artificial General Intelligence , Frontier AI Assets: Assessments. Be the first to apply!