Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Development Engineer, Support Agent Intelligence and Evaluation

$158.1k - $213.8k

Amazon Locker

We are building the next generation of AI-powered advertising intelligence at Amazon Ads. Our team is developing an agent platform that gives every advertiser — regardless of size or sophistication — access to the caliber of strategic campaign management previously available only through dedicated agencies. You will work on agent orchestration, reinforcement learning from expert feedback, trust and permission systems, and scalable inference infrastructure that powers intelligent advertising decisions across Amazon's ad products. This is a greenfield opportunity to define how AI agents operate in one of the world's largest advertising ecosystems.Key job responsibilities- Develop orchestration systems that coordinate multiple specialized AI sub-agents to execute complex, multi-step advertising workflows- Collaborate with cross-functional teams (product, science, partner engineering) to define integration contracts and onboard new consumers to the platform- Build identity, authorization, and permission frameworks that enforce scoped access for diverse caller types - Implement feedback signal pipelines that capture expert judgment and route it into model improvement loops- Design and operate end-to-end evaluation systems that measure recommendation quality, detect regressions, and enforce quality gates- Partner with Applied Scientists to integrate reinforcement learning from human expert feedback into production agent systems- Own system reliability, observability, and performance for always-on agent infrastructure serving thousands of concurrent advertiser accountsA day in the lifeYou might start the morning reviewing eval results from a newly onboarded agent skill, diagnosing why routing accuracy dropped 2%. By mid-morning, you're pairing with an Applied Scientist to tune the feedback pipeline that captures expert signals. After lunch, you're designing the permission model for a new integration. You end the day shipping an observability improvement that surfaces latency bottlenecks across the orchestration chain. Every day is different, but the thread is the same: making AI agents smarter, safer, and more reliable at scale.About the teamWe're a small, high-ownership team within Amazon Ads building the platform that makes AI agents accessible across the advertising ecosystem. Our charter is greenfield: we're defining how agent intelligence gets exposed to other engineering teams. We work closely with Applied Scientists on learning systems, product teams on advertiser experience, and platform teams on shared infrastructure. The team values builders who ship fast, think in systems, and are comfortable operating in ambiguity. If you want to shape how AI transforms advertising from the ground floor, this is the team.Basic qualifications- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- 1+ years of software development engineer or related occupational experience- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience- 1+ years of Object Oriented Design experience- Experience programming with at least one software programming languagePreferred qualification - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience- Bachelor's degree in computer science or equivalentAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .USA, NY, New York - 158,100.00 - 213,800.00 USD annuallyUSA, WA, SEATTLE - 143,700.00 - 194,400.00 USD annually

Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the Software Development Engineer, Support Agent Intelligence and Evaluation in Seattle, WA vacancy
  • $143.7k - $194.4k

     ...Design and implement software solutions that...  ....- Own the full development lifecycle for major...  ...and operational support, ensuring root...  ...real needs while evaluating opportunities to...  ...generative artificial intelligence tools where...  ...meaningful feedback to engineers across experience... 
    Intelligence
    Internship
    Worldwide
    Flexible hours

    Amazon

    Seattle, WA
    6 days ago
  • $143.7k - $194.4k

     ...organization builds the intelligence layer for Amazon...  ...tooling that enables engineers and scientists to...  ...internship professional software development experience- 2+ years...  ...ML concepts (model evaluation, data drift, active...  ...process, including support for the interview or... 
    Intelligence
    Full time
    Temporary work
    Internship
    Seasonal work
    Flexible hours

    Amazon

    Seattle, WA
    a month ago
  • $102k - $169.11k

     ...this position.*** Software Engineer III – Agentic Acceleration...  ...on Google’s Agent Development Kit (ADK) and other...  ...agentic AI systems, intelligent automation workflows...  ...Agent Operations: Support agent deployment, monitoring...  .... Testing and Evaluation: Build testable... 
    Intelligence
    Full time
    Worldwide

    Ukg

    Seattle, WA
    15 hours ago
  • $130k - $170k

     ...Software Engineer, Backend Bellevue, WA Are you ready...  ...Our mission? To bring intelligence to advertising and deliver...  ...through post-launch support, owning the release...  ..., and software development best practices; consistently...  ...influence candidate evaluation or hiring decisions.... 
    Intelligence
    Work from home

    Cognitiv Corp

    Bellevue, WA
    1 day ago
  • $160k - $210k

     ...Our mission? To bring intelligence to advertising and...  ...Role As a Senior Software Engineer, you will own the design...  ...solutions that support ContextGPT integrations...  ...health with rapid development velocity. Collaborate...  ...influence candidate evaluation or hiring decisions.... 
    Intelligence
    Work at office
    Immediate start
    Remote work
    Work from home

    Cognitiv Corp

    Bellevue, WA
    3 days ago
  • $130k - $170k

     ...For employees, our agent Carly provides...  ...delivers strategic intelligence on costs,...  ...features—prompt engineering, context management...  ...of professional software engineering experience...  ...primarily in backend development ~ Strong...  ...Yesterday. We re-evaluate our own toolkit every... 
    Intelligence
    Work at office
    Remote work
    Night shift

    Avante Inc

    Seattle, WA
    15 hours ago
  •  ...Senior Backend Software Engineer At Hiya, we're making business...  .... Our products support branded business calling...  ..., and artificial intelligence. Our work spans both...  ...with Node.js backend development and modern web service...  ...process is designed to evaluate candidates through... 
    Intelligence
    Work at office
    3 days per week

    Hiya Inc

    Seattle, WA
    4 days ago
  • $117.2k - $313.7k

     ...Job Category Software Engineering Job Details...  ...where humans with agents drive customer success...  ...part of your development workflow by...  .... Critically evaluate code (Human or AI...  ...benefits and resources support you to find...  ...uses artificial intelligence (AI) tools to help... 
    Intelligence
    Work at office
    Flexible hours
    3 days per week

    Salesforce.Com Inc

    Seattle, WA
    1 day ago
  • $100k - $150k

     ...team, for building the intelligence behind Indeed's AI sourcing agent-the experience that...  ...UX, data, and platform engineering teams, support measurement and operational...  ...and high-performance software systems Contribute...  ..., and expertise, as evaluated during the interview process... 
    Intelligence
    Work experience placement
    Local area

    Indeed

    Seattle, WA
    1 day ago
  • $111.54k - $167.32k

     ...Software Development Engineer Los Angeles, CA; Seattle, WA About Re:Build At Re:Build, our mission...  ...scalable technical solutions while supporting the broader engineering team. They...  ...tools improved by artificial intelligence to accelerate delivery and support debugging... 
    Intelligence
    Hourly pay
    Work at office

    Re:Build Manufacturing

    Seattle, WA
    4 days ago
  • $118k - $178k

     ...Day As a Senior Software Engineer on the AI Gateway &...  ...will own and drive the development of platform services...  ..., and expertise, as evaluated during the interview...  ...of benefits to support Indeedians, as well...  .... We use artificial intelligence (AI) tools to assist... 
    Intelligence
    Work experience placement
    Local area

    Indeed Inc.

    Seattle, WA
    4 days ago
  •  ...Software Engineer III Be an integral part of an agile team...  ...of the Software Development Life Cycle Leverages...  ...., cloud, artificial intelligence, machine learning, mobile...  ...to critically evaluate, validate, and refine...  ...reimbursement, mental health support, financial coaching... 
    Intelligence

    Chase

    Seattle, WA
    15 hours ago
  • $43 - $52 per hour

     ...programs, talent development courses, and much...  ...where humans with agents drive customer...  ...from experienced engineers while contributing...  ...Ongoing Recruiter Support You're Our...  ...uses artificial intelligence (AI) tools to help...  ...recruiters assess and evaluate candidates'... 
    Intelligence
    Hourly pay
    Temporary work
    Fixed term contract
    Summer work
    Internship
    Summer internship

    Salesforce.Com Inc

    Bellevue, WA
    4 days ago
  • $145k - $217k

     ...to Day As a Senior Software Engineer at Indeed, you will contribute to the development and evolution of software systems that support core products and services...  ...into competitive intelligence and spend guidance for...  ...experience, and expertise, as evaluated during the interview... 
    Intelligence
    Work experience placement
    Local area

    Indeed

    Seattle, WA
    2 days ago
  • $165.2k - $223.6k

     ...AWS) is building a central pipeline of Software Development Engineer (SDE) talent for anticipated roles in 2026. This requisition supports hiring across all AWS SDE positions, from...  ...Compiler Engineering Artificial Intelligence/Machine Learning Healthcare AI Infrastructure... 
    Intelligence
    Internship
    Local area
    Flexible hours
    Day shift

    Amazon

    Bellevue, WA
    1 day ago
  • $197.53k - $276.54k

     ...enhance custom software solutions in...  ...team builds the intelligent software and...  ...around autonomous agents, large...  ...multidisciplinary engineering teams to understand...  ...of vehicle development, testing, and...  ...message queues. Evaluate and integrate...  ...an Education Support Program.... 
    Intelligence
    Permanent employment
    Temporary work
    Internship
    Local area

    Blue Origin

    Seattle, WA
    3 hours ago
  • $160k - $220k

     ...Our mission? To bring intelligence to advertising and...  ...working relationships with engineering teammates and cross-...  ...Performance is evaluated based on: Outcomes...  ...production operation, on-call support, and long-term...  ...August ~ Career development with clear advancement... 
    Intelligence
    Full time
    Work from home

    Cognitiv

    Bellevue, WA
    15 hours ago
  • $160k - $210k

     ...mission? To bring intelligence to advertising...  ...communication skills in a supportive environment where...  ...growth and development of our team...  ...requests every year and evaluates them using our AI...  ...are seeking an engineer who is passionate...  ...robust libraries and software development tools... 
    Intelligence
    Full time
    Work at office
    Local area
    Remote work

    Cognitiv

    Bellevue, WA
    15 hours ago
  •  ...owns AIDRs core reasoning engine the multi-agent layer that turns telemetry...  ...as much time building the evaluation harnesses that tell us whether...  ..., etc.)Strong software engineering fundamentals in...  ...SOC / SIEM / SOAR, threat intelligence, incident response, etc.)Experience... 
    Intelligence

    CipherData, Inc.

    Bellevue, WA
    1 day ago
  • $213k - $256k

     ...Staff Software Engineer - Backend Seattle, Washington,...  ...-driven, actionable intelligence that makes sites smarter...  ...engineers, elevate development standards, and shape...  ...: Continually evaluate industry trends, tools...  ...your whole life is supported. We invest in our crew... 
    Intelligence
    Full time
    Work at office
    Flexible hours
    3 days per week

    LVT Corp

    Seattle, WA
    2 days ago
  • Apple Inc. in Seattle, WA seeks a Senior Manager of AIML Evaluation within Data Science & Insights. You will lead a team of data scientists focused on evaluation for Apple Intelligence and related features, balancing quality with privacy while guiding strategy. You will... 
    Intelligence

    Apple Inc.

    Seattle, WA
    4 days ago
  • $227.8k - $338.8k

     ...an enterprise AI agent platform that helps...  ...production cloud engineering. We are hiring...  ...Requirements ~12+ years in software development. ~7+ years hands...  ...use artificial intelligence tools to help evaluate applications and...  .... These tools support-rather than replace... 
    Intelligence
    Work at office
    Local area

    NetApp

    Bellevue, WA
    1 day ago
  •  ...for everyday users to bring intelligence to conversations, errands, organising...  ..., training workflows, evaluation systems, inference...  ...Collaborate closely with application engineering to integrate ML systems...  ...user impact.Team members are supported, aligned, and able to deliver... 
    Intelligence

    Spectraforce Technologies

    Seattle, WA
    22 hours ago
  • $168.1k - $227.4k

    We build advanced analytic solutions to support the measurement and intelligence needs of Amazon's most strategic advertising customers — Holding...  ...and ensure supply chain transparency.As a Senior Software Development Engineer on the Log-Level Data team, you will build the... 
    Intelligence
    Internship
    Flexible hours

    Amazon

    Seattle, WA
    a month ago
  • $148.5k - $223.9k

     ...where humans with agents drive customer...  ...dependable raises hard engineering questions. How...  ...DoingDrive Agent Development &...  ...environments.Create evaluations and diagnostics that...  ...benefits and resources support you to find balance...  ...uses artificial intelligence (AI) tools to help... 
    Intelligence
    Full time

    Salesforce

    Bellevue, WA
    4 days ago
  • $143.7k - $194.4k

     ...next-generation, agent-driven solutions...  ...across multiple engineering teams and stakeholders...  ...of artificial intelligence, enabling customers...  ...scientists, software engineers, and solution...  ...software development experience- 2+ years...  ...process, including support for the interview... 
    Intelligence
    Internship
    Worldwide
    Flexible hours

    Amazon

    Seattle, WA
    5 days ago
  • $143.7k - $194.4k

     ...re looking for a full-stack software engineer to explore and own new...  ...creativity with artificial intelligence to transform every aspect of...  ...internship professional software development experience- 2+ years of non...  ...hiring process, including support for the interview or... 
    Intelligence
    Internship
    Flexible hours

    Amazon

    Seattle, WA
    12 days ago
  • $197.3k - $313.7k

     ...where humans with agents drive customer...  ...implementing software that manages...  ...a key role in evaluating and...  ...mentor other engineers as they build...  ...accelerate design, development, and operationsStrong...  ...and resources support you to find balance...  ...artificial intelligence (AI) tools to... 
    Intelligence
    Full time

    Salesforce

    Bellevue, WA
    3 days ago
  • $143.7k - $194.4k

     ...technology? Amazon is growing, and we need Software Development Engineers who move fast, are capable of...  ...innovation at the forefront of artificial intelligence, enabling customers to transform...  ...our working culture. When we feel supported in the workplace and at home, there’... 
    Intelligence
    Internship
    Worldwide
    Flexible hours

    Amazon

    Seattle, WA
    a month ago
  • $143.7k - $194.4k

     ...environments. We are seeking a software developer engineer to be part of our team to...  ...learning and artificial intelligence, data lakes and analytics,...  ..., and we celebrate and support the career progression of...  ...organization, you’ll support the development and management of Compute,... 
    Intelligence
    Internship
    Flexible hours

    Amazon

    Seattle, WA
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Development Engineer, Support Agent Intelligence and Evaluation. Be the first to apply!