Software Development Engineer, AGI - Web information retrieval

Description

Amazon AGI is pioneering the next frontier of artificial general intelligence, leveraging over 25 years of AI and machine learning expertise along with Amazon's world-class infrastructure and commitment to responsible AI. Join our diverse team of scientists, engineers, and researchers to push the boundaries of what's possible - from reinventing commerce and enterprise productivity to advancing universal agents and robotics.

We are looking for a Software Development Engineer within AGI to develop a multi-modal, multi-lingual web-scale information retrieval system to make the world’s information accessible to AI models and customers everywhere. We are pushing the boundaries of what's possible by combining the power of large language models with retrieval systems, enabling capabilities in question-answering, knowledge synthesis, and information grounding.

You will have an opportunity to directly impact the customer experience, design, architecture, and implementation of products that will be used every day by people you know. We're looking for someone passionate about innovating on behalf of customers, who demonstrates strong product ownership and is willing to think in new ways to solve difficult problems.

You will have track record of success in delivering new products, solving problems, and learning new technologies quickly. A commitment to teamwork, proactive approach to solving problems, and strong verbal and written communication skills are essential. Creating reliable, scalable, and high-performance products requires technical expertise, understanding of computer science fundamentals, and practical experience building efficient large-scale distributed systems. This person is comfortable delivering quality solutions in a fast-growing environment where priorities may change rapidly.

Key job responsibilities

• Build high-throughput, cost-effective data pipelines to support feature extraction and indexing for our web-scale Information Retrieval (IR) system

• Develop and optimize the core algorithms in Rust and ranking models that power the search engine's ability to retrieve and rank relevant results for user queries.

• Design and implement efficient data structures and indexing techniques to store and retrieve massive amounts of web data and content using Rust programming language.

• Optimize the performance, scalability, and reliability of the search engine's core components, including query parsing, retrieval, ranking, and result rendering.

• Collaborate with machine learning teams to integrate and deploy advanced machine learning models for query understanding, ranking, and personalization.

• Develop and maintain the control plane systems that manage and orchestrate the IR system infrastructure, including the distributed compute clusters, storage systems, and networking components.

• Design and implement real-time updates and freshness mechanisms to ensure the I engine reflects the latest web content and user behavior.

• Develop efficient, state-of-the-art streaming algorithms for processing large datasets (e.g. deduplication, topic clustering)

• Participate in the design and implementation of real-time updates and freshness mechanisms to ensure the search engine reflects the latest web content and user behavior.

Basic Qualifications

• 3+ years of non-internship professional software development experience

• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience

• 1+ years of software development engineer or related occupational experience

• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience

• 1+ years of Object Oriented Design experience

• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field

Preferred Qualifications

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience

• Proficiency in Rust

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .

USA, CA, Sunnyvale - 165,200.00 - 223,600.00 USD annually