Language Data Scientist, Alexa International

Amazon is seeking a Language Data Scientist to join the Alexa International science team as domain expert. This role focuses on expanding analysis and evaluation of conversational interaction data deliverables. The Language Data Scientist is an expert in conversation assessment processes, working closely with a team of skilled machine learning scientists and engineers, and is a key member in developing new conventions for relevant annotation workflows. The Language Data Scientist will be own unique data analysis and research requests that support the training and evaluation of LLMs and machine learning models, and the overall processing of a data collection.Key job responsibilitiesTo be successful in this role, you must have a passion for data, efficiency, and accuracy. Specifically, you will:- Own data analyses for customer-facing features, including launch go/no-go metrics for new features and accuracy metrics for existing features- Handle unique data analysis requests from a range of stakeholders, including quantitative and qualitative analyses to elevate customer experience with speech interfaces- Lead and evaluate changing dialog evaluation conventions, test tooling developments, and pilot processes to support expansion to new data areas- Continuously evaluate workflow tools and processes and offer solutions to ensure they are efficient, high quality, and scalable- Provide expert support for a large and growing team of data analysts- Provide support for ongoing and new data collection efforts as a subject matter expert on conventions and use of the data- Conduct research studies to understand speech and customer-Alexa interactions- Collaborate with scientists and product managers, and other stakeholders in defining and validating customer experience metrics Basic qualifications- 2+ years of data scientist experience- 3+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience- 3+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience- 1+ years of guiding and coaching a group of researchers experience- 1+ years of working with or evaluating AI systems experience- 1+ years of creating or contributing to mathematical textbooks, research papers, or educational content experience- Master's degree or above in Science, Technology, Engineering, or Mathematics (STEM), or experience working in Science, Technology, Engineering, or Mathematics (STEM)- Experience applying theoretical models in an applied environmentPreferred qualification - Ph.D. in Science, Technology, Engineering, or Mathematics (STEM)- Knowledge of machine learning concepts and their application to reasoning and problem-solving- Experience in Python, Perl, or another scripting language- Experience in a ML or data scientist role with a large technology company- Experience in defining and creating benchmarks for assessing GenAI model performance- Experience working on multi-team, cross-disciplinary projects- Experience applying quantitative analysis to solve business problems and making data-driven business decisions- Experience effectively communicating complex concepts through written and verbal communicationAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .USA, WA, Bellevue - 136,000.00 - 184,000.00 USD annually