Research Scientist, Speech Model Evaluation & Metrics
Sanas
A leading AI speech technology company in Palo Alto seeks a Research Scientist to enhance evaluation methodologies for speech AI models. The role involves designing and implementing evaluation frameworks while using advanced metrics to measure model quality. Candidates with over 4 years of experience in speech, audio, or NLP and strong proficiency in Python and engineering practices are preferred. This position is crucial in translating research insights into customer-facing products, fostering collaboration with various teams within the organization. #J-18808-Ljbffr Sanas
- Sanas is looking for a Research Scientist to develop evaluation frameworks for its speech AI models. The role involves ensuring evaluation captures meaningful progress and... ...evaluation systems that bridge automated metrics and human judgment. The ideal candidate will have...Suggested
- Apple Inc. is seeking an expert to evaluate machine learning and deep learning models, playing a crucial role in creating robust evaluation frameworks. The ideal candidate will collaborate with multidisciplinary teams, utilizing statistical methods and Python expertise...Suggested
$180k
...Member Of Technical Staff - Imagine Model Palo Alto, CA; Seattle, WA About... ...for visual and audio data. Design evaluation frameworks, metrics, benchmarks, evals, and reward models... ...horizon visual content creation (audio/speech processing or music/audio generation...SuggestedTemporary work$272k - $431.25k
...019461 Job Category: Research. Time Type: Full time.... ...generating it! Our world model team is pushing the... ...Manager to lead world-model evaluation and benchmarking... ...Lead a team of Research Scientists focused on world‑model... ...‑loop benchmarks, metrics, failure taxonomy, model...SuggestedFull time$154.45k - $208.96k
Groq is seeking a Software Engineer, Model Evaluation Systems, to build and optimize systems ensuring AI models achieve exceptional quality on our platform. This role involves developing benchmarking frameworks and integrating models into Groq’s infrastructure. Ideal candidates...Suggested$150k
About the Institute of Foundation Models We are a dedicated research lab for building, understanding, using... ...world-class researchers, data scientists, and engineers, tackling the most fundamental... ...-training and post-training, and evaluation benchmarks. The role combines...- Google Inc. is hiring a Research Scientist in Mountain View, CA, with a strong background in Machine Learning and a PhD in Computer Science or related field. The role involves proposing independent research directions, managing a strong research agenda, and translating...
$207k - $300k
Research Scientist, Evaluations, Security and Privacy, DeepMind DeepMind Mountain View, CA, USA ; San Francisco, CA, USA Apply X Applicants in San... ...benchmarking frameworks for machine learning models. 2 years of experience in security and privacy. One or...Full time$175k - $350k
...Model Training Engineer At Inflection AI, our public benefit... ...on the fun parts. Balance research curiosity with product pragmatism... ..., hyper-parameter search, evaluation, and rollout—using PyTorch, Torchtune... ...easy to trace. Define the metrics that matter; run A/B tests...Full time$190k - $250k
...large-scale generative world models that learn to predict... ...trucks. We are looking for a research scientist to lead the design and development... ...and radar outputs Design evaluation frameworks that measure... ...quality beyond pixel-level metrics, including scenario fidelity...Temporary workWork at officeVisa sponsorshipFlexible hours$175k - $350k
...by Inflection AI's foundation model, proving that AI can be... ...on the fun parts. Balance research curiosity with product pragmatism... ...curation, hyper-parameter search, evaluation, and rollout-using PyTorch,... ...easy to trace. Define the metrics that matter; run A/B tests...- Member of Technical Staff — Diffusion Model About the Role RadixArk is seeking a... .... This role combines deep research thinking with strong engineering execution... ...into practical production systems Evaluate models using rigorous metrics and benchmarks Contribute to long-term...Flexible hours
- Apple Inc. is seeking a Senior Machine Learning Engineer in Cupertino, California, to evaluate and refine Apple's AI systems. You will design and develop key infrastructures for model and agent evaluations, contribute to quality improvements, and work closely with product...
$128.7k - $261.3k
...enables repeatable, high-velocity model deployments through principled and... ...op/layer/block,using AV-relevant metrics(perception, trajectory,etc.) to evaluate compressed models,andcollaborating... ...platforms, or similar) ~ Published research, open-source contributions,...Local areaRemote workWork from homeRelocation packageFlexible hours$224k - $356.5k
...computing. As a Senior / Principal Deep Learning Engineer — Model Evaluation & AI Systems, you will play a meaningful role in crafting the... ...unclear technical challenges and communicate effectively across research, engineering, and product teams. Ways to stand out from the...$272k - $431.25k
NVIDIA AI is seeking a Senior Research Manager based in Santa Clara, California, to lead world-model evaluation in Physical AI. The role involves spearheading a team of research scientists to define scientific roadmaps and benchmarks, focusing on precise diagnostics and...$174k - $252k
Senior Research Scientist, Google Research Mountain View, CA, USA; New York, NY, USA; +2 more Apply X Applicants in San Francisco: Qualified... ...by defining the data structure, framework, design, and evaluation metrics for research solution development and implementation....Full time$117.2k - $313.7k
...the Role Salesforce AI Research is seeking outstanding AI Research Scientists / Research Engineers to... ...Vision - Vision‑language models, video understanding,... ...grounding for GUI agents Speech Intelligence - Voice... ...scalable APIs and agentic evaluators. Collaborate across a...Full time- ...Job Title: CW Research on Large Vehicle Data Model - Summer Intern (99W210) About Kyyba: Founded in 1998 and headquartered in Farmington... ...multimodal reasoning capabilities Train and evaluate models on multimodal data across vehicle sensors, edge,...Summer internshipVisa sponsorshipWork visa
- Welo Global is seeking a Data Quality Associate in Sunnyvale, California. In this full-time role, you will evaluate AI model outputs, performing audit-based reviews to enhance data quality, and contribute to improving evaluation frameworks. The ideal candidate has a university...Full timeWork at office
$254k - $349.25k
...requires deep expertise in model architecture, training, fine-... ...making Experimentation & Evaluation Establish rigorous evaluation... ...Contributions to AI/ML research, open-source, or security tooling... ...interpretability Success Metrics Development of high-precision...Flexible hours$160k - $240k
Glean is seeking a Product Manager for Glean Model Hub in Mountain View, California. In this hybrid role, you will evaluate LLM models, define the product roadmap, and manage key customer relationships. The ideal candidate has over 4 years of product management experience...- Member of Technical Staff - Foundation Model Architecture & AI Infrastructure Vinci | Full... ...and operator regimes This is not a research prototype. This is production infrastructure... ...throughput, and reliability — not leaderboard metrics. What We’re Looking For Deep experience...Full timeRemote work
$254k - $349.25k
...role requires deep expertise in model architecture, training, fine‑... ...making Experimentation & Evaluation Establish rigorous evaluation... ...Contributions to AI/ML research, open‑source, or security tooling... ...model interpretability Success Metrics Development of high‑...Flexible hours- ...exciting journey. The mission of the Waymo Research team is to develop machine learning solutions... ..., learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation. Waymo interns work alongside leaders in...InternshipSummer internshipLocal area
- ...Machine Learning Scientist Recommender systems (e.... ...optimize recommendation models that power... ...notifications. Conduct applied research to improve recommender... ...for training, evaluation, and inference, ensuring... ...results, offline evaluation metrics, and business impact....Work at officeRemote work2 days per week
$160.36k - $240.54k
...Machine Learning Research Scientist: Generative Modeling for Planning Mountain View, California (HQ) Nuro believes self-driving vehicles are the... ..., prioritize work and develop solutions to solve them, evaluate your solution by deploying the models on to the NuroDriver...Immediate startFlexible hours- ...About The Role Model Alignment And Deployment... ..., And User Experience Research (UXR) Teams. Together,... ...Safety Experts, Data Scientists, Infrastructure Engineers... ...That The Data Pipelines, Evaluation Frameworks, Alignment... ..., Risks, And Success Metrics. Cross-Functional...
$142.8k - $274.8k
...As a Principal Applied Scientist , you'll lead the... ...combining LLMs, multimodal models, and largescale recommender... ...business goals. Own evaluation and experimentation. Define offline metrics (e.g., NDCG, ERR,... ...predictive analytics, research) OR Master's Degree...Ongoing contractWork at officeLocal area$252k - $400k
...about a decade ago, but we believe the next era of models will look fundamentally different. We’re assembling a research team dedicated to shaping that future. The... ...immediate feedback through A/B testing and online evaluation. Direct impact : see your models shape user...Immediate startWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist, Speech Model Evaluation & Metrics. Be the first to apply!
- deep learning scientist Palo Alto, CA
- support scientist Palo Alto, CA
- quality control scientist Palo Alto, CA
- regulatory scientist Palo Alto, CA
- scientist biology Palo Alto, CA
- lab scientist Palo Alto, CA
- scientist immunology Palo Alto, CA
- health scientist Palo Alto, CA
- scientist assay development Palo Alto, CA
- validation scientist Palo Alto, CA

