Applied Scientist / Research Engineer — Speech AI

Applied Scientist / Research Engineer — Speech AI  

HIGHLIGHTS

Location:  San Francisco, CA OR REMOTE

Position Type:  Direct Hire

Salary:  Based on Experience

Residency Status:  US Citizen/Green Card Holder/OPT Visa ONLY

We are looking for a senior technical contributor to help develop the next generation of real-time speech and conversational AI systems. This person will work across applied research, model development, training infrastructure, evaluation, and production deployment.

The role is ideal for someone who has deep experience with modern machine learning for audio, speech, and language, and who enjoys moving beyond prototypes into systems that must perform reliably in live environments. You will work closely with engineering and product teams to improve model quality, speed, reliability, and scalability for speech-driven user experiences.

This is a hands-on position. You should be comfortable experimenting with new model architectures, training and evaluating large models, improving inference performance, and translating research results into production-ready capabilities.

Responsibilities

Develop High-Quality Speech Generation Systems

• Build and improve machine learning models for natural, expressive speech generation.
• Work on controllability, speaker consistency, pacing, tone, and conversational timing.
• Explore model architectures that improve output quality while keeping latency low.
• Improve performance for real-time use cases where responsiveness and reliability matter.
• Partner with infrastructure and product teams to move successful approaches into production.

 

Improve Speech Understanding and Recognition

• Train, adapt, and evaluate models that convert speech into accurate, usable text.
• Improve recognition quality across varied speakers, accents, noisy conditions, phone-quality audio, interruptions, and mixed-language conversations.
• Use large-scale audio data, weak labels, self-supervised methods, and targeted fine-tuning strategies.
• Improve downstream usefulness of transcripts for conversation analysis, structured output, and intent understanding.

 

Advance Audio Representation and Compression Methods

• Research and implement model components that represent speech efficiently and preserve perceptual quality.
• Explore learned audio representations that support generation, recognition, and efficient deployment.
• Evaluate different approaches for balancing quality, speed, compute cost, and scalability.
• Build systems that can support both experimentation and production use.

 

Build Training and Evaluation Workflows

• Create reliable pipelines for collecting, cleaning, processing, and evaluating speech data.
• Design evaluation methods that combine automated metrics, model diagnostics, and human quality review.
• Support large-scale training jobs across modern accelerator infrastructure.
• Improve throughput, reproducibility, monitoring, and cost efficiency of model development workflows.

 

Run Rigorous Experiments

• Design controlled experiments to test model, data, and training improvements.
• Compare approaches using clear benchmarks and production-relevant quality measures.
• Move quickly from hypothesis to implementation, measurement, and iteration.
• Communicate results clearly to research, engineering, and product stakeholders.

 

What We’re Looking For

 

Machine Learning Depth

• Strong background in modern machine learning, especially speech, audio, language, generative modeling, multimodal systems, or large-scale model training.
• Ability to implement new model ideas efficiently and evaluate them with technical rigor.
• Strong understanding of current techniques used in speech and language systems.

 

Speech and Audio Experience

• Practical experience building or improving systems for speech generation, speech recognition, audio modeling, or related areas.
• Experience working with large and varied audio datasets.
• Strong judgment around speech quality, naturalness, latency, robustness, and user-facing model behavior.
• Familiarity with real-world audio issues such as background noise, channel quality, interruptions, speaker variation, and conversational dynamics.

 

Production Awareness

• Experience training, deploying, or serving large models on modern compute infrastructure.
• Understanding of practical inference constraints, including latency, memory use, throughput, quantization, and serving efficiency.
• Comfort working with systems that need to operate reliably in live, low-latency environments.

 

Experimental Discipline

• Experience designing benchmarks, ablation studies, data experiments, and quality evaluations.
• Ability to use both offline metrics and live product signals to guide model decisions.
• Strong technical judgment when deciding which ideas are worth scaling and which should be abandoned.

 

Ownership and Execution

• Comfortable working in a fast-moving technical environment with ambiguous problems.
• Able to own projects from early exploration through deployment.
• Strong collaboration skills across research, engineering, infrastructure, and product.
• High standards for model quality, reliability, and operational performance.

 

Ideal Background

The strongest candidate will have experience building speech or audio AI systems that are both technically advanced and practical to deploy. You should be motivated by improving natural conversation, real-time responsiveness, model robustness, and scalable production performance.

 

You may come from a research lab, AI startup, speech technology company, communications platform, infrastructure team, or another environment where speech models were trained, evaluated, deployed, and improved at scale.

 

Nice to Have

• Experience with distributed training for large models.
• Publications, patents, or open-source work in speech, audio, language, or machine learning.
• Experience with real-time communication, streaming audio, contact-center technology, or other latency-sensitive speech products.
• PhD in Machine Learning, Computer Science, Electrical Engineering, Artificial Intelligence, or a related field; equivalent research or industry impact is also acceptable.

Benefits

• Competitive health, dental, and vision coverage.
• Equity participation.
• Access to modern compute, tooling, and research resources.
• Opportunity to work on advanced speech AI systems used in production environments.

 

"We are GTN – The Go To Network "