Audio Evaluation Expert - Linguistics [Remote]
$50 per hourMercor
San Francisco, CA
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: English (US) Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities
- Transcribe and optimize audio and video content in English (US) , ensuring clarity and accuracy.
- Develop and document evaluation standards, including rubrics and grading guidelines in English .
- Conduct model testing and grading, providing structured feedback to improve AI model performance .
- Support benchmarking and quality assurance to maintain consistency and reliability.
- Collaborate with project leads to resolve ambiguities and improve task design.
Qualifications
Must-Have
- Strong writing, editing, and critical thinking skills.
- Ability to work independently and manage time effectively.
- Native or near-native fluency in English (US) .
- Familiarity with American English spoken language and regional vocabulary.
- Ability to transcribe and analyze English audio content.
- Available to commit 10–20 hours per week .
Preferred
- College students or recent graduates.
- Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.
- Experience with transcription, annotation, localization, evaluation, or research workflows in English .
- Familiarity with regional dialects and variations of American English.
- Interest in AI , language models, or applied research environments.
Application Process (Takes 20–30 mins to complete)
- Complete a short AI-led interview (approximately 15 minutes).
- If selected, you will be onboarded and invited to begin project work.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Audio Evaluation Expert - Linguistics [Remote] in San Francisco, CA vacancy
- ...Gravity Engineering Services Pvt Ltd. is looking for a Retail Banking Expert to evaluate AI-generated outputs and ensure compliance in consumer lending. This position requires strong analytical skills and 3+ years of experience in retail banking. The role involves creating...SuggestedHourly payRemote work
Gravity Engineering Services Pvt Ltd.
San Francisco, CA3 hours ago $80 - $150 per hour
...leading behavioral health consulting firm is seeking Senior Behavioral Health Experts to work part-time and remotely on frontier AI research projects. You will be responsible for designing evaluations and testing AI systems in critical mental health contexts. The ideal...SuggestedHourly payPart timeRemote work- Obsidian is seeking a Bilingual French STEM Expert with a strong background in biology, physics, and chemistry... ...creating detailed prompts and establishing evaluation rubrics, ensuring scientific rigor and linguistic clarity. This position requires a minimum commitment...Suggested
$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can...SuggestedRemote jobHourly payFlexible hours- Mercor is searching for a Telecommunications Expert to evaluate AI-generated outputs related to network architecture and telecom operations. The ideal candidate should have over 3 years of experience in telecommunications and strong analytical skills. This remote position...SuggestedRemote job
- Mercor is looking for a Spreadsheet QA / workbook maintenance Evaluator to connect elite talent with leading AI research labs. This remote position requires over 5 years of experience in relevant fields and fluency in English. Evaluate AI-generated artifacts and provide...Remote jobWork at office
$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workFlexible hoursMercor
San Francisco, CA7 days ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
San Francisco, CA7 days ago- ...us in building the future! About the Role We are seeking an experienced Machine Learning Engineer (MLE) to focus on audio model evaluation, specifically for speech generation and recognition models. This role involves designing and developing comprehensive model...Audio
Cantina
San Francisco, CA2 days ago $80 - $120 per hour
...talent with leading AI research labs. Headquartered in San Francisco. Position Details Position: Clinical / biomedical / pharma Evaluator. Type: Contract. Compensation: $80-$120/hour. Location: Remote. Role Responsibilities Evaluate AI‑generated artifacts against domain...Contract workWork at officeRemote work- Mercor is seeking a Training / onboarding / L&D Evaluator to enhance AI evaluation processes. Based in San Francisco, you'll evaluate AI... ...generated artifacts, provide structured feedback, and work with experts to ensure quality. The role requires 5+ years of relevant...Remote jobWork at officeFlexible hours
- Mercor is seeking an English (US) Audio Generalist Evaluator Expert to optimize audio and video content. This remote role offers 10-20 hours per week... ...to part-time hours is essential, and familiarity with linguistics or related fields is preferred. #J-18808-Ljbffr MercorAudioRemote jobPart time10 hours per week
- Mercor is looking for a Humanities / arts / culture Evaluator who will evaluate AI-generated artifacts against specific quality rubrics. You will identify errors and provide feedback to enhance AI model outputs. The ideal candidate has over 5 years of experience in the...Remote jobWork at officeFlexible hours
- Mercor is looking for an English (US) Audio Generalist Evaluator Expert to connect creative and technical talent with AI research labs. You will transcribe audio content, conduct model testing, and ensure clarity and accuracy in your work. This contract role offers flexible...AudioRemote jobContract work10 hours per weekFlexible hours
- Perle AI is looking for a transcriber fluent in Emirati Arabic to transcribe audio recordings accurately and engage in quality assurance. Candidates should have at least two years of transcription experience and be comfortable with web-based tools. The job offers flexible...AudioFlexible hours
$180k - $270k
...experience building reliable distributed systems, data pipelines, or evaluation harnesses that can run at scale against live model checkpoints.... ...with both traditional (WER, CER, PESQ, etc) and modern audio evaluation frameworks (automated MOS scoring). LLM‑as‑a‑Judge:...AudioFull timeWork at officeWorldwidePlaud
San Francisco, CA4 days ago- ...experienced cybersecurity professionals to improve AI systems' reasoning for threat detection and security operations. Candidates will evaluate AI outputs, create cybersecurity scenarios, and provide feedback on AI accuracy. This project-based role offers competitive task...Remote jobHourly pay
- ...experienced cybersecurity professionals to improve AI systems for threat detection and vulnerability assessment. Candidates will evaluate AI performance on cybersecurity tasks and collaborate with research teams. The ideal candidate will have 3+ years in cybersecurity...Remote job
$20 per hour
...Role Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity,...Remote jobContract workPart timeSummer workMercor
San Francisco, CA18 days ago$103.24k - $133.2k
...to protect national security and investigate violent crimes. Applicants should possess strong analytical skills and experience in linguistics, along with a bachelor's degree from an accredited institution. This role requires the ability to operate under pressure while...Work at office- ...Subject Matter Expert Role Description Engagement Type: Part-time (Hourly) - Work as many or as few hours as you'd like, with the... ...Expert is a specialized role focused exclusively on quality evaluation and standards definition within assigned projects. This role is...Hourly payWork at office
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA5 days ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA5 days ago$100 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Excel Expert — Office / Retail Management Type: Contract... ...experience, and write accurate, well-structured solutions. Evaluate Excel tasks and solutions and provide clear, written feedback...Remote jobContract workSummer workWork at officeWeekday workMercor
San Francisco, CA13 days ago$130 per hour
...Obsidian is looking for Internal Medicine experts to assist in training AI models on healthcare reasoning data. Responsibilities include designing clinical scenarios, evaluating AI outputs, and providing feedback to improve model performance. Candidates must be board certified...Hourly payRemote workObsidian
San Francisco, CA4 days ago$130 - $180 per hour
...Call For Referral is seeking an Internal Medicine Expert to enhance AI systems' clinical reasoning utilizing high-quality internal medicine data. Your role involves designing patient scenarios, evaluating AI outputs, and ensuring compliance with evidence-based internal...Hourly payPart timeRemote workCall For Referral
San Francisco, CA5 hours ago$100 per hour
...Develop clear, step‑by‑step solutions with rigorous logic. Evaluate AI outputs for accuracy and quality of reasoning. Collaborate... ...depends on role and candidate expertise) Assessment: Shortlisted experts complete an evaluation before selection. Assignments:...Contract workRemote workFlexible hoursTuring
San Francisco, CA3 hours ago$25 per hour
...Job Description Job Description AI Training Experts About Prolific Prolific is not just another player in the AI space – we are... ...role We're looking for AI Training Experts to help train and evaluate cutting-edge AI models. If you have the necessary experience, we...Self employmentWork from homeFlexible hoursProlific Academic Ltd
San Francisco, CA3 days ago$1,150 - $1,450 per month
...Summers , and Jack Dorsey . Position: Telecommunications Expert Type: Contract Compensation: $1,150–$1,450 per... ...Location: Remote Role Responsibilities Review and evaluate AI-generated outputs related to network architecture design...Hourly payContract workSummer workRemote workMercor
San Francisco, CA13 days ago$130 per hour
...Larry Summers , and Jack Dorsey . Position: Private Equity Expert Type: Contract Compensation: $130/hour Location:... ...Commitment: 10+ hours/week Role Responsibilities Evaluate financial models and provide insights to strengthen AI model...Remote jobHourly payWeekly payContract workFor contractorsSummer workMercor
San Francisco, CA6 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Audio Evaluation Expert - Linguistics [Remote]. Be the first to apply!
Related searches
- sql expert San Francisco, CA
- subject matter expert San Francisco, CA
- guest service support expert San Francisco, CA
- fulfillment expert San Francisco, CA
- technology expert San Francisco, CA
- audio editing San Francisco, CA
- audio visual San Francisco, CA
- audio producer San Francisco, CA
- audio speech recognition San Francisco, CA
- music audio San Francisco, CA