Linguist III

Linguist III Onsite or Remote Summary We are looking for a senior linguist to help develop language components for AI-powered products, including large language models (LLMs) and voice-enabled technologies. We are seeking candidates with strong linguistic data analysis, programming proficiency, and language technology experience to lead data collection, synthetic data generation, and annotation tasks in support of LLM/AI training, evaluation, alignment, and AI agent development. Responsibilities Provide linguistic expertise in syntax, semantics, pragmatics, and sociolinguistics as applied to LLM and generative AI systems Collaborate with linguists, data operations teams, and ML engineers on data collection, curation, annotation, and localization efforts for model training and fine-tuning Design and maintain annotation schemas and guidelines for LLM training data (e.g., instruction-tuning, preference labeling, RLHF) Evaluate, curate, and quality-check datasets used for pre-training, fine-tuning, and alignment of language models Develop programmatic methods for generating synthetic annotated data at scale Support model evaluation efforts including prompt-based testing, red-teaming, and linguistic error analysis Contribute to AI safety and responsible AI practices through linguistic review of model outputs (e.g., hallucination detection, bias identification, tone and pragmatic appropriateness) Design and conduct experiments to assess data quality, annotation consistency, and downstream model performance Requirements Master's degree in Linguistics, Computational Linguistics, Computer Science, Speech Science, or related field 2+ years of experience in Linguistics, Language Technologies, NLP, or AI/ML data operations (or equivalent) Native or near-native fluency in English and at least one additional language Knowledge of syntax, semantics, pragmatics, sociolinguistics, corpus linguistics, and other areas of linguistics Experience with Large Language Models (LLMs), their applications and data practices (training data, evaluation, prompting, fine-tuning) Experience with LLM evaluation methodologies (human evaluation, automated metrics, adversarial testing) Experience building or maintaining semantic ontologies, taxonomies, or intent/slot frameworks Proficiency using AI Agents/Chatbots Experience with complex database queries and data analysis processes (SQL, spreadsheets, R, Unix, or others) Experience working with speech and text data in multiple languages Comfortable working in a fast-paced, highly collaborative environment with evolving priorities Preferred Qualifications PhD in Linguistics, Computational Linguistics, Language Technologies, or a related field Experience with machine learning frameworks, NLP libraries, and tools (e.g., Hugging Face, spaCy, NLTK, PyTorch) Experience with statistical language modeling or training data pipelines Strong organizational skills and attention to detail Compensation Pay range is $50 - $55 per hour with full benefits available, including paid time off, medical/dental/vision/life insurance, 401K, parental leave, and more. Our compensation reflects the cost of labor across several US geographic markets. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience. #J-18808-Ljbffr