Data-Driven Research Scientist: LLM Training & Evaluation
AfterQuery
AfterQuery is seeking a researcher to design and run training experiments that isolate how datasets affect model behavior. You will conduct SFT and RL post-training experiments and partner with labs to turn datasets into defensible evidence. This role is experimental and high-leverage. You will publish research publicly and collaborate across domains, including finance and software engineering, to drive data-driven improvements. #J-18808-Ljbffr AfterQuery
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data-Driven Research Scientist: LLM Training & Evaluation in San Francisco, CA vacancy
- ...comes from a culture of academic research driven to democratize AI... ...for their next generation of LLM products. Join us if you: Wish... .... Responsibilities Own LLM evaluation processes and methods with a... ...Generate high quality synthetic data, curate labels, and conduct rigorous...SuggestedLocal areaShift work
$150k - $250k
Distyl is seeking an AI Evaluation Engineer to design evaluation systems for AI-driven solutions. Located in San Francisco, this position requires strong Python skills and a commitment to utilizing AI tools to enhance evaluation processes. The role offers a competitive...SuggestedWork at office3 days per week$147k - $211k
Research Data Scientist, Cybersecurity, Google Cloud Location: San... ...Experience building LLM-powered applications... ...environment. Ability to evaluate, analyze, and improve... ...models and LLM-driven systems. Applicants... ...relevant education or training. Your recruiter can share...TrainingFull timeWork experience placement- ...Reflection in San Francisco is looking for a data engineer dedicated to enhancing data quality for LLM pre-training. Your role will involve collaborating with world-class researchers to establish high standards for data collection and processing. You will design automated...Training
Reflection
San Francisco, CA4 days ago - As a Data Engineer at Regard, you will help build... ...product decisions and research. We run an engineering... ...prioritizes transparent, code-driven systems over black-box... ...experience with LLM‑assisted development,... ...for machine learning training, evaluation, or production workflows...TrainingWork at officeLocal areaHome officeVisa sponsorshipRelocation package
$148.5k - $260.1k
...Graph platform to power AI-driven experiences, agentic... ...search, enterprise data discovery, and intelligent... ...infrastructure standards.) Evaluate & Innovate (LMTS):... ...handling from expensive LLM calls. Developer... ..., promotion, benefits, training, assessment of job performance...TrainingContract work- ...B Capital is seeking a data engineer to ensure high data quality for training AI models. You will own the upstream data quality for LLM post-training and design automated QA methods in a collaborative environment. Ideal candidates will have strong engineering skills,...Training
B Capital
San Francisco, CA4 days ago $213k - $263k
...million rider‑only trips, driven more than 100 million miles... ...Generative AI to create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge: How do you mathematically... .... Collaborate with research teams across Waymo and Alphabet...Training$204k - $259k
...Driver. We conduct our own research to address real-world... ...of miles of driving data from a diverse set of sensors... ...models and model training at scale, to (3) analyze... ...Develop and rigorously evaluate metrics and methodologies... ...model development (LLM, VLM, or similar foundation...Training- Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation...
$210k - $385k
A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills...- B Capital is seeking a data engineer focused on ensuring high-quality data for AI model training. You will work closely with top researchers to develop metrics and standards for data quality... ...innovation within a supportive, mission-driven team. #J-18808-Ljbffr B CapitalTraining
- ...environments. We build evaluation frameworks that ensure... ...safety metrics, including LLM-judge-based evaluations... ...model architectures, training procedures, and evaluation... ...in algorithms , data structures , and object... ...systems . Ability to convert research insights into...Training
- ...answer quality across Perplexity's products. You will architect evaluation pipelines, design methods to measure tool impact on answers,... ...MS in a technical field and at least 4 years of experience in data science or machine learning, alongside strong skills in Python,...
- ChatGPT Jobs is seeking a Senior Software Engineer to contribute to the development and evaluation of AI training data. This unique role blends software engineering with artificial intelligence, focused on helping companies build better AI models. You will be responsible...Training
$155k - $165k
Wing is looking for an Engineering Manager for System Evaluation to lead a team dedicated to bridging operational data with engineering insights. The ideal candidate will have over 8 years in data analytics and 3+ years managing analytical teams, with strong programming...$150k - $225k
...Software Engineer (Top AI/LLM Startup) AI Software... ...a billion dollar evaluation and over $100M in revenue... ...with AI researchers, data experts and software... ...some of the top data scientists and ML researchers in... ...Engineer, Python - AI Training (Freelance, Remote) Machine...TrainingFull timeFreelanceRemote work2 days per week$161k - $215k
# Data Scientist, AI Enabled Analytics - ProcurementGilead SciencesBe an... ...visualizations and data‐driven narratives to communicate insights... ...and optimize planning* Evaluate supplier performance and risk... ...through tools, standards, and training.### Basic...TrainingContract workLocal area- ...in San Francisco to develop sampling techniques and optimize evaluation pipelines for autonomous driving. The ideal candidate possesses... .... The role involves collaboration across teams to enhance data-driven decisions and improve code quality, with competitive pay and...
$140k - $230k
# Data Scientist / ML EngineerVCAZ Digital Marketing AgencyBe... ...that power Ryno’s AI-driven platforms across... ...Design, develop, and train machine learning models... ...testing and performance evaluations to optimize model accuracy... ...advancements in AI/ML research and apply them to Ryno...TrainingFull timeRemote work$160k - $280k
...datasets at scale, used to train ML models that power AI... ...foundational tools and data pipelines to ingest,... .... Model Training and Evaluation Support: providing support... ...models Transform research prototypes into high-quality... ..., retrieve , rank) for LLM, RecSys, etc....TrainingWork experience placementImmediate startFlexible hours$172k - $229k
...multimodal sensor data. Our next-... ...working on post-training analysis, error... ...regressions. Research and Integrate Agentic... ...with ML scientists, data engineers... ...model training, evaluation, and deployment... ...thought models, or LLM-based planning.... ...reality. We're driven by something...TrainingWork at officeRemote work- ...consume it. You'll find the right data sources, transform them, and... ...that into a probabilistic, ML-driven pipeline — taking that data,... ...-ready datasets. Identify and evaluate the data sources we need, and... ...designing data flows that feed ML training and serving (data sourcing,...TrainingContract workStart working today
$176k - $220k
...Coach, a development plan, a trained and coached manager, the most... ...Engineer with experience building data modeling systems within a... ...visualizations, etc.) that enable data‑driven decision making. Build and... ...—AI‑assisted SQL generation, LLM‑powered data documentation,...TrainingWork experience placementSummer holidayWork at officeLocal areaFlexible hours2 days per weekBetterUp
San Francisco, CA2 days ago$80 per hour
Prolific is seeking an AI & Machine Learning Engineer in San Francisco to evaluate and refine AI models. The role involves auditing ML code, providing human feedback on AI frameworks, and analyzing model reasoning. Candidates should have a relevant degree and experience...TrainingRemote jobHourly payWork from homeFlexible hours$193.4k - $220.7k
...functional team of engineers, research scientists, technical program managers,... ...including foundation model training, large language model... ...similarity search, guardrails, model evaluation, experimentation, governance... ...introduce state-of-the-art LLM optimization techniques to...TrainingLocal area- ...scratch. We then use that data to advance our own ML research, while also... ...discovery workflows, where scientists use them to solve the highest... ...infrastructure. Build LLM powered systems for literature... ...that drive model training, evaluation, customer delivery, and...Training
$204k - $259k
...Machine Learning Engineer to optimize and develop large-scale model training pipelines for foundation models. The ideal candidate has over 5... ...of experience in Machine Learning, with strong expertise in LLM/VLM pre-training. This position offers a competitive salary range...Training$148.5k - $260.1k
## Data Engineer (SMTS / LMTS) - MDMApplyremote type: Office Tech... ...API orchestration layers, event-driven architectures, Change Data... ...help our recruiters assess and evaluate candidates’ resumes and qualifications... ..., promotion, benefits, training, assessment of job performance...TrainingWork at office- ...intelligent, compatibility-driven dating platform that blends psychology, data, and human-like... ...loops, and natural voice/LLM-based interactions that... ...with ownership across research, prototyping, and production... ...generation, model training, evaluation, and inference. Prototype...TrainingFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data-Driven Research Scientist: LLM Training & Evaluation. Be the first to apply!
Related searches
- energy data scientist San Francisco, CA
- python data scientist San Francisco, CA
- principal data scientist San Francisco, CA
- data scientist (hedge fund) San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- entry level data scientist remote San Francisco, CA
- healthcare data scientist San Francisco, CA
- work from home data scientist San Francisco, CA
- senior data scientist San Francisco, CA
- junior data scientist remote San Francisco, CA