Remote Senior Data Labeling Lead — AI QA & LLM Evaluation
Rex.zone
Atlanta, GA
- Remote job
Rex.zone in Atlanta is seeking a Mid-Senior Data Labeling Specialist to lead high-accuracy labeling and AI/ML evaluation work supporting production LLM training pipelines. You will drive data quality through guideline compliance and RLHF-style ranking across NLP, computer vision, and content safety domains. This role emphasizes meticulous QA, edge-case documentation, and collaboration with AI labs and startups to deliver reliable labeled data and evaluation signals that improve model performance. #J-18808-Ljbffr Rex.zone
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote Senior Data Labeling Lead — AI QA & LLM Evaluation in Atlanta, GA vacancy
- Rex.zone is seeking senior data labeling professionals to... ...labeled datasets and evaluation signals that enhance AI/ML system performance. This remote role focuses on NLP, LLM evaluation, and... ...datasets. You will lead labeling tasks,... ...perform rigorous QA with gold sets and...Remote jobSenior
- ...zone is seeking a Senior Data Annotation Specialist to lead high-quality labeling and evaluation workflows that enhance... ...data quality and LLM evaluation. This full-time remote role is aligned... ...prompt evaluation and QA. Strong guideline... ...with AI/ML teams are essential...Remote jobSeniorFull time
$30 - $50 per hour
Rex.zone is hiring mid-senior data annotators to support US-based AI/ML projects across NLP, LLM evaluation, RLHF, content safety, and computer... ...and review high-quality labeled data, ensuring strict annotation... ...improvement. Fully remote role aligned with Miami job-...Remote jobSeniorHourly pay- Rex.zone is seeking a Senior Data Labeling Specialist to lead high-impact data labeling and evaluation workflows for AI training data quality. This fully remote role in the United... ...focuses on supporting LLM training pipelines,... ...guidelines, conduct QA evaluations, and...Remote jobSenior
- ....zone is hiring for a Senior Data Annotation role in a remote-first setup targeting... ...Miami market. You will lead annotation guidelines, evaluate labeling quality, and perform RLHF tasks to improve AI/ML training data. Expect... ...across NLP/NER, LLM evaluation, CV labeling...Remote jobSenior
- Rex.zone is seeking a Senior Data Annotator to work remotely with our US-based Phoenix team. You will lead data labeling across NLP, LLM evaluation, and computer vision tasks, guiding RLHF workflows and QA checks to ensure high-quality training data. Sources emphasize strong...Remote jobSeniorFull time
- Rex.zone is seeking a data annotation professional to lead end-to-end annotation workflows for LLM and multimodal training. You will ensure data quality, drive labeling consistency across projects, and collaborate... ..., execute RLHF and LLM evaluation tasks, improve guidelines,...Remote job
- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality... .... This is a US-based remote, full-time role aligned... ...with reviewers and leads. A mid-senior background...Remote jobSeniorFull time
- Rex.zone is seeking a Senior Data Annotation professional for an Austin-aligned, fully remote role within the US. You will lead end-to-end data annotation and evaluation workflows that support AI/ML training pipelines, including RLHF, prompt-response evaluation, and rubric...Remote jobSenior
- ...partner is looking for a Senior Data Quality / QA & UAT Lead based in the United States... ...major validation periods. Remote work opportunity within... ...Jobgether works: We use an AI-powered matching process... ...your personal data to evaluate your candidacy and share relevant...Remote workSeniorPermanent employmentContract workTemporary workPart timeLocal area10 hours per week
jobgether
United States3 days ago - Driverai is seeking an Applied Data Scientist with expertise in LLM evaluation to join its innovative team in Austin, TX. This role focuses on building the evaluation function from scratch and requires a strong background in statistics and machine learning. The successful...Remote jobSenior
- ...in Atlanta is seeking a Senior Data Annotation professional for a full-time remote role focused on improving AI/ML training pipelines through high-quality data labeling, RLHF-related evaluation, and rigorous data quality... ...and support production LLM training workflows. With...Remote jobSeniorFull time
- Rex.zone is seeking Senior Data Annotation professionals to support AI/ML training workflows with high-quality labeled data, RLHF judgments, and QA signals for LLM evaluation and computer vision annotation. This is a remote, full-time role aligned to Boston hiring demand...Remote workSeniorFull time
- Rex.zone is seeking a Senior AI data annotation professional to support LLM training pipelines from Austin, TX. This fully remote, full-time role focuses on RLHF workflows, prompt evaluation, QA checks, and content safety labeling across NLP and computer vision datasets...Remote jobSeniorFull time
$279.1k
...ServiceNow is the AI control tower... ...together any AI, any data, and any... ...on building the evaluation infrastructure and... ...depend on.As a Senior Director, AI Evaluation... ..., you will lead the teams responsible... ...stack spanning LLM-as-judge, rule-... ...(flexible, remote, or required in...Remote workSeniorWork at officeImmediate startFlexible hours$115k - $125k
...Role: Senior Data Test Lead Location: Remote Exp: 10+ years $115k to $125k Full Time Must... ...Snowflake, Snowflakes Cortex/Coco AI (preferred), Informatica(preferred)... ...testing using SQL, Python, or data QA tools Solid testing in Snowflake...Remote workSeniorFull timeWork experience placementAcestack
Remote1 day ago- ...Role Overview Design and evaluate high-quality datasets and evaluations that advance large... ...corrections across multiple languages, assess AI-generated implementations for production... ...on performance and fit. Location: Remote, candidates must be based in the United States...Remote workSeniorFor contractors10 hours per weekFlexible hours
SaidGig
Canadamore than 2 months ago - ...of high-quality datasets and evaluation pipelines that improve and benchmark... ...code, evaluate and refine AI-generated solutions across... ...this by providing high-quality data, advanced training pipelines,... ...documentation. Work Terms Location: Remote. Engagement type:...Remote workSeniorFull timeFor contractors10 hours per weekFlexible hours
SaidGig
United Statesmore than 2 months ago $213k - $263k
...The mission of the Waymo AI Foundations team is to... ...hierarchical learning, and robust evaluation. This role follows a... ...time models. Explore LLM/VLM distillation recipes... ...Customize distillation data and recipe for business-... ...role can be performed remote, the specific salary...Remote workSeniorFull timeWaymo
Remote17 hours ago- ...California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global... ...research with high-quality data, advanced training pipelines, plus... ...What Does a Typical Day Look Like? Evaluate and refine AI-generated code across...Remote jobSeniorFor contractorsFlexible hours
- Cohere is seeking a Senior Research Scientist, Model Evaluation, to create ambitious evaluation... ...infrastructure for enterprise AI. You will work with cross-... ...to push the frontiers of LLM evaluation. The role... ...research and engineering, with remote-friendly policies and...Remote workSenior
$80 - $100 per hour
...coding benchmarks and evaluation pipelines used to test frontier AI models on real... ...maintain scalable data pipelines for evaluation... ...and implementing LLM coding benchmarks and... ...Nice to have Senior or Lead-level profile with... ...Location: Fully remote — work from anywhere...Remote jobSeniorFull timeContract workFor contractorsG2i
Miami, FL17 hours ago- ...building next-generation AI systems in a U.S.-based hybrid/remote environment as a full-time Senior AI Engineer II. You’... ...production-level ML/LLM systems Programming... ...distributed systems, and data pipelines Cloud... ...vector databases, and AI evaluation tooling Kafka or...Remote workSeniorFull timeFlexible hours
- Rex.zone is hiring a Senior Data Annotator to produce... ...quality training data for AI systems across NLP,... ..., and multimodal evaluation. This is a Remote, full-time role focused... ...compliance, content safety labeling, and evaluation... ...and contributing to QA workflows. #J-18808-...Remote jobSeniorFull time
- Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems.... ...deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model performance...Remote jobSeniorFull time
$183.34k - $206k
...accountability from Day 1. #LI-Remote Little more... ...the team: The LLM Observability (LLM... ...layer that makes AI workloads... ...), and ensure that data from diverse ecosystems... ...beyond. You'll plan, lead, and deliver... ...own frameworks for evaluating how to approach new...Remote workSeniorFull timeWork at officeLocal areaWork from homeHome officeVisa sponsorshipFlexible hoursShift workHoneycomb.io
United States17 hours ago- Data Lead — AAM Weather Technology Evaluation Location: Remote (U.S.) with periodic travel to Fort Worth, TX, and designated test... ..., regulatory strategy, and AI/ML integration for safety-critical... ...technical domain end to end on a small, senior team. Preferred Qualifications...Remote work
- ...Senior/Staff QA Engineer We are seeking a highly skilled and... ...a fast-moving agentic AI product. The successful... ...with the Delivery Lead/Solutions Architect and... ...understanding, with the ability to evaluate usability and flag... ...scripts. AI/LLM Tools: Familiarity with...Remote workSenior
Ontrac Solutions Inc
United States3 days ago - ...CoastPosition OverviewAs a Senior Machine Learning... ..., repeatable evaluation of ML models and data. Your skills span... ..., Toronto, and remotely. Autodesk is a... ...TestingAutomate ML QA workflows using... ...engineering or QA for ML/AI systemsStrong... ...Expectations) or labeling...Remote workSeniorFull timeFor contractorsWork at office
- ...Moveworks is the Agentic AI Assistant platform... ...ServiceNow’s leading workflow automation... ...building and serving LLM’s at Moveworks.... ...models(LLM), model evaluation and monitoring framework... ...learning team, data infrastructure team... ...personas (flexible, remote, or required in office...Remote workSeniorFull timeWork at officeFlexible hours
Servicenow
Remote17 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior Data Labeling Lead — AI QA & LLM Evaluation. Be the first to apply!
Related searches
- manager workday data conversion lead Atlanta, GA
- data analytics lead Atlanta, GA
- data lead Atlanta, GA
- operations coordinator remote Atlanta, GA
- content designer remote Atlanta, GA
- remote coordinator Atlanta, GA
- remote broker Atlanta, GA
- remote insurance verification jobs Atlanta, GA
- remote design intern Atlanta, GA
- remote accounts receivable Atlanta, GA