Remote Senior Data Labeling Lead — AI QA & LLM Evaluation
Rex.zone
Atlanta, GA
- Remote job
Rex.zone in Atlanta is seeking a Mid-Senior Data Labeling Specialist to lead high-accuracy labeling and AI/ML evaluation work supporting production LLM training pipelines. You will drive data quality through guideline compliance and RLHF-style ranking across NLP, computer vision, and content safety domains. This role emphasizes meticulous QA, edge-case documentation, and collaboration with AI labs and startups to deliver reliable labeled data and evaluation signals that improve model performance. #J-18808-Ljbffr Rex.zone
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote Senior Data Labeling Lead — AI QA & LLM Evaluation in Atlanta, GA vacancy
- ...zone is seeking a Senior Data Annotation Specialist to lead high-quality labeling and evaluation workflows that enhance... ...data quality and LLM evaluation. This full-time remote role is aligned... ...prompt evaluation and QA. Strong guideline... ...with AI/ML teams are essential...Remote jobSeniorFull time
- Rex.zone is seeking a Senior Data Labeling Specialist to lead high-impact data labeling and evaluation workflows for AI training data quality. This fully remote role in the United... ...focuses on supporting LLM training pipelines,... ...guidelines, conduct QA evaluations, and...Remote jobSenior
- Rex.zone is seeking a data annotation professional to lead end-to-end annotation workflows for LLM and multimodal training. You will ensure data quality, drive labeling consistency across projects, and collaborate... ..., execute RLHF and LLM evaluation tasks, improve guidelines,...Remote job
$279.1k
...ServiceNow is the AI control tower... ...together any AI, any data, and any... ...on building the evaluation infrastructure and... ...depend on.As a Senior Director, AI Evaluation... ..., you will lead the teams responsible... ...stack spanning LLM-as-judge, rule-... ...(flexible, remote, or required in...Remote workSeniorWork at officeImmediate startFlexible hours- ...Role Overview Design and evaluate high-quality datasets and evaluations that advance large... ...corrections across multiple languages, assess AI-generated implementations for production... ...on performance and fit. Location: Remote, candidates must be based in the United States...Remote workSeniorFor contractors10 hours per weekFlexible hours
SaidGig
Canadamore than 2 months ago - ...of high-quality datasets and evaluation pipelines that improve and benchmark... ...code, evaluate and refine AI-generated solutions across... ...this by providing high-quality data, advanced training pipelines,... ...documentation. Work Terms Location: Remote. Engagement type:...Remote workSeniorFull timeFor contractors10 hours per weekFlexible hours
SaidGig
United Statesmore than 2 months ago $213k - $263k
...The mission of the Waymo AI Foundations team is to... ...hierarchical learning, and robust evaluation. This role follows a... ...time models. Explore LLM/VLM distillation recipes... ...Customize distillation data and recipe for business-... ...role can be performed remote, the specific salary...Remote workSeniorFull timeWaymo
Remote22 hours ago- ...California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global... ...research with high-quality data, advanced training pipelines, plus... ...What Does a Typical Day Look Like? Evaluate and refine AI-generated code across...Remote jobSeniorFor contractorsFlexible hours
- ...Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data... ...performance. This is a US-based remote, full-time role aligned... ...with reviewers and leads. A mid-senior background...Remote workSeniorFull time
REX
Doral, FL22 hours ago - ...Description Job Title: Data Scientist Quality Assurance Lead Job Type: Contract Location: Remote About This Role In... ...across data science AI training projects.... ...content and trainer/QA work, evaluate output quality against... ...training, data annotation, LLM evaluation, data...Remote jobHourly payContract workFor contractorsImmediate start
- ...Insights & Analytics team seeks a Senior Manager, Soccer Analytics & Data Science to lead major analytics workstreams and... ...tracking, roster, and financial data to evaluate performance, lead data-driven... ..., and advance MLS’s use of AI and data governance across the sporting...Remote jobSenior
- ...will also be considered. Remote candidates are welcome... ...Overview We are seeking a senior-level Cybersecurity Data Science and Analytics Lead to help shape and scale... ..., and potential AI-enabled solutions.... ...security domains. Evaluate security data and determine...Remote workSeniorFull timeWork at officeFlexible hours
TSG Risk Management
Remote12 days ago $80 - $100 per hour
...coding benchmarks and evaluation pipelines used to test frontier AI models on real... ...maintain scalable data pipelines for evaluation... ...and implementing LLM coding benchmarks and... ...Nice to have Senior or Lead-level profile with... ...Location: Fully remote — work from anywhere...Remote jobSeniorFull timeContract workFor contractorsG2i
Miami, FL22 hours ago- ...models to cybersecurity operations. You will own the evaluation methodology to determine whether an AI capability is fit to deploy in a Federal security environment. The role requires a strong background in ML/LLM engineering, governance with DoD-level attestations, and...Remote jobSenior
$160k - $205k
...supported the Regular Toilet is seeking a Senior GenAI and LLM Architect to join their Data capability group in Denver, Colorado. This role involves leading project teams in a client-facing... ...data sets and develop insights using AI techniques. Ideal candidates will have...SeniorFlexible hours- Optum is seeking a Senior AI/ML Engineer to own the intelligence layer of our... .... You will design, build, evaluate, and improve AI components including LLM workflows, RAG pipelines, and evaluation... ...-ready capabilities. You’ll work remotely from anywhere in the U.S. with...Remote jobSeniorWork at officeLocal area
- Data Lead — AAM Weather Technology Evaluation Location: Remote (U.S.) with periodic travel to Fort Worth, TX, and designated test... ..., regulatory strategy, and AI/ML integration for safety-critical... ...technical domain end to end on a small, senior team. Preferred Qualifications...Remote work
$183.34k - $206k
...accountability from Day 1. #LI-Remote Little more... ...the team: The LLM Observability (LLM... ...layer that makes AI workloads... ...), and ensure that data from diverse ecosystems... ...beyond. You'll plan, lead, and deliver... ...own frameworks for evaluating how to approach new...Remote workSeniorFull timeWork at officeLocal areaWork from homeHome officeVisa sponsorshipFlexible hoursShift workHoneycomb.io
United States22 hours ago- Mercor is seeking experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong...Remote jobSeniorHourly payWork at office
- Rex.zone is hiring a Remote Data Labeling Specialist to produce high-quality training data for AI/ML systems. You will complete data labeling... ..., RLHF preference ranking, QA evaluation audits, prompt evaluation,... ...safety labeling to support LLM training pipelines and computer...Remote job
$202k - $304k
...partner is looking for a Senior Marketing Data & Analytics Lead based in United States.... ...model with a fully flexible remote arrangement for the role.... ...Jobgether works: We use an AI-powered matching process... ...your personal data to evaluate your candidacy and share relevant...Remote workSeniorFull timeFlexible hoursjobgether
United States5 days ago$86.8k - $198k
Agentic AI and LLM Applications Software Development Engineer... ...We are looking for a senior SDE who lives at the... ...correctlyBuild evaluation pipelines for LLM quality... ...experiments, collect data, and iterate based on... ...cameras on during meetings.Remote: If this position is...Remote workSeniorFull timeContract workPart timeWork at officeLocal area- ...engineering tasks and evaluation datasets derived from public... ...code tasks that inform LLM evaluation and training... ...with opportunities to lead and mentor junior... ...Proven experience at a senior or tech-lead level working... ...tooling. Perks Fully remote work. Opportunity to...Remote workSeniorFor contractorsLocal area
SaidGig
United Statesmore than 2 months ago - ...AI-Powered QA Engineer Role at XY.AI Labs XY.AI Labs is... ...fully-automated quality, evaluation, and release platform... ..., spinning up LLM-driven evaluation pipelines... ...models for type-safe data flows. Architect GitHub... ...to grow into senior technical or leadership...Remote workSeniorShift work
Xy.ai Labs
United States3 days ago - ...Senior Software Engineer As a Senior Software... ..., design, and QA to ship reliable, well... ...'s core accounting data and workflows - the... ...transactions. AI Platform - Join the... ...SDKs, guardrails, evaluation frameworks, feedback... ...Build or integrate AI/LLM-powered...Remote workSeniorWork experience placement
Juniper Square
United States2 days ago $201.3k - $352.3k
...ServiceNow is the AI control tower... ...together any AI, any data, and any... ...to-end, industry-leading work experiences... ...exceptional, data-driven Senior Engineering... ...and Evaluations to establish and... ..., BLEU, G-Eval, LLM-as-a-judge patterns... ...personas (flexible, remote, or required in...Remote workSeniorWork experience placementWork at officeImmediate startFlexible hoursShift work- ...Senior QA Engineer Location: Remote — LatAm (Costa Rica preferred) Our client is a U.S.-based platform... ...automation and a global network of AI-enabled agents. The system connects... ...Familiarity with AI-powered testing — LLM evaluation, prompt testing, etc. Our...Remote workSeniorFull timeTemporary workPart timeFreelanceWork at officeLocal areaRelocation packageFlexible hours
MEV, LLC
United States2 days ago - ...Status: Yes Job Summary The Senior BI Analyst serves as a... ...area supported (AI Evaluation & Monitoring) and will... ...including knowledge of data structures, programming... ...performed in an office or remote environment. Accountable... ...adoption and outcome metrics LLM and generative AI...Remote workSeniorFull timePart timeWork at officeWork from homeShift work
$192.3k - $260k
...Position Overview:This is a senior leadership role... ...responsible for the management of Data Center cost engagements... ...(s), and serve as Team Lead.· Serve as Team Lead for... ...considerations.Location:Remote -Atlanta, GA, Chicago,... ...intelligence (AI) to efficiently accelerate...Remote workSeniorFull timeLocal area- ...Senior QA Engineer Steer Health helps healthcare organizations improve patient... ...burden, and recover revenue through AI-native workflow automation. Our lead product, Luna AI, acts as a voice-based... ...across our platform — from testing LLM-powered features and voice pipelines...Remote workSenior
Steer Health
United States12 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior Data Labeling Lead — AI QA & LLM Evaluation. Be the first to apply!
Related searches
- manager workday data conversion lead Atlanta, GA
- data analytics lead Atlanta, GA
- data lead Atlanta, GA
- junior remote developer Atlanta, GA
- college summer internship remote Atlanta, GA
- remote senior salesforce administrator Atlanta, GA
- remote transcription Atlanta, GA
- junior front end developer remote Atlanta, GA
- cad remote Atlanta, GA
- remote entry level web developer Atlanta, GA