Senior Data Annotator: AI Evaluation & QA Lead (Remote)
Rex
Phoenix, AZ
- Remote job
Rex.zone is seeking a Senior Data Annotator to work remotely with our US-based Phoenix team. You will lead data labeling across NLP, LLM evaluation, and computer vision tasks, guiding RLHF workflows and QA checks to ensure high-quality training data. Sources emphasize strong attention to rubric-based scoring, policy application, and clear edge-case communication. This full-time, remote role offers collaboration with distributed engineers and data ops while focusing on risk-aware content labeling. #J-18808-Ljbffr REX
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Annotator: AI Evaluation & QA Lead (Remote) in Phoenix, AZ vacancy
- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation... ..., and contributing to QA workflows. #J-18808-Ljbffr...Remote jobSeniorFull time
$30 - $50 per hour
Rex.zone is hiring mid-senior data annotators to support US-based AI/ML projects across NLP, LLM evaluation, RLHF, content safety, and computer vision. You will produce and... ...measurable model performance improvement. Fully remote role aligned with Miami job-search intent,...Remote jobSeniorHourly pay- Rex.zone is seeking a Senior Data Annotation professional for an Austin-aligned, fully remote role within the US. You will lead end-to-end data annotation and evaluation workflows that support AI/ML training pipelines, including RLHF, prompt-response evaluation, and rubric...Remote jobSenior
- Volga Partners seeks an Investment Banking SME to support AI model evaluation in finance. You will assess AI-generated analyses for accuracy, validate reasoning, and identify errors. This is a remote, project-based role leveraging your deep industry expertise. Ideal candidates...Remote jobSenior
- Volga Partners seeks a Quantitative Finance Subject Matter Expert to support the development, evaluation, and improvement of advanced AI models in a remote, project-based engagement. This role requires evaluating AI-generated financial analyses for accuracy, identifying...Remote workSenior
- Centraprise is looking for detail-oriented and motivated AI Data Annotators proficient in Canadian French to enhance AI-powered conversational... ...provided for all levels of experience. The position is fully remote, offering a flexible work environment and collaboration within...Remote jobFlexible hours
- Geisinger is seeking a Senior BI Analyst to partner with AI Evaluation & Monitoring, collecting, cleaning, and interpreting data to support data-driven decisions. You will turn findings... ..., AI evaluation, and reporting design. Remote work from Pennsylvania is supported....Remote jobSenior
- YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world...Remote workSenior
- Rex.zone is seeking a Senior Data Annotation Specialist to lead high-quality labeling and evaluation workflows that enhance... ...evaluation. This full-time remote role is aligned with... ...prompt evaluation and QA. Strong guideline... ...and collaboration with AI/ML teams are essential...Remote jobSeniorFull time
- YO AI Labs in the United States is seeking experienced Civil Engineers to contribute to a high-impact AI evaluation project. You will apply your engineering expertise to create realistic scenarios... ..., rubrics, drawings, reports, and data artifacts while #J-18808-Ljbffr YO AI...Remote jobSeniorFor contractors
- Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You... ...high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model performance...Remote jobSeniorFull time
- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality... .... This is a US-based remote, full-time role aligned... ...with reviewers and leads. A mid-senior background...Remote jobSeniorFull time
$224k - $356.5k
...of autonomous driving, and evaluation is how we know the drive... ...our organization develops AI drivers!We are looking for a senior engineer to own the engine... ...road and simulation driving data becomes curated golden... ...CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote...Remote workSeniorFull time- Rex.zone is hiring for a Senior Data Annotation role in a remote-first setup targeting the Miami market. You will lead annotation guidelines, evaluate labeling quality, and perform RLHF tasks to improve AI/ML training data. Expect collaboration with engineering to build...Remote jobSenior
- Mercor is seeking expert Evaluators in user and customer research to review AI-generated work products for accuracy, rigor, and domain quality. This remote, hourly role requires applying deep subject-matter expertise to grade outputs and provide clear, structured feedback...Remote jobSeniorHourly pay
$40 - $50 per hour
...Role Overview Help develop evaluation tasks for AI systems used in complex human services and clinical... ..., such as an LCSW or LMSW, or as a senior case management professional. Experience... ...is preferred. Work Terms ~ Remote, hourly engagement. Compensation...Remote workSeniorHourly paySaidGig
United States27 days ago$80 - $90 per hour
...author realistic enterprise product evaluation tasks used to assess AI systems in Fortune 500 level product... ...judgment and decision making expected of senior product leaders operating at large... ...plus. Work Terms Location: Remote. Engagement type: Hourly...Remote workSeniorHourly paySaidGig
United States22 days ago$144.7k - $261.3k
...DescriptionAbout the TeamThe Evaluation Foundations team, part of Embodied AI's Scaling... ...models and partner with data-intensive ML teams... ...About the RoleAs a Senior Engineer in the... ...This role is based remotely, but if the selected... ...responsibility to lead the change that will...Remote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hours$144.7k - $221.4k
...About the Organization The Evaluation team builds and evolves... ...approaches that enable data-driven decisions across... ...Experience leveraging AI-assisted development... ...evaluation coverage.Hybrid/Remote: This role can be based... ...the responsibility to lead the change that will...Remote workSeniorFull timeLocal areaWork from homeRelocationRelocation packageFlexible hours$70 - $80 per hour
...Role Overview Build high-fidelity evaluation tasks for AI systems used in financial reporting, audit, and technical accounting. This work reflects... ...rubrics or training materials is a plus. Work Terms ~ Remote, hourly engagement. Compensation ~$70 to $80 per...Remote workSeniorHourly paySaidGig
United States27 days ago$90 - $100 per hour
...Overview Design high-fidelity evaluation tasks, reference outputs, and... ...reproduce the decision making of senior investment bankers working on... ...that train and evaluate AI systems against the standards... ...plus. Work Terms Location: Remote. Engagement type: Hourly contractor...Remote workSeniorHourly payContract workFor contractorsVisa sponsorshipSaidGig
United States27 days ago$50 - $60 per hour
...Build realistic enterprise insurance evaluation tasks and reference materials used to test AI systems in large, complex... ...outputs, and rubrics that reflect senior practitioner judgment. Key Responsibilities... .... Work Terms Location, remote. Employment type, hourly....Remote workSeniorHourly paySaidGig
United States27 days ago- ...MIT/MGH spinout building AI-enabled, ultrasound-... ...Lincoln Laboratory and leading physicians at the Massachusetts... ...an onsite team of data annotators performing... ...audits and track inter-annotator agreement to ensure consistent... ...edge cases, and model evaluation. Qualifications...SeniorFull time
AutonomUS, Inc.
Cambridge, MA3 days ago - ...RWS Group is seeking AI Data Specialists to enhance AI-generated content in English. This freelance position allows you to work from... ...hours (10+ hours per week). The role involves data collection, evaluation, annotation, and object tagging across various content types....Remote workPart timeFreelanceWork from home10 hours per weekFlexible hours
RWS Group
Raleigh, NC1 day ago $110 - $150 per hour
...Role Overview Help shape AI evaluation tasks for legal work in Fortune... ...reflect the judgment expected of a senior Fortune 500 lawyer.... ...preferred. Work Terms Remote, hourly independent-contractor... ...contributors may advance to reviewer, lead, and domain subject-matter-...Remote workSeniorHourly payFor contractorsSaidGig
United States27 days ago$204k - $259k
...-the-art Generative AI to create a training... ...Driver. The Simulator Evaluation team faces the ultimate data challenge: How do... ...We are looking for a Senior Software Engineer to... ...realism. You will lead the strategy for specific... ...can be performed remote, the specific salary...Remote workSeniorFull timeWaymo
San Francisco, CA2 days ago$60 per hour
...Lua Developers to support AI model training through technical evaluations, scripting tasks, and... ...The client partners with leading AI organizations to improve... ...of high-quality training data used to advance generative... .... Benefits ~Fully remote, project-based opportunity...Remote workSeniorWeekly payContract workTemporary workFreelance10 hours per weekLifted, an Upwork Company™
Remotea month ago- ...Role Overview Design and evaluate high-quality datasets and evaluations that advance large... ...corrections across multiple languages, assess AI-generated implementations for production... ...on performance and fit. Location: Remote, candidates must be based in the United States...Remote workSeniorFor contractors10 hours per weekFlexible hours
SaidGig
Canadamore than 2 months ago $37 per hour
...collaborates with the world’s leading AI research labs to build... ...: SaaS Software Data Reviewer Referral... ...37/hour Location: Remote Commitment: 10–40... ...ticket content. Draft evaluation rubrics and... ...your resume (15 min) Seniority level Associate...Remote workHourly payContract workCrossing Hurdles
United States4 days ago$201.3k - $352.3k
...ServiceNow is the AI control tower for business... ...any AI, any data, and any workflow—... ...end-to-end, industry-leading work experiences for... ..., data-driven Senior Engineering Manager... ...GenAI Benchmarking and Evaluations to establish and lead... ...(flexible, remote, or required in office...Remote workSeniorWork experience placementWork at officeImmediate startFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Annotator: AI Evaluation & QA Lead (Remote). Be the first to apply!
Related searches
- quality assurance lead Phoenix, AZ
- senior network engineer remote Phoenix, AZ
- senior app developer Phoenix, AZ
- senior manager legal Phoenix, AZ
- senior retail sales associate Phoenix, AZ
- sr project manager Phoenix, AZ
- senior account executive Phoenix, AZ
- senior manager strategic initiatives Phoenix, AZ
- senior staff systems engineer Phoenix, AZ
- senior commercial counsel Phoenix, AZ