Senior Data Annotator: AI Evaluation & QA Lead (Remote)
Rex.zone
Phoenix, AZ
- Remote job
Rex.zone is seeking a Senior Data Annotator to work remotely with our US-based Phoenix team. You will lead data labeling across NLP, LLM evaluation, and computer vision tasks, guiding RLHF workflows and QA checks to ensure high-quality training data. Sources emphasize strong attention to rubric-based scoring, policy application, and clear edge-case communication. This full-time, remote role offers collaboration with distributed engineers and data ops while focusing on risk-aware content labeling. #J-18808-Ljbffr Rex.zone
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Annotator: AI Evaluation & QA Lead (Remote) in Phoenix, AZ vacancy
- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation... ..., and contributing to QA workflows. #J-18808-Ljbffr...Remote jobSeniorFull time
$30 - $50 per hour
Rex.zone is hiring mid-senior data annotators to support US-based AI/ML projects across NLP, LLM evaluation, RLHF, content safety, and computer vision. You will produce and... ...measurable model performance improvement. Fully remote role aligned with Miami job-search intent,...Remote jobSeniorHourly pay- YO AI Labs is seeking a Senior Accountant Expert for a contractor role, remotely based in the United States. You will contribute specialized accounting and financial expertise... ...project, assisting with training and evaluating AI systems. No prior AI experience is required...Remote jobSeniorFor contractors
- Rex.zone is seeking a Senior Data Annotation professional for an Austin-aligned, fully remote role within the US. You will lead end-to-end data annotation and evaluation workflows that support AI/ML training pipelines, including RLHF, prompt-response evaluation, and rubric...Remote jobSenior
- Hippocratic AI Inc. is seeking a Registered Nurse with 5+ years of clinical experience to join our remote data annotation team evaluating AI-driven clinical agents. You will review agent conversations across primary care, chronic disease management, and scheduling, labeling...Remote job
- SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate... ...a Data Scientist Quality Assurance Lead (QAL) for an hourly remote contractor role to oversee quality,... ...will review AI-generated content, evaluate output quality, provide precise written...Remote jobSeniorHourly payContract workFor contractors
- Flodesk is a remote-first company shaping the future of AI-driven marketing tools for small businesses. The role focuses on owning prompts, agent instructions, evaluation criteria, and the continuous-improvement loop across prompts, context, tools and product state, ensuring...Remote workSenior
- Persona ищет ведущего QA (manual) для мобильных приложений на iOS и Android. Вы будете руководить командой QA, улучшать процессы тестирования и внедрять AI-автоматизации и автотесты в рабочие процессы команды. Требуется опыт не менее 5 лет в QA, управление командой, 1,5...Remote jobSenior
- Brooksource is seeking a Senior Business Systems Analyst and Testing Lead for a remote contract role supporting an Agentic AI contact center program. You will own requirements... ...ideal candidate has 5+ years of BSA/QA leadership, deep data platform skills, and experience with...Remote jobSeniorContract work
- ...seeking a Sr. Staff ML Systems Engineer to own end-to-end evaluation and data pipelines for healthcare AI products. You will set direction for evaluation... ...ingestion, labeling, and calibration workflows. You will lead multi-team initiatives, drive automated gates, and mentor...Remote jobSenior
- OpenTeams seeks a Senior AI/ML Test and Evaluation Engineer to build and operate benchmarking and evaluation capabilities at the core of our AI platform. You will design automated metrics and human judgments to compare models and agentic workflows, surface failure modes...Remote jobSenior
- Flodesk, a remote-first email marketing company, seeks an experienced AI Systems professional to own prompts, agent instructions, quality definitions, and evaluation infrastructure. You’ll connect engineering, product, and language models to improve member experiences...Remote workSenior
- SME Careers is hiring a C++ Quality Assurance Lead (QAL) as a remote hourly contractor to oversee quality across C++ AI training projects. You will review AI-generated C++... ...safety, performance, and readability; manage QA workflows across distributed teams; and contribute...Remote jobSeniorHourly payFor contractors
- 24-MAG LLC invites experienced Senior Software Engineers to join a part-time, remote consulting engagement focused on evaluating AI-generated software, code benchmarking, and research-driven verification. You will curate code, craft reference solutions, and build automated...Remote jobSeniorPart time
- 24-MAG LLC is offering a specialised remote consulting opportunity for Senior Book Editors with a track record in manuscript editing, developmental editing... ...manuscripts, provide nuanced editorial feedback, evaluate AI-generated work, and help develop editorial guidelines...Remote jobSeniorFor contractors
- Volga Partners is seeking an experienced Senior Investment Research & Capital Markets SME to support the development, evaluation, and improvement of AI models. This is not a traditional Investment Banking position; you will assess AI-generated financial analyses, validate...Remote jobSeniorBank staff
$15 - $30 per hour
Crossing Hurdles is seeking a contractor to perform realistic digital tasks using AI assistant tools from a remote location. You will follow standardized workflows, give clear instructions to AI, and verify outputs for accuracy, with a strong emphasis on attention to detail...Remote jobFor contractorsFlexible hours- Volga Partners is seeking an experienced Quantitative Finance Subject Matter Expert to support the evaluation and improvement of AI-driven financial analyses in a remote, project-based capacity. You will review AI-generated models, identify inaccuracies, and provide structured...Remote workSenior
- ...- An LTTS Company is seeking a Content Specialist III to evaluate, improve, and shape AI content across diverse topics. The role focuses on high-quality... ...structured guidelines consistently. The position is remote in the United States, with a 6+ month contract (W2). You...Remote workSeniorContract work
$130k - $160k
...start of a new age of data-centric... ...Requirements The Senior Quantitative Researcher... ...Implementation and Evaluation plays a pivotal role... ...evaluation work. Lead and collaborate on... ...functions. This is a remote position.... ...920 or ****@*****.***.ai. Please note that...Remote workSeniorFull time- Prolific is seeking Senior Python Developers to join our Expert Network to help train and evaluate AI models. You’ll undergo a short skills test and, if successful, join Prolific... ...are required. This role offers flexible hours and remote work. #J-18808-Ljbffr ProlificRemote jobSeniorFlexible hours
- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality... .... This is a US-based remote, full-time role aligned... ...with reviewers and leads. A mid-senior background...Remote jobSeniorFull time
- AI Trainer Jobs in the United States is seeking a C++ Systems Programming AI Evaluator to remotely review prompts and responses against our quality rubric. You will compare outputs, label edge cases, and provide structured feedback for retraining. This independent contractor...Remote jobSeniorHourly payFor contractors10 hours per week
- Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You... ...high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model performance...Remote jobSeniorFull time
- Rex.zone is seeking a Senior Data Annotation Specialist to lead high-quality labeling and evaluation workflows that enhance... ...evaluation. This full-time remote role is aligned with... ...prompt evaluation and QA. Strong guideline... ...and collaboration with AI/ML teams are essential...Remote jobSeniorFull time
- Mercor is seeking expert Evaluators in user and customer research to review AI-generated work products for accuracy, rigor, and domain quality. This remote, hourly role requires applying deep subject-matter expertise to grade outputs and provide clear, structured feedback...Remote jobSeniorHourly pay
$184k - $287.5k
...Control team to work on metrics and evaluation. In this role you will enable... ...software.Build compelling, data driven evaluation products by... ...existing vacancy. NVIDIA uses AI tools in its recruiting... ...US, CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote...Remote workSeniorFull timeNvidia
Santa Clara, CA1 day ago$60 per hour
...Senior Lua Developer (Roblox) – AI Code Evaluation An enterprise client is seeking experienced... ...The client partners with leading AI organizations to improve... ...high-quality training data used to advance generative... ...projects. Fully remote, project-based opportunity...Remote workSeniorWeekly payContract workFreelance10 hours per weekLifted, an Upwork Company™
United States4 days ago$144.7k - $261.3k
...DescriptionAbout the TeamThe Evaluation Foundations team, part of Embodied AI's Scaling... ...models and partner with data-intensive ML teams... ...About the RoleAs a Senior Engineer in the... ...This role is based remotely, but if the selected... ...responsibility to lead the change that will...Remote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Warren, MI1 day ago- Senior Data Analyst — Remote AI Evaluation Reviewer is a remote review track for evaluating AI outputs across senior data analyst... ...and report drift to the program lead. Nice to have Prior experience training, calibrating, or QA-ing operations teams. Familiarity with...Remote jobSeniorHourly payFor contractorsWork experience placement10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Annotator: AI Evaluation & QA Lead (Remote). Be the first to apply!
Related searches
- quality assurance lead Phoenix, AZ
- senior business development Phoenix, AZ
- american senior communities Phoenix, AZ
- senior devops engineer remote Phoenix, AZ
- senior information technology project manager Phoenix, AZ
- senior vmware engineer Phoenix, AZ
- sr electrical engineer Phoenix, AZ
- sr marketing manager Phoenix, AZ
- senior manufacturing manager Phoenix, AZ
- senior IT support specialist Phoenix, AZ