Senior AI Data Annotation & Evaluation Specialist (Remote)
REX
Seattle, WA
- Remote job
Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model performance improvement. You will collaborate with engineers and data ops on task design, schema updates, and quality monitoring signals, documenting edge cases and escalating issues that impact data quality. #J-18808-Ljbffr REX
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Data Annotation & Evaluation Specialist (Remote) in Seattle, WA vacancy
- Rex.zone is hiring for a Senior Data Annotation role in a remote-first setup targeting the Miami market. You will lead annotation guidelines, evaluate labeling quality, and perform RLHF tasks to improve AI/ML training data. Expect collaboration with engineering to build...Remote jobSenior
- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt... .... This is a US-based remote, full-time role aligned with Miami... ...mid-senior background in data annotation and familiarity with RLHF concepts...Remote jobSeniorFull time
- Rex.zone is seeking a Senior Data Annotation Specialist to lead high-quality labeling and evaluation workflows that enhance training data quality... ...evaluation. This full-time remote role is aligned with Dallas-... ...and collaboration with AI/ML teams are essential. #J-18...Remote jobSeniorFull time
$20 per hour
...A technology-focused company is seeking a Senior Graphic Designer to evaluate and enhance AI models' understanding of design. This role allows you to critique... ...design, along with fluency in English. This is a remote opportunity with competitive pay starting at $20+ USD...Remote workSeniorDataAnnotation
Sioux Falls, SD1 day ago$50 - $60 per hour
...A leading AI company in Michigan is seeking a Senior Financial Analyst to help train the next generation of AI. This position offers remote work with flexibility in scheduling, making it ideal... ...opportunities. Responsibilities include evaluating AI outputs and providing...Remote workSeniorHourly payFull timePart timeDataAnnotation
United States1 day ago$23 - $26.45 per hour
Appen is seeking Independent Contractors for a remote Audio Evaluation Project. You will listen to two audio recordings per case and decide which is better based on the provided guidelines. The role emphasizes precision, consistency, and adherence to instructions. The project...Remote jobHourly payFor contractorsWork from homeFlexible hours$20 per hour
...A technology company is seeking a Senior Graphic Designer to enhance AI models through design evaluation and feedback. This remote role focuses on reviewing AI-generated visual content, ensuring quality, and contributing to design-specific projects. Ideal candidates will...Remote workSeniorFlexible hoursDataAnnotation
Montgomery, AL1 day ago$80 - $100 per hour
...the coding benchmarks and evaluation pipelines used to test frontier AI models on real software... ...Build and maintain scalable data pipelines for evaluation... .... Nice to have Senior or Lead-level profile with... ...Logistics Location: Fully remote — work from anywhere on...Remote jobSeniorFull timeContract workFor contractorsG2i
Miami, FL17 hours ago- Turing is seeking experienced law enforcement and public safety professionals for remote contractor work evaluating AI systems. You will apply criminal justice expertise to supervise and test AI reasoning, collaborate with researchers, and produce clear explanations of...Remote workSeniorFor contractorsFreelance
- Volga Partners seeks an Investment Banking SME to support AI model evaluation in finance. You will assess AI-generated analyses for accuracy, validate reasoning, and identify errors. This is a remote, project-based role leveraging your deep industry expertise. Ideal candidates...Remote jobSenior
$70 - $80 per hour
...Role Overview Design evaluation tasks and senior-level scenarios that test AI systems used for rapid prototyping, product design, and human-AI collaborative... ...are encouraged to apply. Work Terms Location: Remote. Employment type: hourly. Compensation ~ Pay...Remote workSeniorHourly paySaidGig
United States11 days ago- ...Description This is a remote position. Please Note... ...and Application Support Specialist to lead technology efforts... ...operational support, data storage optimization,... ...current data environments, evaluate storage capacity, and... ...Microsoft Azure. ~AI & Vendor Management: Implement...Remote workSeniorFull timeMonday to Friday
Omm IT Solutions
Remote17 hours ago - ...seeking a backend-focused engineer to build scalable evaluation and observability tooling for our AI agent platform. You will shape how we measure and improve... ..., and collaboration across teams in a fast-growing, remote-friendly environment. #J-18808-Ljbffr AlionRemote workSenior
$7.81k - $11.82k
...EmployeePosition Title:*Senior Power Platform... ...Information Systems Specialist 8)Job Description:... ...integrations, and AI‑enabled capabilities... ...enterprise systems, data platforms, identity... ...components, evaluate platform capabilities... ...role is a hybrid of remote work and in-office...Remote workSeniorFull timeWork at office$224k - $356.5k
...of autonomous driving, and evaluation is how we know the drive... ...our organization develops AI drivers!We are looking for a senior engineer to own the engine... ...road and simulation driving data becomes curated golden... ...CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote...Remote workSeniorFull time$184k - $287.5k
...Control team to work on metrics and evaluation. In this role you will enable... ...software.Build compelling, data driven evaluation products by... ...existing vacancy. NVIDIA uses AI tools in its recruiting... ...US, CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote...Remote workSeniorFull time- Rex.zone is seeking a Senior Data Annotation professional for an Austin-aligned, fully remote role within the US. You will lead end-to-end data annotation and evaluation workflows that support AI/ML training pipelines, including RLHF, prompt-response evaluation, and rubric...Remote jobSenior
$24 - $30 per hour
Mercor is seeking a Moonlight MCQA - Arabic Generalist to draft Arabic MCQs for an AI evaluation dataset. This contract role offers remote work with flexible hours and a process including AI interview based on your resume. Must hold a master's or PhD, 2-6 years of experience...Remote jobHourly payContract workFreelanceFlexible hours- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation guidelines compliance, content safety labeling, and...Remote jobSeniorFull time
- ...Build realistic enterprise insurance evaluation tasks and reference materials used to test AI systems in large, complex... ...outputs, and rubrics that reflect senior practitioner judgment. Key Responsibilities... .... Work Terms Location, remote. Employment type, hourly....Remote workSeniorHourly pay
SaidGig
United States11 days ago $129.4k - $198.4k
...experiences. About the Organization:The Evaluation team builds and evolves the... ...approaches that enable data-driven decisions across AV development... ...best practices. Leverage AI-assisted development tools and... ...teams and organizations in a remote or distributed environment....Remote workSeniorFull timeLocal areaWork from homeFlexible hours$120k - $145k
...network of trusted suppliers. Summary The Senior Systems Specialist is responsible for installing,... ...technical expert, providing support remotely and, as needed, at production locations... ...Performs routine analysis to include evaluation of hardware and software based on business...Remote workSeniorFull timeContract workWork at officeWorldwideHome office$30 - $50 per hour
Rex.zone is hiring mid-senior data annotators to support US-based AI/ML projects across NLP, LLM evaluation, RLHF, content safety, and computer... ...data, ensuring strict annotation guidelines compliance and measurable... ...improvement. Fully remote role aligned with Miami job...Remote jobSeniorHourly pay- ...Overview Design and write evaluation tasks and reference analyses that simulate senior Fortune 500 enterprise data science and analytics decision... ...including SageMaker, Vertex AI, and MLflow. Apply... ...Work Terms Location: Remote. Engagement type: Hourly....Remote workSeniorHourly pay
SaidGig
United States11 days ago $70 - $80 per hour
...Overview Design and author realistic evaluation tasks and reference materials for AI systems used in large-scale... ...outputs, and rubrics that reflect senior civil engineering judgment on projects... ...plus. Work Terms Location: Remote. Employment type: Hourly. Compensation...Remote workSeniorHourly paySaidGig
United States21 days ago$279.1k
...Today, ServiceNow is the AI control tower for... ...brings together any AI, any data, and any workflow—... ...focused on building the evaluation infrastructure and frameworks... ...they depend on.As a Senior Director, AI Evaluation... ...Work personas (flexible, remote, or required in office)...Remote workSeniorWork at officeImmediate startFlexible hours$85 per hour
...estimation, construction planning, and solar design to evaluate AI-generated content and produce expert training data that improves AI understanding of project... ...cost estimation. This is hourly contract work, fully remote and flexible, suitable to take on alongside other...Remote workHourly payContract workPart timeFlexible hoursSaidGig
United Statesmore than 2 months ago$110 - $150 per hour
...Shape realistic legal evaluation tasks for AI systems used in Fortune 500 and large public-company contexts. This role applies senior legal judgment to scenarios reflecting complex regulations... ...is preferred. Work Terms Remote, hourly engagement. Minimum commitment...Remote workSeniorHourly paySaidGig
United States11 days ago- Role Description This is a remote position. Our Client is hiring a Senior Program Director, AI Data Services to lead complex customer... ...AI data, localization, data annotation, transcription, enterprise... ...services, LLM workflows, model evaluation, speech/audio AI, multilingual...Remote workSeniorFull time
L10n People Ltd
Remote7 days ago $80 - $110 per hour
...seeking experienced Structural Engineers to help train and evaluate next-generation AI systems. This opportunity is part of a large-scale... ...structural engineering. Work independently in a fully remote, flexible environment. Qualifications Requirements...Remote workSeniorHourly payContract workTemporary work10 hours per weekFlexible hoursLifted, an Upwork Company™
Chicago, IL27 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Data Annotation & Evaluation Specialist (Remote). Be the first to apply!
Related searches
- ai scientist Seattle, WA
- ai data scientist Seattle, WA
- data specialist Seattle, WA
- data management specialist Seattle, WA
- provider data specialist Seattle, WA
- data associate Seattle, WA
- data entry associate Seattle, WA
- data integration specialist Seattle, WA
- data management associate Seattle, WA
- oncology data specialist Seattle, WA