Evaluation Specialist
AI Trainer Jobs
AI Trainer Jobs is seeking a Korean bilingual expert for a remote evaluation track. The role involves reviewing Korean generalist prompts and responses against AuraOne's rubric, comparing paired outputs, and writing structured feedback for retraining. As a remote independent contractor, you will assess outputs, tag issues, and calibrate ratings weekly. The position offers an hourly rate to be confirmed after the interview, with eligibility to work from the United States. #J-18808-Ljbffr AI Trainer Jobs
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Evaluation Specialist in New York, NY vacancy
$90.58k - $114.59k
Position InformationNY HELP: YesAgency: Mental Health, Office ofTitle: Mental Hygiene Program Evaluation Specialist 3 (NY HELPS), Kingsboro Psychiatric Center, P27987Occupational Category: Health Care, Human/Social ServicesSalary Grade: 23Bargaining Unit: PS&T - Professional...SuggestedPermanent employmentFull timeWork at officeRemote workState of New York, USA
New York, NY3 days ago$50 per hour
...English (US) Audio Evaluation Specialist is a remote evaluation track for reviewing audio annotation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team...SuggestedFor contractorsRemote work10 hours per weekAI Trainer Jobs
New York, NY3 days ago$111.71k - $137.59k
...this position by using the contact information provided on the "Contact" tab for the position. Title Mental Hygiene Program Evaluation Specialist 4 (NY HELPS), Pilgrim Psychiatric Center, P27982 Occupational Category Health Care, Human/Social Services Salary Grade 27...SuggestedPermanent employmentFull timeWork at office- AuraOne is seeking remote evaluators to review exocentric video recorder outputs and judge them against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. This contractor role emphasizes written...SuggestedFor contractorsRemote work
- Weekday 1 is seeking analytical professionals to evaluate AI-generated responses across a variety of topics in a fully remote contractor role. You will assess AI outputs, identify strengths and weaknesses in reasoning, and provide structured, evidence-based feedback to...SuggestedFor contractorsRemote workWeekday work
- AuraOne is seeking a Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses. You will compare outputs, label edge cases, and create structured feedback for retraining the model. As an independent contractor, you will review tasks with...For contractorsRemote work
- Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior...Hourly payFor contractorsRemote work10 hours per week
- ...contractor role. Reviewers compare outputs, label edge cases, and provide structured feedback to retrain models. Responsibilities include evaluating model outputs against a rubric, identifying safety issues, and calibrating scores weekly. The position offers an hourly rate...Hourly payFor contractorsRemote work
- AI Trainer Jobs is seeking a Hindi Audio Recording Expert for a remote evaluation track. You will review Hindi prompts and responses against AuraOne's rubric, compare paired outputs, label edge cases, and provide structured feedback to retrain models. You will help turn...Remote job10 hours per week
- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...Remote jobContract workImmediate startFlexible hours
- ...Merchant Mariner Evaluation Specialist (Engine) This vacancy is for a GS - 2101 - 12, Merchant Mariner Evaluation Specialist (Engine) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER EXAMINATIONS BRANCH, Location Negotiable After Selection...
- Senior Merchant Mariner Evaluation Specialist (Engine) This vacancy is for a GS-2101-13, Senior Merchant Mariner Evaluation Specialist (Engine) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER EXAMINATIONS BRANCH in location to be determined...
$89.59k - $197.46k
...own future.KPMG is currently seeking a Senior Associate, Credit Specialist to join our Audit practice.Responsibilities:Execute the day-to... ...models to credit loss accounting concepts, including evaluation of model validation design and application Ability to meet challenging...H1bLocal areaKPMG
New York, NY3 days ago$86.21k - $141.64k
...Guardian is seeking a motivated individual to join our team as Lead Specialist, General Audit.This role will support the Head of Corporate... ..., value-add, assurance and advisory services that identify, evaluate, and report on highly complex business risks and controls in...Full timeH1bWork at officeVisa sponsorshipWork visaFlexible hoursGuardian Life Insurance
New York, NY3 days ago$70 - $100 per hour
...Contract Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of...Contract workSummer workWork at officeImmediate startRemote workMercor
New York, NY7 days ago$230k - $270k
...our policies, protecting users, and ensuring our platform is not misused. As a Safeguards Enforcement Analyst focused on Safety Evaluations, you'll play a central role in ensuring our models meet safety and policy standards before and after launch. You'll run and monitor...Work at officeVisa sponsorshipFlexible hoursShift workAnthropic
New York, NY3 days ago$145k
...Make: We are looking for an experienced PolyPath Market Risk Specialist with strong technical and business knowledge to support... ...your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this...Hourly payFull timeContract workWork experience placementShift workSantander Holdings USA Inc
New York, NY2 days ago- ...role suits analytical professionals with strong written communication skills who can apply structured guidelines to high-impact evaluation projects across consumer-facing domains. You will contribute to quality control and documentation standards while collaborating with...
- ...Job Description Job Description Humanities Evaluation Specialist Role Type: Contractor Location: Remote micro1 is seeking Humanities Evaluation Specialists to support an AI training project involving research, critical analysis, question development, and...Remote jobFor contractors
$15 - $20 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role...Contract workSummer workRemote work$45 - $70 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Behavioral Health Expert, AI Safety and Model Evaluation Type: Contract Compensation: $45–$70/hour Location: Remote Commitment: 20–40 hours/week Role...Contract workSummer workRemote workWeekday work$90 per hour
...DOM impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility expertise ( ARIA , semantic landmarks...Contract workSummer workLocal areaRemote work- ...Description Job Description Job title: Recreational Specialist Reports to: Program Director FLSA Status:... ...for recruiting and selecting employees, assigning work and evaluating performance. Additional responsibilities may be assigned, and...Hourly payFull timeContract workWork at officeWork from homeMonday to Friday
Highland Park Community Development Corp
New York, NY16 days ago $25 - $30 per hour
...seeks an enthusiastic, dedicated, and mission-aligned Activity Specialist at Harlem Children’s Zone. The Activity Specialist will... ...youth in the following areas through the arts: critical thinking; evaluation; risk-taking; rehearsals; hands-on project-based learning;...Hourly payPart timeSummer workMonday to FridayHarlem Children's Zone
New York, NY7 days ago$219.1k - $296.5k
AWS Specialist Technology Team (STT) is the connective tissue between AWS's deep technical specialists, field teams, and customers—delivering... ...—working through your product managers to shape roadmaps, evaluate trade-offs, and ensure each product delivers measurable impact...Flexible hoursAmazonWebServices
New York, NY1 day ago$162.7k - $220.2k
...is looking for an experienced Information Technology Assurance Specialist to join our fast-paced FSI Security and Compliance team and... ...diligence needs of Financial Services customers during their evaluation of AWS as a cloud provider, the overall trends in the industry...WorldwideFlexible hoursAmazonWebServices
New York, NY3 days ago$100k - $120k
...Services, is looking to hire a Professional Services Sourcing Specialist in New York, NY. Salary: $100,000 - $120,000 Key Responsibilities... ...processes, including requirements development and supplier evaluation criteria. Negotiate commercial terms, pricing, and...Contract workLocal areaRussell Tobin
New York, NY4 days ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote work$80 - $150 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities Review and assess domain-...Contract workSummer workRemote work$84.58k - $145.9k
...Senior Controls Specialist Facilities / Real Estate -- Maintenance/Skilled Workers New York • Full-Time/Regular NYU Langone... ...scheduling, discipline, approvals for time off and performance evaluations. Oversees the execution of the building automation system...Full timeTemporary workFor contractorsWork at officeNYU Langone Health
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation Specialist. Be the first to apply!
Related searches
- senior safety specialist New York, NY
- reentry specialist New York, NY
- grocery specialist New York, NY
- localization specialist New York, NY
- agency management specialist New York, NY
- restaurant specialist New York, NY
- outreach specialist New York, NY
- renovation specialist New York, NY
- live chat specialist New York, NY
- generation specialist New York, NY