Remote JS/TS AI Evaluator & Rubric Specialist
AI Trainer Jobs
New York, NY
- Remote job
AI Trainer Jobs is seeking an Independent contractor for a remote JavaScript and TypeScript AI Evaluator role. You will review prompts and responses against a rubric, label issues, and provide structured feedback to help retrain the model. Responsibilities include evaluating model outputs, comparing paired responses, labeling edge cases, and routing ambiguous prompts for rubric updates. Strong written reasoning and reliable weekly availability are essential. #J-18808-Ljbffr AI Trainer Jobs
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote JS/TS AI Evaluator & Rubric Specialist in New York, NY vacancy
- AuraOne is seeking a Fluid Dynamics AI Reviewer to remotely evaluate prompts and responses against its quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model. This contractor role requires careful reasoning...Remote jobFor contractors10 hours per week
- About the role JavaScript and TypeScript AI Evaluator is a remote evaluation track for reviewing... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs, label... ...annotation Work model Remote · Independent specialist contractor Compensation Hourly rate...Remote workJavascriptHourly payFor contractors10 hours per week
- Mercor is hiring experienced musicians to evaluate generative music AI models, focusing on Urdu and English lyrics. You will assess AI-generated... ...months, with a flexible commitment around 20 hours per week. Remote work is supported; candidates in the United States are...Remote workImmediate startFlexible hours
- AI Trainer Jobs is seeking a remote Conversational AI Evaluator to review prompts and model outputs against a evolving rubric. You will compare paired responses, label errors, and provide structured feedback to support retraining efforts. The role emphasizes clear reasoning...Remote jobHourly payFor contractors10 hours per week
- 24-MAG LLC seeks experienced Educator/ Assessor Writers for remote evaluation of AI-generated written responses. You will apply structured rubrics, assess clarity and relevance, and provide detailed rationales to ensure consistent quality judgments across tasks. Ideal...Remote job
- AuraOne seeks an experienced Senior Journalist / Writer for a remote evaluation track. You will review prompts and responses, compare paired outputs... ...after the interview. Reliable weekly availability and strong written reasoning are essential. #J-18808-Ljbffr AI Trainer JobsRemote jobHourly payFor contractors
- Weightlossprojectionlab is seeking a remote software engineer to build AI-powered health tech solutions. You will enhance family health management systems using technologies like React 19 and Next.js 16. The role emphasizes ownership over features from API to UI in a collaborative...Remote jobJavascript
- ...Assessment Rubric AI Evaluator is a remote review track for evaluating AI outputs across assessment rubric ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... .../ community programs Evaluator Type: Contract Compensation... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... ...domain-specific quality rubrics. Identify factual, aesthetic...Remote workContract workSummer workWork at office$131k - $165k
...Description SummaryThe Specialist Software Engineer is focused... ...Nexus)Familiarity with AI Development Tools and... ...(Angular, React, Vue.js,ASP.NET MVC, HTML, JS,... ...should be contacted to evaluate the accommodation... ...designation (in-office, hybrid, remote) and operational needs....Remote workJavascriptFull timeContract workWork at officeWorldwideWork visaRelocation package3 days per weekTransamerica
Cedar Rapids, IA5 days ago$122.5k
...Herndon, VA. Must currently hold an Active TS/SCI clearanceJob Description: Our client is... ...different technologies within a dynamic AI-driven environment. Minimum Requirements:... ...any of the following: Java, C++, Python, Vue.js, React, Kafka or similar, Git, ELK, Grafana...JavascriptSOC Support Services
McLean, VA5 days ago$69.4k - $158k
...frameworks, including React, Vue.js, or AngularKnowledge of server-... ...quickly, including AI and its applications in software... ...access to classified information; TS/SCI clearance with polygraph is... ...their cameras on during meetings.Remote: If this position is listed as...Remote workJavascriptFull timeContract workPart timeWork at officeLocal areaBooz Allen Hamilton
Laurel, MD3 days ago- ...JavaScript and TypeScript AI Evaluator is a remote evaluation track for reviewing javascript and typescript... ...responses against AuraOne's quality rubric. Reviewers compare paired outputs,... ...— US-eligible. Remote · Independent specialist contractor. Employment type:...Remote jobJavascriptHourly payFor contractors10 hours per week
$180k - $230k
...to deliver innovative solutions, including AI-driven capabilities, that address the... ...particularly Linux and Python. This is a hybrid remote position (50% on site/50% work from home)... ...such as Bootstrap, Tailwind, HTMX, Alpine.js, or comparable technologies. ~...Remote workJavascriptContract workWork from homeSynertex LLC
McLean, VA23 days ago- ...currently seeking a Systems Integration Specialist Advisor to join our team in Dallas, Texas... ...like GCP, AWS, and Azure, including their AI/ML services. Generative AI Experience with... ...’s needs. While many positions offer remote or hybrid work options, these arrangements...Remote workJavascriptWork at officeFlexible hours
NTT DATA
Dallas, TX3 days ago - ...Emerging Technologies Specialist to join the Digital Humanities... ...intelligence (AI), large language models... ...commitment to exploring and evaluating new tools and methods.... ...with IIIF, Node.js, React, static site generators... ...with up to two remote days per week.About UVAThe...Remote workJavascriptLocal areaVisa sponsorship2 days per week
University of Virginia
Charlottesville, VA3 days ago - ...Initiate action for evaluation and recommendation... ...Secret Clearance; TS/SCI is preferred... ...collaboratively across remote and physical locations... ..., Ansible, Vue.js, React, HTML, Podman... ...artificial intelligence (AI) to fight terror,... ...of Highly Cleared Specialists have hard-to-find...Remote workJavascriptContract workImmediate start
Newgen
Sterling, VA4 days ago - AuraOne is seeking a Latin Bilingual Expert for a remote evaluation track. Reviewers compare paired outputs to a quality rubric, label edge cases, and generate structured... ...requires reliable async availability for at least 10 hours per week. #J-18808-Ljbffr AI Trainer JobsRemote workFor contractors10 hours per week
- ...role We are hiring expert Evaluators in Data analysis / quantitative... ...to review and assess AI-generated work products (documents... ...to grade outputs. This is a remote, hourly engagement. Requirements... ...domain-specific quality rubrics. Identify factual, aesthetic...Remote workHourly payWork at office
Mercor Inc
New York, NY1 day ago $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $90/hour Location: Remote Role Responsibilities Render a reference... ...from those that merely look correct. Evaluate responsive behavior and semantic quality,...Remote workJavascriptContract workSummer workLocal areaMercor
San Francisco, CA9 days ago- ...to expose or operate on pipeline data. AI/Agentic Support: Support the architecture... ...Required Qualifications Clearance: Active TS/SCI clearance with a poly. Experience:... ...our offices, a hybrid schedule, or fully remote work; our team is spread across 25 states...Remote workJavascriptFull timeWork at officeWork from home
Orbis
McLean, VA6 days ago - YO AI Labs is seeking an AI Evaluation Specialist to remotely assess enterprise AI outputs against detailed rubrics, measuring accuracy, relevance and quality. You will provide concise, actionable feedback to drive improvements. Responsibilities include identifying reasoning...Remote jobFor contractors
$77.6k - $176k
...stacks such as Python, React, Node.js, Next.js, or CSSExperience with... ...to classified information;TS/SCI clearance with polygraph is... ...identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our... ...cameras on during meetings.Remote: If this position is listed as...Remote workJavascriptFull timeContract workPart timeWork at officeLocal areaBooz Allen Hamilton
Chantilly, Loudoun County, VA4 days ago$187.08k
...integrations using Java, Python, JS, TS, Node.js, React, & Vue.js.... ...providing tech. guidance. ~ AI & Intelligent Systems Dev. (20... ...orgs. Lead design reviews evaluating components for scalability, security... ...around our offices and remote work environments. The work style...Remote workJavascriptSecond jobWork at officeZoom
San Jose, CA1 day ago$89.6k - $204k
...Developer (Entry Level to SME) TS/SCI with Poly REQUIRED... ...software problems. • Integrate AI-assisted workflows into the development... ...(e.g., OAuth 2.0, JWT). • Evaluate eTask requirements to provide feedback... ...or frameworks like Node.js, PHP, Ruby on Rails, or Python....JavascriptWork at officeLocal areaArlington, VAmore than 2 months ago- AI Trainer Jobs seeks a remote independent contractor to review AI outputs for fintech operations evaluation. You will assess workflow adherence, tone, and escalation logic, assigning severity... ...and the ability to apply multi-page rubrics consistently. This contractor position...Remote jobHourly payFor contractorsFlexible hours
- ...monitor, troubleshoot, deploy, and maintain AI/ML models and analytics platforms. Support... ..., or a related technical field. Active TS/SCI clearance with Polygraph required. Demonstrated... ...schedule to include onsite, hybrid or remote, as dictated by position4. 401(k) and...Remote workJavascriptTemporary workFor contractorsLocal areaFlexible hours
Solerity
McLean, VA5 days ago - AI Trainer Jobs is seeking a Lesson Plan AI Evaluator for a remote, contractor role. You will review prompts and responses against AuraOne's quality rubric, label edge cases, and provide structured feedback to help retrain models. Responsibilities include evaluating model...Remote jobFor contractors
- AuraOne is seeking a Children Safety Content AI Evaluator for a remote, contractor-based role. You will evaluate model outputs, compare responses... ...content with structured tags according to our quality rubric. Ideal candidates have prior evaluation/annotation experience...Remote jobFor contractors10 hours per week
$30 per hour
...Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language... ...autonomous agent systems using defined rubrics and quality standards. Review... ...experience in LLM evaluation, AI output analysis, QA/testing, UX...Remote jobHourly payContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote JS/TS AI Evaluator & Rubric Specialist. Be the first to apply!
Related searches
- ai evaluator New York, NY
- education evaluator New York, NY
- work from home web search evaluator New York, NY
- evaluator New York, NY
- program evaluator New York, NY
- work from home social media evaluator New York, NY
- clinical evaluator New York, NY
- social media evaluator New York, NY
- quality evaluator New York, NY
- ai scientist New York, NY