Remote Learning Progression AI Evaluator — Quality & Policy
AuraOne, Inc.
New York, NY
- Remote job
AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows and firm policies. You will grade tone, escalation logic, and stakeholder fit using a structured rubric. Flexible US-based remote contractor role with at least 10 hours per week. You will help flag policy gaps and capture actionable next steps for the modeling team to train on. #J-18808-Ljbffr AuraOne, Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote Learning Progression AI Evaluator — Quality & Policy in New York, NY vacancy
- Learning Progression AI Evaluator is a remote review track for evaluating AI outputs across learning progression ai... ...grade workflow correctness, policy adherence, and stakeholder fit; flag... ...firm guidance. Maintain reviewer-quality scores in inter-rater calibration...Remote workQualityPolicyHourly payFor contractorsWork experience placement10 hours per week
$245k - $319k
...Engineer, Machine Learning to be a pivotal technical... ...generation of AI/ML models and... ...Brooklyn, NY or for remote candidates based in... ...and vaccination policy here.What’s this team... ...with local law.Qualities that will help you... ...are:10+ years of progressive experience in ML and...Remote workQualityPolicyFull timeWork at officeLocal areaVisa sponsorshipFlexible hoursEtsy
Brooklyn, NY5 days ago- ...keeping the Machine Learning organization... ...machine learning / AI. As the central hub... ...personalized, relevant, high-quality experience for... ..., and tracking progress for major cross-... ...or twice per week. Remote candidates outside... ...workplace safety policies here.Salary Range:...Remote workQualityPolicyFull timeWork at officeLocal areaVisa sponsorship
Etsy
Brooklyn, NY3 days ago $100 per hour
...Google Calendar AI Usage... ...frontier models and evaluating AI agents. Experts... ...into high-quality training data,... ...how AI systems learn, reason, and perform... ...: Contractor, Remote Location: United... ...updates on progress and challenges.... ...Terms and Privacy Policy for candidates....Remote workQualityPolicyPart timeFor contractorsmicro1
San Francisco, CA22 days ago$107.36k - $152.9k
...privately held, "remote-first" company... ...platform to learn and connect with... ...users run multiple AI agents on... ...improve content quality and safety across... ...engineers to design, evaluate, and deploy... ..., and other policy-violating content... ...or in progress Strong understanding...Remote workQualityPolicyFull timeWork experience placementInternshipFlexible hours$187k
...Chime’s Machine Learning Platform (MLP)... ...learning and emerging AI workloads,... ...-model access, evaluation, and agentic... ...testing, online quality signals, human... ...achieve financial progress. We created... ...in-office work policy is designed to... ...part of our fully remote program, you’ll...Remote workQualityPolicyFull timeWork at officeLocal areaChime
San Francisco, CA8 days ago$220.7k - $300k
..., and advanced AI to reshape access... ...financial progress. We're proudly... ...The Machine Learning Platform team builds... ..., retraining, evaluation, and drift monitoring... ...locations: Remote-US Time zone... ...spend high quality time in-person... ...process, please email _privacy_policyRemote workQualityPolicyCurrently hiringLocal areaWork from home$107.36k - $152.9k
...for a Machine Learning Engineer, New Grad... ...helping build AI-powered systems... ...content quality and safety across... ...design, develop, evaluate, and deploy large... ...solutions. This remote opportunity is... ...harassment, and other policy-violating... ...currently in progress. Strong understanding...Remote workQualityPolicyFull timeInternshipMonday to FridayFlexible hours$195.3k - $270.4k
..., and advanced AI to reshape access... ...financial progress. We're proudly... ...Upstart's Machine Learning and Simulations... ...offline model evaluation systems... ...following locations: Remote Time zone requirements... ...spend high quality time in-person... ..., please email _privacy_policyRemote workQualityPolicyCurrently hiringLocal areaWork from home$166.9k - $230k
...experimentation, and advanced AI to reshape access... ...their financial progress. We're proudly... ...: The Machine Learning and Simulations... .... Develop high-quality software... ...following locations: Remote Time zone requirements... ...process, please email _privacy_policyRemote workQualityPolicyCurrently hiringLocal areaWork from home- Brazilian Portuguese AI Evaluator is a remote evaluation track for reviewing portuguese generalist evaluation... ...and responses against AuraOne's quality rubric. Reviewers compare paired... ...Tag an unsafe response with the correct policy category and severity. Audit a 50-row...Remote workQualityPolicyHourly payFor contractors10 hours per week
- Misinformation Context AI Evaluator is a remote evaluation track for reviewing misinformation context... ...prompts and responses against AuraOne's quality rubric. Reviewers compare paired... ...Tag an unsafe response with the correct policy category and severity. Audit a 50-row...Remote workQualityPolicyHourly payFor contractors10 hours per week
$120k - $150k
...seeking a Machine Learning Engineer / Data... ...hyper-local policy analysis and recommendations... ...engineering, AI/ML, and climate... ...Develop evaluation frameworks to... ...and LLM output quality against expert-... ...'s climate progress through data-driven... ...include a remote but highly collegial...Remote workQualityPolicyFull timeLocal areaShift work- Social Engineering Security Evaluator is a remote evaluation track for reviewing... ...responses against AuraOne's quality rubric. Reviewers compare... ...retrain. Why this role matters AI data reviewers help turn... ...unsafe response with the correct policy category and severity....Remote workQualityPolicyHourly payFor contractors10 hours per week
- ...Flexible Contract (Remote) Job Summary:... ...review reinforcement learning tasks and... ...whether frontier AI models can carry out... ...review checklist and quality standards over time... ...implementing proximal policy optimization or... ...Work on frontier AI evaluation. Your judgment directly...Remote workQualityPolicyContract workPart timeFlexible hours
Cobalt
United States2 days ago - ...Manager for Applied AI and Machine Learning — a hands-on,... ..., prototype, and evaluate the models behind... ...that define product quality before launch and... ...either a fully remote or a hybrid role,... ...and communicate progress transparently to... ...batteries Unlimited PTO policy Complimentary in-...Remote workQualityPolicyWork at officeLocal area3 days per week
$188k - $302.45k
Director of Machine Learning & Artificial Intelligence Remote (US-Based), some... ...Learning & AI, you will lead and... ...balance speed, quality, reliability, cost... ...visibility into progress, risks,... ...guide direction, evaluate trade‑offs, and... ...Employment Opportunity policy, we do not discriminate...Remote jobQualityPolicyContract workFor contractorsFor subcontractorWork at officeWork from home$165.13k - $180.95k
...Software Engineer, Machine Learning Implement and... ...Artificial Intelligence (AI) and Machine Learning (... ...processes to streamline model evaluation and deployment... ...sessions to maintain high-quality standards in software development... ...pursuant to company policy. Minimum...Remote workQualityPolicyInternshipGriffin
United States5 days ago$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Remote workQualityPolicyContract workSummer workMercor
New York, NY17 days ago- ...through automation and AI. Our customers... ...-level Machine Learning Engineer who can... ...maintaining high quality, owning end-to-end... ...and performance. Evaluate and implement tools... ...happen. We're remote-first, flexible, and... ...the law, it is a policy that is fully...Remote workQualityPolicyFlexible hours
Canals
United States4 days ago $141.3k - $360.7k
...looking for a Senior Machine Learning Engineer who can drive... ...integrating Generative AI capabilities and Vision... ...to enrich content quality and user engagement. This... ...generally flexible for remote work, except for... ...accordance with local leave policies and other personal needs...Remote workQualityPolicyWork at officeLocal areaMonday to ThursdayFlexible hoursRoku
San Jose, CA7 days ago- Senior Machine Learning Engineer (Tech... ...Columbus, Ohio or Remote Build the Path... .... Our AI-driven systems... ...across action-policy learning, world... ...establish code-quality standards, review... ...information will help us evaluate and improve our... ...measure our progress towards this goal...Remote jobQualityPolicyContract workFor contractorsFor subcontractorWork at officeVisa sponsorshipFlexible hours
- ...Moveworks: the Agentic AI Assistant platform... ..., and continuously learn and adapt.... ...layer of our agent evaluation platform: the rubrics... ...question appropriate, was policy followed, was the... ...authoring, label quality, and annotator throughput... ...(flexible, remote, or required in office...Remote workQualityPolicyWork at officeFlexible hours
Servicenow
Mountain View, CA2 days ago $180k - $220k
...TITLE: Sr. Machine Learning Engineer... ...(hybrid) / Fully Remote in the United States... ...Design, train, and evaluate ML models for document... ...in LLMs, Agentic AI, and ML, and translate... ...to ensure code quality and provide mentorship... ...work from home policy ~ Home office stipend...Remote workQualityPolicyLocal areaWork from homeHome officeFlexible hoursCanoe Intelligence
New York, NY2 days ago$160k - $240k
...company and a leading AI platform for... ...applying modern machine learning, generative AI,... ..., build models, evaluate performance, and help... ..., reliability, quality, and responsible use... ...-person time and remote. Our approach enables... ...violation of this policy, requesting one or...Remote workQualityPolicyFull timeWork at officeHome officeFlexible hoursWorkday
Pleasanton, CA5 days ago- ...Staff Machine Learning Engineer Primer exists... ...decision-ready AI to the world's most... ...models, and the evaluation harnesses that catch... ...root cause when quality or operations are... ...flexible vacation policy for team members to... ...Membership, 401(k), remote work stipends, and...Remote workQualityPolicyContract workFlexible hours
Primer
San Francisco, CA1 day ago $176.1k - $308.2k
..., ServiceNow is the AI control tower for business... ...of continuous learning. This is a zero-to-one... ..., delivery, and quality. The design decisions... ...Experience with AI evaluation, safety, governance, or policy guardrails is a plus... ...personas (flexible, remote, or required in office...Remote workQualityPolicyWork at officeImmediate startFlexible hoursServiceNow
Santa Clara, CA2 days ago- ...hiring a Machine Learning Engineer II to join... ...teammates on model evaluation, backtests, tuning... ...(formerly Vertex AI), Dataproc, BigQuery... ...trending, data-quality tags, and alert hygiene... ...twice per week. Remote candidates outside... ...workplace safety policies here.Salary Range:...Remote workQualityPolicyFull timeInternshipSeasonal workWork at officeLocal areaVisa sponsorship
Etsy
Brooklyn, NY5 days ago - ...Today, ServiceNow is the AI control tower for... ...As a Staff Machine Learning Engineer - VoIP Infrastructure... ...environments. Build high-quality, clean,scalableand... ...Work personas (flexible, remote, or required in office)... ...'s terms and privacy policy apply #J-18808-Ljbffr...Remote workQualityPolicyFull timeWork at officeImmediate startFlexible hours
ServiceNow
Boston, MA3 days ago $120k - $145k
...through our Zero Harm policy JCI Employee... ...Manager, Technical Learning, you will lead the... ...solutions. Ensure high-quality learning... ...business outcomes to evaluate effectiveness and... ...environmentThis role is remote eligible. HIRING... ...artificial intelligence (AI), to help identify...Remote workQualityPolicyFull timeJohnson Controls
Phoenix, AZ3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Learning Progression AI Evaluator — Quality & Policy. Be the first to apply!
Related searches