Evaluation Specialist
AuraOne
AuraOne seeks a Remote Constitutional AI Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the model. The role is contractor-based and remote in the US, requiring clear written reasoning and attention to detail. Candidates should have prior evaluation or annotation experience on constitutional AI reward model evaluation and be able to work asynchronously for at #J-18808-Ljbffr
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Evaluation Specialist in New York, NY vacancy
- ...AuraOne is seeking a Lingala Bilingual Expert for a remote evaluation track. You will review prompts and responses against a quality rubric, label edge cases, and provide structured feedback for retraining the model. This is a contractor role requiring reliable async...SuggestedFor contractorsRemote work
AuraOne
New York, NY23 hours ago - ...AuraOne is seeking a remote Business Document Expert (Chinese Speaker) to review Chinese evaluation prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain models. This contractor...SuggestedFor contractorsRemote work
AuraOne
New York, NY23 hours ago - ...AuraOne is seeking a Haitian Creole Bilingual Expert for a remote evaluation track. You will review prompts and responses, apply the quality rubric, and provide structured feedback. You’ll label edge cases and contribute to retraining data with clear rationales and severity...SuggestedHourly payRemote work10 hours per week
AuraOne
New York, NY22 hours ago $10k
.... Position Summary Reporting to the team lead, supports the work of the asthma case manager within the schools. The Program Evaluation Specialist will be expected to provide health education, support and referrals for families of students with asthma. Communicate to OSH...SuggestedPermanent employmentFull timeWork at officeWork from home2 days per weekNYC Department of Health and Mental Hygiene
New York, NY1 day ago$10k
...Program Evaluation Specialist ONLY PERMANENT EMPLOYEES IN THE TITLE AND THOSE THAT ARE REACHABLE ON THE PUBLIC HEALTH EDUCATOR CIVIL SERVICE LIST ARE ELIGIBLE TO APPLY. Division/Program Summary: The Division of Family and Child Health (DFCH) of the New York City Department...SuggestedPermanent employmentFull timeWork at officeWork from home2 days per weekNew York City | Jobs
New York, NY1 day ago$80 - $120 per hour
Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should...Remote jobHourly payContract workWork at office- ...Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios...Hourly payFor contractorsFreelanceRemote work
Meridial Marketplace, by Invisible
New York, NY23 hours ago $68.9k - $99.62k
Community Relations Specialists are on the front lines of improving the lives of New Yorkers by connecting people to health-insurance products... ...organization in a positive and impactful manner Monitor and evaluate the effectiveness of community engagement efforts and...Full timeTemporary workWork experience placementLocal areaNight shiftWeekend work$32.39 - $36.04 per hour
...accomplishments, internal equity, budget, and subject to Fair Market Value evaluation. The hiring range listed is a good faith determination of... .... What you will be doing Description The Patient Access Specialist serves as the primary point of contact for patients and...Full timeLocal areaShift work$230k - $270k
...Safeguards Enforcement Analyst, Safety Evaluations Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want...Work at officeRemote workVisa sponsorshipFlexible hoursShift workAnthropic
New York, NY3 days ago- ...A healthcare provider is seeking an Audiologist to conduct comprehensive audiological evaluations, provide hearing aid fitting, and counsel patients regarding hearing and balance-related concerns. The ideal candidate will have a Master's degree in Audiology, excellent...Full time
Mount Nittany Health
New York, NY23 hours ago - ...cutting-edge diagnostic technology, collaborate with leading specialists, and contribute to advancing clinical practice. We prioritize... ...do as a Foot and Ankle Orthopedic Surgeon: Provide expert evaluation, diagnosis, and treatment for foot and ankle conditions, including...Local area
$40 per hour
A leading AI annotation company is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and contribute to the development of cutting-edge AI systems. This fully remote role offers flexible scheduling and pays at least $40/hour. Candidates...Remote workFlexible hoursDataAnnotation
New York, NY23 hours ago$101.18k - $120.46k
...Job Description Business Title(s): Senior Shared Services Specialist Employment Type: Full-Time FLSA Status: Exempt... ...negotiation. Desireto work in a fast-paced environment. Excellent evaluation and strategic skillsrequired. Mustpossessa strong customer...Full timeWork experience placementLocal areaArgonaut Management Services, Inc
New York, NY3 days ago$45.75k - $79k
## Sr. Specialist, Customer Advocacy and Resources EducationApplylocations: REMOTE - Pennsylvaniatime type: Full timeposted on: Posted... ...phone, through email or other means of virtual communication.* Evaluate information provided by a customer to determine the best course...Hourly payFull timeContract workWork experience placementRemote workShift workBanco Santander SA
New York, NY2 days ago- ...requirements and turn‑around times of the Expedited Appeal unit, the Specialists are required to work weekends and holidays as the organization... ...Independently perform triage function: review and evaluate appeal requests; identify and classify member and provider appeals...Remote jobHourly payContract workWeekend work
- ...individuals with disabilities to perform the essential functions unless this causes undue hardship to the company.Performance is evaluated each year based on these competencies and the NADSP code of ethics.EEO StatementBirch Family Services provides equal employment opportunities...Local areaWork from home
Birch-Family-Services,-Inc
New York, NY1 day ago $17.25 - $20.5 per hour
...accommodations may be made to enable qualified individuals with disabilities to perform the essential functions unless this causes undue hardship to the company. Performance is evaluated each year based on these competencies and the NADSP code of ethics. #J-18808-Ljbffr...Hourly payWork at officeBirch Family Services
New York, NY4 days ago$60.63k - $93k
...services to automakers. How You’ll Make An Impact The Senior Specialist, Clearances and Music Rights role supports the Music Licensing... ...media) and escalate exceptions or non‑standard terms for review. Evaluate rights and usage details to determine clearance path, required...Contract workTemporary workLocal areaShift workSiriusXM
New York, NY3 days ago$93.53k - $137.18k
...for multiple consecutive years. Overview The Process Technology Specialist I plays a critical role within the Global Process Technology... ...engineering to define equipment requirements (pumps, mixers, tanks) Evaluate manufacturing capabilities and recommend improvements Sourcing...Work at officeSolenis
New York, NY4 days ago- ...Shipping Specialist Anywhere (Remote) Fulfilment Apply now About Cloudprinter Cloudprinter.com is a leading global print‑on‑demand platform... ...shipping accounts with carriers in key regions worldwide. Evaluate, select, and onboard new shipping carriers and logistics partners...Contract workRemote workWorldwideFlexible hours
Cloudprinter.com B.V.
New York, NY3 days ago - ...unnecessary healthcare costs. Role Overview The Patient Engagement Specialist is a frontline role responsible for connecting eligible... ...eligibility verification, and scheduling of initial clinical evaluations. As an early-stage startup, we are looking for someone who...Remote job
$40 per hour
A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated work and design training problems for advanced AI systems. Responsibilities include ensuring the technical accuracy of analyses and providing feedback to shape AI capabilities...Remote jobHourly payFlexible hours$40 per hour
A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated work and design problems for AI training. The role offers fully remote work across multiple countries. Candidates should have 2+ years in quantitative roles, strong...Remote jobHourly payFlexible hours$80k - $95k
...EHS Specialist Delhi New York (US) Quality & HSE 40+ At FrieslandCampina Ingredients, we transform good into great. As a global leader... ...well as certification standards. Risk Mitigation: Identify and evaluate hazards/risks, and educate others on changes/new regulations....Work at officeLocal areaWorldwideFrieslandCampina
New York, NY4 days ago- ...screens and physicals. Coordinate and administer DOT regulations in conjunction with Human Resources and Operations (where applicable). Evaluate technical and scientific publications concerned with safety management and participate in activities of related organizations to...Work at officeNight shiftWeekend work
Knife River
New York, NY3 days ago - ...The Central Production Control Specialist is an office-based role that uses centralized system-based tools to direct and manage production... ..., we may use AI‑assisted tools to support the screening and evaluation of candidate applications and interviews. These tools help...Temporary workWork at officeFlexible hours
Lehigh Hanson
New York, NY3 days ago $40 - $42.1 per hour
...6 Months Job Description The Safety Program Advisor (Remote Position) is responsible for delivering high-quality Safety and Risk Evaluation and Mitigation Strategy (REMS) education to healthcare professionals (HCPs). This role involves ensuring patient safety and REMS...Contract workRemote workIntegrated Resources
New York, NY3 days ago$100.4k - $186.4k
...every voice matters.### ### The Position****Pathology Solutions Specialist********The Opportunity:****The Pathology Solutions Specialist... ...on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Demonstrates good judgment in selecting...Relocation packageNight shiftF. Hoffmann-La Roche AG
New York, NY2 days ago$40 per hour
A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated work and solve technical problems. This fully remote role allows you to choose your projects and schedule, offering competitive pay starting at $40+ per hour. Ideal...Remote jobHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation Specialist. Be the first to apply!
Related searches
- recovery specialist New York, NY
- instructional specialist New York, NY
- evaluation specialist New York, NY
- professional specialist New York, NY
- learning management system specialist New York, NY
- government relations specialist New York, NY
- patient experience specialist New York, NY
- zoning specialist New York, NY
- appeals specialist New York, NY
- ergonomic specialist New York, NY