Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Evaluation Specialist

AuraOne

AuraOne is seeking a Lingala Bilingual Expert for a remote evaluation track. You will review prompts and responses against a quality rubric, label edge cases, and provide structured feedback for retraining the model. This is a contractor role requiring reliable async availability and US remote eligibility. You will compare outputs, explain your rationale, and document recurring issues to support continuous improvement of the evaluation process. #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Evaluation Specialist in New York, NY vacancy
  •  ...AuraOne is seeking a Haitian Creole Bilingual Expert for a remote evaluation track. You will review prompts and responses, apply the quality rubric, and provide structured feedback. You’ll label edge cases and contribute to retraining data with clear rationales and severity... 
    Suggested
    Hourly pay
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • $10k

     ...Program Evaluation Specialist ONLY PERMANENT EMPLOYEES IN THE TITLE AND THOSE THAT ARE REACHABLE ON THE PUBLIC HEALTH EDUCATOR CIVIL SERVICE LIST ARE ELIGIBLE TO APPLY. Division/Program Summary: The Division of Family and Child Health (DFCH) of the New York City Department... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Work from home
    2 days per week

    New York City | Jobs

    New York, NY
    1 day ago
  • $10k

     .... Position Summary Reporting to the team lead, supports the work of the asthma case manager within the schools. The Program Evaluation Specialist will be expected to provide health education, support and referrals for families of students with asthma. Communicate to OSH... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Work from home
    2 days per week

    NYC Department of Health and Mental Hygiene

    New York, NY
    1 day ago
  • $80 - $120 per hour

    Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should... 
    Suggested
    Remote job
    Hourly pay
    Contract work
    Work at office

    Mercor

    New York, NY
    4 days ago
  •  ...Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios... 
    Suggested
    Hourly pay
    For contractors
    Freelance
    Remote work

    Meridial Marketplace, by Invisible

    New York, NY
    1 day ago
  • $26 per hour

    Housing Specialist The in-shelter Housing Specialist is responsible for supporting shelter residents in securing stable housing...  ...Collaborate with guests to develop service plans informed by evaluations, incorporating clearly defined SMART goals. * Provide ongoing... 
    Hourly pay
    Permanent employment
    Full time
    Work at office
    Local area

    Cherokee Federal

    New York, NY
    2 days ago
  • $68.9k - $99.62k

    Community Relations Specialists are on the front lines of improving the lives of New Yorkers by connecting people to health-insurance products...  ...organization in a positive and impactful manner Monitor and evaluate the effectiveness of community engagement efforts and... 
    Full time
    Temporary work
    Work experience placement
    Local area
    Night shift
    Weekend work

    HealthFirst

    New York, NY
    3 days ago
  • $230k - $270k

     ...Safeguards Enforcement Analyst, Safety Evaluations Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want... 
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    New York, NY
    3 days ago
  • $32.39 - $36.04 per hour

     ...accomplishments, internal equity, budget, and subject to Fair Market Value evaluation. The hiring range listed is a good faith determination of...  .... What you will be doing Description The Patient Access Specialist serves as the primary point of contact for patients and... 
    Full time
    Local area
    Shift work

    Hospital for Special Surgery

    New York, NY
    3 days ago
  •  ...A healthcare provider is seeking an Audiologist to conduct comprehensive audiological evaluations, provide hearing aid fitting, and counsel patients regarding hearing and balance-related concerns. The ideal candidate will have a Master's degree in Audiology, excellent... 
    Full time

    Mount Nittany Health

    New York, NY
    5 days ago
  • $15 - $20 per hour

     ...Role Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity,... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    a month ago
  • $40 per hour

    A leading AI annotation company is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and contribute to the development of cutting-edge AI systems. This fully remote role offers flexible scheduling and pays at least $40/hour. Candidates... 
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  •  ...cutting-edge diagnostic technology, collaborate with leading specialists, and contribute to advancing clinical practice. We prioritize...  ...do as a Foot and Ankle Orthopedic Surgeon: Provide expert evaluation, diagnosis, and treatment for foot and ankle conditions, including... 
    Local area

    White Plains Hospital

    New York, NY
    13 hours ago
  • $60.63k - $93k

     ...services to automakers. How You’ll Make An Impact The Senior Specialist, Clearances and Music Rights role supports the Music Licensing...  ...media) and escalate exceptions or non‑standard terms for review. Evaluate rights and usage details to determine clearance path, required... 
    Contract work
    Temporary work
    Local area
    Shift work

    SiriusXM

    New York, NY
    2 days ago
  •  ...Bronx Men’s Homeless Shelter seeks to hire a Full-Time Housing Specialist who will assist residents in seeking and obtaining services...  ...The Housing Specialist will: Conduct housing assessments to evaluate participants’ housing readiness, and overall needs. Facilitate... 
    Permanent employment
    Full time
    Temporary work
    Live in
    Local area
    Monday to Friday

    SEBCO

    New York, NY
    28 days ago
  • $40 per hour

    A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated work and solve technical problems. This fully remote role allows you to choose your projects and schedule, offering competitive pay starting at $40+ per hour. Ideal... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A technology firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative analysis. This fully remote position allows you to choose your projects while ensuring competitive pay starting at $40+ USD per hour. Ideal candidates have 2+ years... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    3 days ago
  • $45.75k - $79k

    ## Sr. Specialist, Customer Advocacy and Resources EducationApplylocations: REMOTE - Pennsylvaniatime type: Full timeposted on: Posted...  ...phone, through email or other means of virtual communication.* Evaluate information provided by a customer to determine the best course... 
    Hourly pay
    Full time
    Contract work
    Work experience placement
    Remote work
    Shift work

    Banco Santander SA

    New York, NY
    1 day ago
  • $101.18k - $120.46k

     ...Senior Shared Services Specialist Argo Group is an underwriter of specialty insurance products in the property and casualty market....  .... Desire to work in a fast-paced environment. Excellent evaluation and strategic skills required. Must possess a strong customer... 
    Work experience placement
    Local area

    Argo Group

    New York, NY
    5 days ago
  • $40 per hour

    A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated work and design problems for AI training. The role offers fully remote work across multiple countries. Candidates should have 2+ years in quantitative roles, strong... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated work and design training problems for advanced AI systems. Responsibilities include ensuring the technical accuracy of analyses and providing feedback to shape AI capabilities... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • $42 - $50 per hour

     ...Job Description Role: Social Emotional Learning (SEL) Specialist About Us: New York Edge is the largest provider of after...  ..., and group work ● Administer pre and post assessments and evaluations for student activities using the organizational Mosaic By ACT... 
    Temporary work
    Part time
    Summer work
    Monday to Friday

    NEW YORK EDGE, INC

    New York, NY
    11 days ago
  • $93.53k - $137.18k

     ...for multiple consecutive years. Overview The Process Technology Specialist I plays a critical role within the Global Process Technology...  ...engineering to define equipment requirements (pumps, mixers, tanks) Evaluate manufacturing capabilities and recommend improvements Sourcing... 
    Work at office

    Solenis

    New York, NY
    4 days ago
  •  ...requirements and turn‑around times of the Expedited Appeal unit, the Specialists are required to work weekends and holidays as the organization...  ...Independently perform triage function: review and evaluate appeal requests; identify and classify member and provider appeals... 
    Remote job
    Hourly pay
    Contract work
    Weekend work

    EmblemHealth

    New York, NY
    2 days ago
  • $80k - $95k

     ...EHS Specialist Delhi New York (US) Quality & HSE 40+ At FrieslandCampina Ingredients, we transform good into great. As a global leader...  ...well as certification standards. Risk Mitigation: Identify and evaluate hazards/risks, and educate others on changes/new regulations.... 
    Work at office
    Local area
    Worldwide

    FrieslandCampina

    New York, NY
    4 days ago
  •  ...unnecessary healthcare costs. Role Overview The Patient Engagement Specialist is a frontline role responsible for connecting eligible...  ...eligibility verification, and scheduling of initial clinical evaluations. As an early-stage startup, we are looking for someone who... 
    Remote job

    RightMove Health

    New York, NY
    3 days ago
  •  ...individuals with disabilities to perform the essential functions unless this causes undue hardship to the company.Performance is evaluated each year based on these competencies and the NADSP code of ethics.EEO StatementBirch Family Services provides equal employment opportunities... 
    Local area
    Work from home

    Birch-Family-Services,-Inc

    New York, NY
    1 day ago
  •  ...screens and physicals. Coordinate and administer DOT regulations in conjunction with Human Resources and Operations (where applicable). Evaluate technical and scientific publications concerned with safety management and participate in activities of related organizations to... 
    Work at office
    Night shift
    Weekend work

    Knife River

    New York, NY
    3 days ago
  •  ...Shipping Specialist Anywhere (Remote) Fulfilment Apply now About Cloudprinter Cloudprinter.com is a leading global print‑on‑demand platform...  ...shipping accounts with carriers in key regions worldwide. Evaluate, select, and onboard new shipping carriers and logistics partners... 
    Contract work
    Remote work
    Worldwide
    Flexible hours

    Cloudprinter.com B.V.

    New York, NY
    3 days ago
  • $17.25 - $20.5 per hour

     ...accommodations may be made to enable qualified individuals with disabilities to perform the essential functions unless this causes undue hardship to the company. Performance is evaluated each year based on these competencies and the NADSP code of ethics. #J-18808-Ljbffr... 
    Hourly pay
    Work at office

    Birch Family Services

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Evaluation Specialist. Be the first to apply!