Evaluation Specialist
AuraOne
AuraOne is seeking a Lingala Bilingual Expert for a remote evaluation track. You will review prompts and responses against a quality rubric, label edge cases, and provide structured feedback for retraining the model. This is a contractor role requiring reliable async availability and US remote eligibility. You will compare outputs, explain your rationale, and document recurring issues to support continuous improvement of the evaluation process. #J-18808-Ljbffr
$10k
.... Position Summary Reporting to the team lead, supports the work of the asthma case manager within the schools. The Program Evaluation Specialist will be expected to provide health education, support and referrals for families of students with asthma. Communicate to OSH...SuggestedPermanent employmentFull timeWork at officeWork from home2 days per week$10k
...educational materials. Work on special projects for the Office of School Health and analyze the training needs of the program. Evaluate the effectiveness of the asthma case management program, develop presentations and materials by utilizing entry and exit...SuggestedPermanent employmentFull timeWork at officeWork from home2 days per week$23 - $26.45 per hour
Appen is seeking Independent Contractors for a remote Audio Evaluation Project. You will listen to two audio recordings per case and decide which is better based on the provided guidelines. The role emphasizes precision, consistency, and adherence to instructions. The...SuggestedRemote jobHourly payFor contractorsWork from homeFlexible hours- ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring...SuggestedFull timeRemote work
$24 - $30 per hour
Mercor is seeking a Moonlight MCQA - Arabic Generalist to draft Arabic MCQs for an AI evaluation dataset. This contract role offers remote work with flexible hours and a process including AI interview based on your resume. Must hold a master's or PhD, 2-6 years of experience...SuggestedRemote jobHourly payContract workFreelanceFlexible hours- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...Remote jobContract workImmediate startFlexible hours
- AuraOne is seeking a remote News Monitoring Task Evaluator to assess evaluation prompts and responses against our quality rubric. You will compare paired outputs, write rationales, and label edge cases to aid model retraining and quality control. Join as a contractor working...Remote jobFor contractors
- The Manhattan Division of The New Jewish Home is seeking a full-time Admissions Evaluator to join their in-person team at an onsite location in New York City. The role includes an incentive bonus of $5,000 and involves coordinating with hospitals and HMOs to evaluate and...Full timeWeekend work
- Dorado is seeking a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny....Remote job
$105k - $140k
Kroll Bond Rating Agency is seeking an Associate/Associate Director to join the Funds Ratings team in New York. This role involves credit research, developing rating tools, and leading credit ratings processes for various funds. The ideal candidate will have a Bachelor...$145k - $180k
...You Make:We are looking for an experienced PolyPath Market Risk Specialist with strong technical and business knowledge to support... ...your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this...Hourly payFull timeContract workWork experience placementShift work$86.21k - $141.64k
...Guardian is seeking a motivated individual to join our team as Lead Specialist, General Audit.This role will support the Head of Corporate... ..., value-add, assurance and advisory services that identify, evaluate, and report on highly complex business risks and controls in...Full timeH1bWork at officeVisa sponsorshipWork visaFlexible hours$162.7k - $220.2k
...is looking for an experienced Information Technology Assurance Specialist to join our fast-paced FSI Security and Compliance team and... ...diligence needs of Financial Services customers during their evaluation of AWS as a cloud provider, the overall trends in the industry...WorldwideFlexible hours- ...offices in New York, London, and Hong Kong, JPMorganChase's PricingDirect employees serve our clients globally by providing them evaluated pricing on over two million fixed income securities and derivative instruments every day.As a Securities Valuation Analyst or Associate...
$230k - $270k
...Safeguards Enforcement Analyst, Safety Evaluations Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want...Work at officeRemote workVisa sponsorshipFlexible hoursShift work$219.1k - $296.5k
AWS Specialist Technology Team (STT) is the connective tissue between AWS's deep technical specialists, field teams, and customers—delivering... ...—working through your product managers to shape roadmaps, evaluate trade-offs, and ensure each product delivers measurable impact...Flexible hours$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$150k - $200k
Hudson River Trading (HRT) is seeking a PostTrade Strategy Specialist to join our PostTrade team in New York City. Encompassing the firm... ...instructed or agreed upon. We employ various methods to evaluate the authenticity of candidate responses. If we determine that...Work at officeLocal areaImmediate start$145.6k - $270.4k
...sponsor visas for this position.The Rheumatology Institutional Specialist (IS) will be responsible for ensuring proper access pull-... ...strategies to meet product access and sales targets. Regularly evaluate key customer needs to provide tailored insights and hospital activities...Full timeLocal areaRemote workHome officeVisa sponsorshipRelocation package- We’re seeking a future team member for the role of Specialist Fund operations to join Private Equity Team. This role is located in New... ...issues regarding fund reports and accounting processes.Assist in evaluating GAAP and/or IFRS rules to determine the impact of new...Work experience placementWork at officeFlexible hours
$207k - $275k
...layer is one of its most important new frontiers. As a Solution Specialist for Data Services, you are the person who opens that frontier... ...ability to manage complex, multi-stakeholder technical evaluations without losing momentum.Why CoreWeave?At CoreWeave, we work hard...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$100k
Job Summary Squarepoint is looking for a Platform Storage Specialist to join our growing global team. The candidate will work alongside... ...related observability, alerting, and incident response processes Evaluate and integrate new storage technologies, including cloud-based...$110k - $130k
...critical infrastructure. You'll independently conduct Critical Environment Gap Assessments for data centers and critical facilities, evaluating MEP systems, identifying infrastructure gaps, and providing actionable recommendations. The position requires managing projects...Full timeWork at officeLocal areaRemote work$103.95k - $180.53k
...at the forefront of aviation technology.Role Overview: The FAA ATEPS II Human Factors Engineer supports the design, development, evaluation, and improvement of air traffic control (ATC) systems by applying human factors engineering principles. This role focuses on optimizing...Full timeContract workPart timeWork at officeLocal areaRemote workWorldwideShift work- ...supervision of the Manager of DDS Print, the Production Control Specialist is responsible for ensuring all Client Service Level... ...deadlinesMicrosoft Office proficient.Broadridge considers various factors when evaluating a candidate's final salary including, but not limited to,...Full timeWork experience placementWork at officeLocal areaFlexible hoursShift work
- ...financial modeling of target markets.You will conduct sensitivity analysis as well as assess and determine market growth. You will also evaluate competitive landscapes and customer feedback, to forecast future state potential of asset and market.You will work with client...ApprenticeshipWork at officeEasy work
$90k - $115k
...highest potential!Why this job’s a big deal:The Workday Integration Specialist is responsible for supporting Priceline’s Workday tenant for... ...HRIS systems. Collaborate with Human Resources personnel to evaluate HRIS software andhardware. Often works with the Payroll Team...Full timeWork experience placementSummer workWork at officeRemote workFlexible hours$93k - $115k
Job TitleSenior Events SpecialistJob DescriptionSenior Events Specialist Join Rabobank as a Senior Events Specialist and help bring our... ...Rabobank offers a flexible hybrid working model and continually evaluates and enhances our benefit offerings to ensure they are...Full timeWork at officeRemote workWorldwideWork visaFlexible hours$100k - $130k
...Trading (HRT) is seeking a highly motivated Margin and Collateral Specialist to join our PostTrade team. Our global trading platform... ...otherwise instructed or agreed upon. We employ various methods to evaluate the authenticity of candidate responses. If we determine that...Work at officeLocal areaImmediate start- Senior Specialist, Fund/Client AccountingAt BNY, our culture allows us to run our company better and enables employees’ growth and success... ...related to fund reports and accounting processes; assist in evaluating GAAP and/or IFRS rules to determine regulatory impact on fund...Work experience placementWork at officeWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation Specialist. Be the first to apply!
- junk removal specialist New York, NY
- correspondence specialist New York, NY
- measurement specialist New York, NY
- disclosure specialist New York, NY
- partnership specialist New York, NY
- absence management specialist New York, NY
- continuous improvement specialist New York, NY
- loss prevention specialist New York, NY
- hospitality specialist New York, NY
- learning management system specialist New York, NY


