Evaluation Specialist
Aaru
Aaru in New York City seeks an Evaluation Researcher to tackle measurement problems at the boundary of ML, statistics, and behavioral science. You will define constructs, assemble data, design studies, write analysis code, and clearly communicate uncertainty. You will build reusable evaluation Rails and Carts, conduct end-to-end studies, and work with Population Research, Prediction Research, and Deployment while keeping final measurements independent and trustworthy. #J-18808-Ljbffr
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Evaluation Specialist in New York, NY vacancy
- ...Mercor seeks experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations...Suggested
Mercor Inc
New York, NY3 days ago - ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring...SuggestedFull timeRemote work
- Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project. You will evaluate paired video outputs, score them against a rubric, and document brief rationales. This is a short-term, flexible engagement for researchers with...SuggestedTemporary workFlexible hours
- ...experts to contribute to a high-impact video AI research project with a leading lab. We're looking for detail-oriented annotators to evaluate short video clips. In each task you'll watch two videos side by side, compare them against a provided rubric, and score them. This...SuggestedTemporary workFlexible hours
- ...the code is actually constructed. Structure and responsiveness are explicitly part of the rubric, not just the render. This is evaluation work, not authoring. The defining skill is not that you can build a page - it's that you can open someone else's page and tell how...SuggestedAgency workLocal areaImmediate start
- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...Remote jobContract workImmediate startFlexible hours
- ...relevance. This is a great opportunity for professionals with strong analytical skills and domain expertise to contribute to high-impact evaluation projects. Basic Qualifications Bachelor’s degree (minimum) At least 3+ years of professional experience in a relevant domain...
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Key Responsibilities Compare AI-generated...Hourly payImmediate startFlexible hours
$105k - $140k
Kroll Bond Rating Agency is seeking an Associate/Associate Director to join the Funds Ratings team in New York. This role involves credit research, developing rating tools, and leading credit ratings processes for various funds. The ideal candidate will have a Bachelor...Kroll Bond Rating Agency
New York, NY2 days ago$145k
...Make: We are looking for an experienced PolyPath Market Risk Specialist with strong technical and business knowledge to support... ...your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this...Hourly payFull timeContract workWork experience placementShift workSantander Holdings USA Inc
New York, NY18 hours ago- The TemPositions Group of Companies in New York is hiring an experienced Vocational Evaluation Supervisor. This role involves leading a team that assesses work readiness and vocational skills for individuals in a workforce development program. Responsibilities include...
$86.21k - $141.64k
...Guardian is seeking a motivated individual to join our team as Lead Specialist, General Audit.This role will support the Head of Corporate... ..., value-add, assurance and advisory services that identify, evaluate, and report on highly complex business risks and controls in...Full timeH1bWork at officeVisa sponsorshipWork visaFlexible hours$162.7k - $220.2k
...is looking for an experienced Information Technology Assurance Specialist to join our fast-paced FSI Security and Compliance team and... ...diligence needs of Financial Services customers during their evaluation of AWS as a cloud provider, the overall trends in the industry...WorldwideFlexible hours- ...role suits analytical professionals with strong written communication skills who can apply structured guidelines to high-impact evaluation projects across consumer-facing domains. You will contribute to quality control and documentation standards while collaborating with...
$230k - $270k
...Safeguards Enforcement Analyst, Safety Evaluations Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY About the Role Anthropic's Safeguards team is responsible for enforcing our policies, protecting users...Work at officeRemote workVisa sponsorshipFlexible hoursShift workAnthropic
New York, NY17 hours ago- ...offices in New York, London, and Hong Kong, JPMorganChase's PricingDirect employees serve our clients globally by providing them evaluated pricing on over two million fixed income securities and derivative instruments every day.As a Securities Valuation Analyst or Associate...
$219.1k - $296.5k
AWS Specialist Technology Team (STT) is the connective tissue between AWS's deep technical specialists, field teams, and customers—delivering... ...—working through your product managers to shape roadmaps, evaluate trade-offs, and ensure each product delivers measurable impact...Flexible hours- Mercor in the United States is seeking expert Evaluators in Healthcare / clinical to review AI-generated materials for accuracy, rigor, and domain quality. You’ll apply deep subject-matter expertise to grade outputs and provide structured feedback. This is a remote, hourly...Remote jobHourly payWork at office
- ...transactions and reports to detect and prevent fraudulent, suspicious, or erroneous activity.Conduct ACH risk assessments and audits to evaluate the bank's compliance with the ACH rules and regulations, as well as internal policies and procedures.Apply ACH risk management...Hourly payBank staff
$110k - $120k
...major financial centers.The OpportunityWe are seeking a Senior Specialist, Events to join our Firm. This position will be based in our... ...include scoping event requirements and budgets, sourcing and evaluating venues, negotiating, and finalizing hotel contracts in coordination...Full timeWork at officeLocal areaRemote workShift work$207k - $275k
...requirements as instinctively as they do. As a Principal Solution Specialist for Infrastructure, you sit at the center of how CoreWeave... ...production systems to enterprises scaling global AI deployments, evaluate, procure, and operationalize infrastructure, including the...Permanent employmentFull timeContract workTemporary workCasual workWork at officeFlexible hours- ...Improvement plans, targeting efficiencies, enhancing processes, and specialist review functions.Provide input into methodologies and review... ...regarding fund reports and accounting processes.Assist in evaluating GAAP and/or IFRS rules to determine the impact of new regulations...Work experience placementWork at officeWorldwideFlexible hours
$75 per hour
...Medical Coder AI Content Evaluator (Remote) This role focuses on applying medical coding and healthcare operations expertise to assess and improve AI-generated content. You will evaluate AI responses related to healthcare operations, medical coding, and reimbursement...Remote jobContract workTemporary workWork at officeFlexible hours$101.18k - $120.46k
...Inc. Job Description Business Title(s): Senior Shared Services Specialist Employment Type: Full-Time FLSA Status: Exempt Location:... ...negotiation. Desire to work in a fast-paced environment. Excellent evaluation and strategic skills required. Must possess a strong customer...Full timeWork experience placementLocal areaArgo Group
New York, NY1 day ago- ...financial modeling of target markets.You will conduct sensitivity analysis as well as assess and determine market growth. You will also evaluate competitive landscapes and customer feedback, to forecast future state potential of asset and market.You will work with client...ApprenticeshipWork at officeEasy work
$198k - $264k
...live in their own or a partner's facility. As a GTM Solution Specialist for Omni, you are the market-maker for this offering: you identify... ...with product, engineering, operations, legal, and finance to evaluate each opportunity against Omni's decision framework: minimizing...Permanent employmentFull timeContract workTemporary workCasual workLive inWork at officeLocal areaFlexible hours- Senior Specialist, Fund/Client AccountingAt BNY, our culture allows us to run our company better and enables employees’ growth and success... ...related to fund reports and accounting processes; assist in evaluating GAAP and/or IFRS rules to determine regulatory impact on fund...Work experience placementWork at officeWorldwideFlexible hours
$160k - $180k
...Full-TimePosition SummaryThe Technology Governance and Controls Specialist serves as a First Line of Defense (1LoD) control function... ...identification, control mapping, control testing, control effectiveness evaluations, issue identification, action plan development, remediation...Local area$90k - $115k
...highest potential!Why this job’s a big deal:The Workday Integration Specialist is responsible for supporting Priceline’s Workday tenant for... ...HRIS systems. Collaborate with Human Resources personnel to evaluate HRIS software andhardware. Often works with the Payroll Team...Full timeWork experience placementSummer workWork at officeRemote workFlexible hours- ...manner which is safe to the member and consistent with a passing score on the ‘Ear Impression Certification Exam’. Completes hearing evaluations, makes product recommendations, takes ear impressions, orders product, delivers and makes programming adjustments to hearing...Full timeTemporary workApprenticeshipWork at office
Elijahhouseliving
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation Specialist. Be the first to apply!
Related searches
- live chat specialist New York, NY
- configuration specialist New York, NY
- localization specialist New York, NY
- intervention specialist New York, NY
- investigations specialist New York, NY
- referral specialist New York, NY
- ecommerce specialist New York, NY
- workforce management specialist New York, NY
- community health promotion specialist New York, NY
- title specialist New York, NY