Staff AI Evaluation Scientist
Visa Hunt
Reflection Research Lab in San Francisco is seeking a candidate to conduct critical comparative analysis to advance our understanding of model capabilities. You will build and refine evaluation systems that create tight feedback loops between data, evals, and model behavior, and develop generalizable frameworks for reasoning, alignment, and usefulness. Join a fast-moving startup to translate insights into model improvements, collaborate with pre-training, post-training, and applied teams, and #J-18808-Ljbffr Visa Hunt
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff AI Evaluation Scientist in Brooklyn, NY vacancy
- ...Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour... ..., and other content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality...SuggestedHourly payFor contractorsRemote workFlexible hours
CNTXT AI
Brooklyn, NY10 days ago - ...DataAnnotation is looking for a Clinical Specialist to help train AI models in the United States. The role involves evaluating AI outputs related to healthcare and ensuring their accuracy. Candidates must be fluent in English and hold a current or in-progress medical...SuggestedHourly payFor contractorsRemote workFlexible hours
DataAnnotation
Brooklyn, NY1 day ago $35 - $42 per hour
...per weekbased on project availability Help Shape the Future of AI in Finance, Audit & Risk Volga Partners is seeking experienced... ...and legal professionals to join our growing network ofon-call AI Evaluation Specialistssupporting the development, training, and evaluation...SuggestedHourly payExtra incomePermanent employmentContract workTemporary workRemote workFlexible hours$80 per hour
...and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What This...SuggestedPermanent employmentTemporary work$143.62k - $229.79k
Job Description Serve as the senior AI/ML scientist to identify, research, and develop transformational predictive, prescriptive, and Generative... ...that can adapt and evolve over time. Design, implement, and evaluate artificial intelligence (AI) systems that can be used in...Suggested- Relativity Applied Science is seeking a Lead Applied Scientist to set the technical direction for our public-sector investigations work... ...the science end-to-end—from retrieval and review systems to evaluation standards—that make responses complete, correct, and defensible...
$44.02k - $58.68k
...health, and mission alignment. Develop and execute ministry plans, evaluating and modifying as needed. Mobilize students and faculty to... ...Partner with local, area, regional, and national InterVarsity staff and volunteers to maintain biblical standards of excellence and...Full timePart timeWork at officeLocal areaFlexible hours$33.9k - $45.2k
...research and reflection with your teams (students, faculty, and staff) for qualitative and quantitative growth, including conversions... ...alignment Develop and execute plans to achieve annual goals, evaluating and modifying the plan as needed throughout the year Increase...Full timeWork at officeLocal areaFlexible hours- MongoDB’s Voyage AI team is seeking a Staff Research Scientist to advance next-generation AI models, focusing on embedding models and rerankers to enable... ...to cutting-edge information retrieval, LLMs, and evaluation methodologies while collaborating with world-class researchers...Remote job
$170k - $220k
...$220,000.00What’s the role?We’re hiring a Staff Design Program Manager to own the operational... ...inventory, unlocking growth through AI-assisted insights, and reducing friction across... ...and capacity.Build the operating model: Evaluate how the Seller Experience design org currently...Full timeContract workWork at officeLocal areaVisa sponsorshipShift work$105.4k - $207.8k
...to build the data foundations that power the next generation of AI-enabled cyber defense?If yes, then Deloitte’s Cyber team could be... ..., vector or hybrid retrieval, tool or function calling, evaluation or monitoring, prompt-injection defenses, and secure access patterns...Local areaVisa sponsorship- ...transforms how the business operates. We build AI-first, agent-driven products that change... ..., retrieval-augmented generation (RAG), evaluation frameworks, and traditional machine... ...and operational processes.• Mentor data scientists, AI engineers, and analysts on agentic...Full timeTemporary workRemote work
$75k - $90k
...skills training, conducting regular check-ins and performance evaluations, reviewing work product, and providing consistent and effective... ...legal work and support in the professional development of junior staff. Support with data management and grant reporting systems,...Temporary workWork at officeRemote work2 days per weekNew Jersey Consortium for Immigrant Children
Jersey City, NJ5 days ago- ...positive and engaged work environment that promotes teamwork, accountability, and operational excellence. Participate in performance evaluations, disciplinary processes, and corrective action follow-up in partnership with Human Resources. Prepare, manage, and adjust weekly...Work at officeAll shiftsFlexible hoursShift workAfternoon shift
Kerzner International
Brooklyn, NY2 days ago $86.7k - $140.47k
...description Under the leadership of the Borough Director, the staff attorney will work to effectuate the mission of CLC. The staff... ...legal strategy and facilitate its implementation; Properly evaluate the strengths and weaknesses of a case; Explore alternatives...Full time2 days per weekChildren's Law Center
Brooklyn, NYa month ago$25 per hour
...DataAnnotation We are looking for a Bilingual Copyeditor (Chinese/English) to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need...Hourly payFull timeContract workPart timeRemote workDataAnnotation
Brooklyn, NY4 days ago- ## AI Literacy SpecialistApplylocations: Ruby Memorial Hospital (WVUH)time type: Full timeposted on: Posted Yesterdayjob requisition... ...participation, adoption metrics, and user engagement to evaluate program effectiveness and identify improvement opportunities.10....Work at officeLocal areaRemote workShift work
- Innodata Inc. is seeking a Generative AI Specialist to join our global contributor community as part of the SME on Demand program.... ...offering flexible scheduling and global scope. You’ll help train and evaluate language models, label data, create prompts, and generate...Remote jobPart timeFlexible hours
- QCi in Hoboken, NJ is hiring a Research Scientist to develop quantum and AI computational structures for chip-scale implementation. The role involves high-fidelity simulation, feasibility analysis, and collaboration with fabrication teams. A Ph.D. in a relevant field is...
- Moderna is seeking a Scientist to contribute to AI-enabled design of de novo antibodies and binder modalities, and de novo design of antigens across discovery programs. This is a hands-on computational protein design role applying generative methods, agentic AI workflows...
- ...00 AM Care Initiatives is now hiring an AI Innovation Specialist to join our team. As... ...is responsible for identifying, evaluating, piloting, documenting, and supporting the... ...Support and document AI pilots Develop staff training and guidance Ensure AI adoption...Immediate startHome office
$15 per hour
Innodata Inc. is seeking a Generative AI Associate for a flexible, part-time role focused on the evaluation of AI models and language processing. This innovative position allows contributors to engage in cutting-edge AI development while maintaining flexible hours. Applicants...Remote jobHourly payPart timeFlexible hours- Innodata Inc. is seeking a Generative AI Associate for a flexible, part-time, remote project-based role. The SME on Demand will contribute to AI development by labeling, evaluating, and transforming data to train large language models. The position supports diverse contributors...Remote jobPart timeWorldwideFlexible hours
$25 per hour
...A leading AI training company is seeking a Korean-English Language Instructor to help train AI models based in the United States.... ...entry-level position, you will measure the progress of AI chatbots, evaluate their logic, and enhance model quality through innovative...Hourly payRemote workDataAnnotation
Brooklyn, NY1 day ago- ...emerging data science, machine learning, AI, and GenAI capabilities that create measurable... ...-ready solutions. The Principal Data Scientist / Machine Learning Engineer will design... ...feature engineering, model optimization, and evaluation. Oversee the application of advanced...Remote workFlexible hours
$16 per hour
...discrimination. Reasonable accommodations will be made for disabled team members. Resumes and applications for employment will be evaluated based on qualifications and the ability to meet the position's requirements. All Stonebridge openings are projected to close...Hourly payFull timePart timeSeasonal workFlexible hoursWeekend workAfternoon shiftStonebridge Companies
North Bergen, NJ4 days ago- ...Exempt About the Role We are seeking a motivated and knowledgeable Staff Environmental Specialist to support and maintain environmental... ...and capital projects, including permitting and regulatory evaluations. Monitor changes in environmental regulations and communicate impacts...Full timeFor contractorsWork at officeLocal area
- Shield AI is seeking a Staff Operational Analyst to contribute to modeling, simulation, and analysis of its aircraft systems. You will perform... ...at the component, system, mission, and campaign levels to evaluate effectiveness, survivability, and operational impact in...
- micro1 is seeking a Federal Reporting & Staff Writing Expert for remote contract work in the United States. You... ...high-quality written responses, rubric-based evaluation, and collaboration with a team to train AI models in federal reporting contexts. Experience in...Remote jobContract work
$172.5k - $260.1k
## Staff Business Intelligence ArchitectApplyremote type: Office Tech-Flexiblelocations: California... ...*About Salesforce****Salesforce is the #1 AI CRM, where humans with agents drive... ...identify trends, measure performance, and evaluate business opportunities.* Build intuitive...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff AI Evaluation Scientist. Be the first to apply!
