Senior AI Benchmark Problem Designer (Contract)

Lifted, an Upwork Company™

SmartRecruiters, Inc. seeks a seasoned technical expert to design and present hard problems for AI benchmarking.

You will craft tasks in a Linux terminal drawn from your domain, ensuring they resist current frontier models when tested by multiple AI systems. Ideal candidates hold a Masters or higher, 10+ years of experience in a technical field, at least one publication, and demonstrated coding, systems, and security expertise.

#J-18808-Ljbffr

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Senior AI Benchmark Problem Designer (Contract) in Florida, FL vacancy

AI Evaluator - English
$15 per hour
...innovative companies improve their AI models by providing human... ...zooming in and replaying, to spot problems like distorted anatomy, flickering... ...internal policies and programs designed to protect personal data. This is a 1099 contract opportunity on the Outlier.ai platform...
Contract work
Hourly pay
Freelance
Internship
Remote work
Flexible hours
Outlier
Florida, FL
6 hours ago
Senior QA Automation Engineer
...coverage with the QA Manager, and leveraging AI tools to improve coverage and efficiency... ...testing practices with peers, and raising design concerns early enough to prevent defects... ...hats in a fast-paced environment Strong problem-solving and collaboration skills, with the...
Senior
Full time
Temporary work
Remote work
Flexible hours
Nucleus Security
Florida, FL
more than 2 months ago
Sr. Substation Commissioning Engineer - East Region
...Summary Verification that Transmission Substation Equipment is commissioned in compliance with project contract and specification requirements, conforms to design operational feasibility, and is set up and tested per the supplier’s requirements, within the engineer’s...
Contract work
Senior
Immediate start
Black & Veatch Family of Companies
Florida, FL
a month ago
Senior Product Manager - Cloud Infrastructure & GPU Platforms | Remote
...BASED APPLICANTS ONLY** We are in search of a highly technical Senior Product Manager to lead the strategy and roadmap for next-generation... ...partners to develop scalable infrastructure products supporting AI, HPC, enterprise, and cloud workloads. **What You’ll Do** *...
Senior
Remote work
Nomad Search Partners
Florida, FL
a month ago
Water Treatment Operator/ Water Tester
...Operator/ Water Tester Location: Homestead, FL Duration: 11 Month Contract Status: Onsite Employment Type: Contract role on W-2 through... ...and occupational health and safety systems. Strong analytical, problem-solving, and organizational skills. Performance Objectives / What...
Contract work
For subcontractor
Above and Beyond Talent Acquisition
Homestead, FL
4 days ago
Launch Manager
...vibrant membership community designed to support and empower women founders... ...the advertising specialist, contract copywriters, agencies, and... ...You're a strong, resourceful problem solver who's comfortable figuring... ...re on the pulse of the latest AI tools and how to use them for...
Contract work
Full time
For contractors
Entreprenista
Florida, FL
a month ago
Regional Field Service Manager
...reputation is grounded in reliability, practical design, and a customer base that depends on... ...efforts, proposals, and service contract structuringIdentify new service opportunities... ...leadership, communication, analytical, and problem-solving capabilitiesWhat You'll Get at ODRAA...
Contract work
Full time
For contractors
ODRA Road Sweepers
Florida, FL
6 days ago
Psychological/Mental Health Technician
...behavioral, or psychological problems. Perform work independently... ...planning stages and contingent on contract awards. By applying to... ...healthcare and technology solutions designed to improve outcomes and... ...program. Loyal Source uses AI?powered voice screening as part...
Contract work
For contractors
For subcontractor
Worldwide
Loyal Source
Homestead, FL
1 day ago
CORRECTIONAL PROBATION SENIOR OFFICER
...Correctional Probation Senior Officer - 70007554The incumbent in this position is responsible for supervising, surveilling and maintaining... ...and analyze data, ability to assist offenders in solving problems, ability to conduct investigations, ability to apply laws, rules...
Senior
Work at office
Trial period
Florida Jobs
Florida, FL
5 days ago
Nurse Case Manager
...procedures in clinical settings in order to analyze the full scope of problems associated with providing appropriate, cost effective care to... ...the MTF they are credentialed through.Please note: this position is notional and contingent upon the award of a government contract....
Contract work
For contractors
Local area
Loyal Source
Homestead, FL
5 days ago
Data Scientist II
...contingent upon the award of a government contract. About Notional Opportunities: Notional... ...healthcare and technology solutions designed to improve outcomes and support mission-critical... ...Partnership program. Loyal Source uses AI-powered voice screening as part of our...
Contract work
For contractors
For subcontractor
Work at office
Worldwide
Loyal Source
Homestead, FL
2 days ago
Project Manager - Nuclear
$70 - $75 per hour
...Manager - Nuclear-Level 4 on behalf of our client. This is a 1-year contract assignment (W-2). You will manage and lead a project from... ...and timeframe. Individuals maintain project momentum, surface problems and recommendations, report completion status, and control costs...
Contract work
Westinghouse Electric Company
Florida, FL
5 days ago
Rehabilitation Physical Therapist
Encompass Health is seeking a contract Physical Therapist to provide high-quality, evidence-based rehabilitation for patients recovering from stroke, brain and spinal cord injuries, complex orthopedic conditions, and other serious illnesses. In this role, you will perform...
Contract work
Encompass Health
Florida, FL
1 day ago
Customer Service Associate I
...requiredStrong organizational and communication skills are requiredStrong problem-solving and decision-making skills are requiredPerks and... ...by their supervisor.Please note, this job description is not a contract of employment and may be modified to meet evolving business...
Contract work
Part time
Local area
Dollar Tree
Florida, FL
4 days ago
Sr Manager SAP Security Architect
...This role owns security architecture and design across the Enterprise Solutions portfolio.... ...together with the Azure services and the AI and agentic platforms that increasingly surround... ...~ Experience influencing and advising senior stakeholders and delivery teams as a recognized...
Senior
Visa sponsorship
Deloitte LLP
Florida, FL
20 days ago
Water Sampling Technician - Hurlburt Field, FL
...Responsibilities The technician will collect water samples at designated locations on Hurlburt Field in accordance with applicable... ...Copper, and other required compliance samples during applicable contract years. Lead and Copper: Periodically collect first-draw tap...
Contract work
Full time
Part time
For contractors
Local area
I-2-I Solutions, Inc.
Florida, FL
a month ago
Program (Contract Manager)
$114.45k - $127.17k
...Posting ID: KT_[271]_JOB Position: Program (Contract) Manager FT/PT Status: Full-Time... ...• Strong leadership, decision-making and problem-solving skills. • Strong written and... ...communication skills, including presenting to senior leaders. • Ability to work...
Contract work
Full time
Work at office
Remote work
Kreative Technologies
Florida, FL
24 days ago
Locum Physician (MD/DO) - Emergency Medicine in Central Florida, FL
...Personnel Pay: Competitive weekly pay (inquire for details) Contract Duration: 2 Weeks Start Date: ASAP About the... ...address Required certifications: ACLS, PALS, ATLS (trauma-designated sites as applicable) Credentialing / Onboarding ~...
Contract work
Weekly pay
Full time
Temporary work
Locum
Immediate start
All Medical Personnel
Florida, FL
1 day ago
Psychiatric-Mental Health Nurse Practitioner
...contingent upon the award of a government contract.About Notional OpportunitiesNotional... ...provides healthcare and technology solutions designed to improve outcomes and support mission-critical... ...Partnership program.Loyal Source uses AI?powered voice screening as part of our...
Contract work
For contractors
For subcontractor
Local area
Worldwide
Loyal Source
Homestead, FL
5 days ago
Locum Physician (MD/DO) - Emergency Medicine in Central Florida, FL
...Location: Central Florida, FL Employer: All Medical Personnel Pay: Competitive weekly pay (inquire for details) Contract Duration: 2 Weeks Start Date: ASAP About the Position Emergency MD Location Bartow, FL Schedule 12-hour shifts...
Contract work
Weekly pay
Full time
Temporary work
Locum
Immediate start
Shift work
All Medical Personnel
Florida, FL
1 day ago
Locum Physician (MD/DO) - Family Practice in Central Florida, FL
...Location: Central Florida, FL Employer: All Medical Personnel Pay: Competitive weekly pay (inquire for details) Contract Duration: 2 Weeks Start Date: ASAP About the Position Specialty : Family Nurse Practitioner Shifts : Ongoing...
Contract work
Hourly pay
Weekly pay
Daily paid
Full time
Work experience placement
Locum
Immediate start
Shift work
All Medical Personnel
Florida, FL
1 day ago
Enterprise Security Systems Architect (Physical ) -Remote
...Enterprise Security Systems Architect ( Design & Pre-Construction) Contract: 6 months + Location: US-based, remote with travel for site surveys The role Design authority for enterprise physical security deployments - surveillance, access control...
Contract work
For contractors
Local area
Remote work
Accliive Inc
Florida, FL
3 days ago
SIGINT Target Digital Network Analyst
$77.5k - $176k
...education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The... ...picture to verify your identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work at Booz Allen, and we...
Contract work
Full time
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Homestead, FL
5 days ago
Locum Nurse Practitioner (NP) - Family Practice in Central Florida, FL
...Location: Central Florida, FL Employer: All Medical Personnel Pay: Competitive weekly pay (inquire for details) Contract Duration: 2 Weeks Start Date: ASAP About the Position Primary Care NP Location: Florida Schedule: Ongoing per...
Contract work
Hourly pay
Weekly pay
Daily paid
Full time
Temporary work
Locum
Immediate start
Day shift
All Medical Personnel
Florida, FL
1 day ago
Locum Nurse Practitioner (NP) - Family Practice in Central Florida, FL
...Location: Central Florida, FL Employer: All Medical Personnel Pay: Competitive weekly pay (inquire for details) Contract Duration: 2 Weeks Start Date: ASAP About the Position Specialty : Family Nurse Practitioner Shifts : Ongoing per...
Contract work
Hourly pay
Weekly pay
Daily paid
Full time
Temporary work
Work experience placement
Locum
Immediate start
Shift work
All Medical Personnel
Florida, FL
1 day ago
Locum Nurse Practitioner (NP) - Family Practice in Central Florida, FL
...Location: Central Florida, FL Employer: All Medical Personnel Pay: Competitive weekly pay (inquire for details) Contract Duration: 2 Weeks Start Date: ASAP About the Position Primary Care NP | Florida Schedule Schedule: Ongoing per...
Contract work
Hourly pay
Weekly pay
Daily paid
Full time
Temporary work
Locum
Immediate start
Day shift
All Medical Personnel
Florida, FL
1 day ago
Healthcare Construction Project Executive - OCONUS / International
...assigned projects via operational and financial systems reporting. Ensures project document controls are in compliance with contract requirements. Responsible for overall program asset management including collections, cost control, progress billings and payables...
Contract work
Full time
For subcontractor
Remote work
Work from home
Worldwide
Overseas
Johnson Controls
Florida, FL
1 hour ago
Avionics Technician
$42 - $63 per hour
...engineering and production teams. Strong problem-solving skills for troubleshooting and... ...standards are central to daily work. Contract: $42/hr, $63/hr OT, up to $500 mileage... ...liability. Use of Artificial Intelligence (AI): We may use Artificial Intelligence (...
Contract work
Weekly pay
Temporary work
Relocation
Shift work
Aerotek
Homestead, FL
3 days ago
Senior Quality Inspector - CIC
...Senior Quality Inspector - CICHomestead, Florida, United StatesAST SpaceMobile is building... ...extensive IP and patent portfolio and designed for both commercial and government applications... ....Strong communication, leadership, and problem-solving skills.Preferred SkillsIPC or...
Senior
AST SpaceMobile
Homestead, FL
1 day ago
Project Manager
...to get the job done, and our staff is well trained in its use. We make sure the job gets done right the first time and without any problems. Call us today! Company Description Specialties\r\nWe specialize in residential, commercial, industrial, and service-based...
For contractors
For subcontractor
Seaway Plumbing Inc
Homestead, FL
13 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Benchmark Problem Designer (Contract). Be the first to apply!