Technical Experts needed to stump AI Models
Lifted, an Upwork Company™
This enterprise client helps the world’s most innovative companies improve their AI models by providing human feedback.
Job Description
Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.
The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.
Qualifications
Who we need:
- Masters degree or higher
- 10+ years of professional experience in a technical domain
- At least one publication (academic or professional)
Domains in demand:
- Coding
- Machine Learning
- Systems
- Security
- Hardware
Additional Information
- This is an ongoing project — at least 7 weeks
- Onboarding process is approximately 90 minutes total
- ...companies improve their AI models by providing human... ...build a benchmark of real, expert-level problems that today... ...terminal. The goal: stump the model. A task... ...Qualifications Who we need: ~ Masters degree or... ...experience in a technical domain ~ At least one...SuggestedTemporary work
- ...professional who combines deep technical expertise with good... ...serve as both a subject matter expert and a product ambassador, translating... ...applications and modules (e.g., HRSD, AI/ML) for new and existing... ...service level agreements, and data models. Set up and support...SuggestedVisa sponsorship
- Our Deloitte AI & Engineering team to transform technology platforms... ...Deploy and manage ML models in production, including endpoints... ...platform reliability Document technical processes, operating... ...are tailored for each client's needs, offering engineering-led Advise...SuggestedWork at officeLocal areaRelocationFlexible hoursNight shift
- ...with a full-stack portfolio of AI-enabled, AI-ready, and AI-... ...Services team is looking for a Technical Consultant for Power and Cooling... ...critical engineering subject matter experts to determine the solution... ...build vs. buy decisions as needed, and identify key technologies...SuggestedFull timeWork at officeRemote work
- ...Personal Finance Experts For Ai Training Enterprise client helps the world's most innovative companies improve their AI models by providing human feedback. We are seeking a high volume... ...schedule is flexible. Talent will not need to follow any specific schedule and...SuggestedSelf employmentFreelanceFlexible hours
- ...industry , particularly big tech, innovative companies, start-ups, and system integrators, through a predominantly hybrid-offshoring model; # To promote US and European innovation in both directions, leveraging its Corporate Innovation and Business Development...Flexible hours
- ...including PNCWM, PNC Private Bank, Business Banking and Mortgage. Identifies the resource or team of resources best equipped to meet client needs and introduces the client accordingly. Holds partners accountable for routine updates and referral follow up. Client experience...Full timeTemporary workPart timeWork experience placementWork at office
- ...relationships Builds role as the internal and external mortgage expert; builds and maintains good relationships with customers; and... ...expertise, product knowledge, and knowledge of the customer's financial needs, goals, and circumstances Required Qualifications,...Work experience placementLocal areaImmediate startRelocation
- CAC I International Inc. is seeking a Sensitive Activities Advisor to provide SME support across planning to execution of sensitive activities, including information operations and specialized programs, in direct support to national defense objectives. The role emphasizes...
$120k - $160k
...The advisor is required to be effective in the application of technical skill sets as it applies to planning, execution, and tracking measures... ...on product development. Willing to work rotating shifts if needed Associates degree and five years of experience or seven years...Full timeContract workWork experience placementLocal areaFlexible hoursRotating shift- Job Description Job Description ROLE DESCRIPTION: As a Financial Services Representative with Michael Hodge State Farm, you will successfully market the financial products that manage everyday risks. Your proficient knowledge of financial products reinforces your...Work from homeFlexible hours
- Educational Federal Credit Union seeks a Member Advisor to provide exceptional member service as a consultant on deposits and loan transactions, new accounts, closings, and referrals to credit union products and services. The role includes processing a variety of member...
- Magellan Federal in Homestead, FL seeks a Personal Financial Counselor to deliver comprehensive financial counseling to service members and their families at military installations. Responsibilities include one-on-one counseling, group briefings, and the development of ...
$58.44k - $93.5k
...financial counseling sessions with service members and their families. Consult with military commanders or other staff to address financial needs. Deliver briefings and presentations to groups on financial topics. Provide referral resources to participants outside of counseling...Contract workTemporary workWork at office- ...# Review information for completeness and accuracy before and after data entry. # Update and correct information in CARISK as needed and as authorized. # Assist with monitoring data-entry requirements and identifying missing, incomplete, or inconsistent information...Work at office
- ...engages clients in meaningful, consultative conversations to understand their financial goals and align on solutions that meet their needs. In this role, you will drive growth by actively promoting and selling the bank's products and services. This role emphasizes...Temporary workWork at officeMonday to Friday
- Need Help? If you have a disability and need assistance with the application, you can request a reasonable accommodation. Send an email to Accessibility (accommodation requests only; other inquiries won’t receive a response). Regular or Temporary: Regular Language...Full timePart timeWork at officeShift workNight shiftWeekend workDay shift
- ...phone through the development and expansion of new and existing client relationships. Provides financial solutions that meet client needs based on consultative conversations and referrals to other business partners for additional business growth opportunities. Will be cross...Full timeTemporary workPart timeWork at officeShift workNight shiftWeekend workDay shift
- ...client service-focused Banking Associate to build relationships and cross-sell financial solutions. You will handle teller duties as needed, work to meet client service and branch sales targets, and collaborate with internal specialists to address complex needs. Strong...Temporary workWeekend work
- ...building upon that we expect our employees to be: Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized...Full timeTemporary workPart timeWork experience placementWork at office
- Truist is a leading financial services company seeking a Retail Banking Associate in Florida. You will deliver a superior client experience in person and over the phone while expanding client relationships and cross-selling financial solutions. The role requires a high ...Weekend work
- ...Financial Services Representative I in Homestead, FL to deliver high-quality member service and cross-sell products that meet financial needs. The role requires travel within the branch network within a 15 mile radius to support staffing at all locations. You will handle...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Experts needed to stump AI Models. Be the first to apply!


