LLM Evaluation Architect - Remote Contract
$45 - $140 per hourMercor
Austin, TX
- Remote job
Mercor is looking for a Code-Data Eval Author — Machine Learning Engineer, responsible for designing ML/LLM evaluation tasks and collaborating with AI research teams. The role is remote with a commitment of 30+ hours per week and offers competitive compensation of $45–$140/hour. The ideal candidate has 5+ years of experience in machine learning engineering, proficiency in PyTorch and JAX, and strong written communication skills. Join us to enhance AI model performance! #J-18808-Ljbffr Mercor
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the LLM Evaluation Architect - Remote Contract in Austin, TX vacancy
- Role Overview Join to apply for the AI QA Trainer - LLM Evaluation role at Invisible Expert Marketplace. Large‑scale language... ...health insurance and PTO do not apply. Employment type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level #J-18808-Ljbffr...Contract workRemote workHourly payFor contractorsFreelance
- ...Job Title: Test Architect Job Summary:... ...projects and teams. Evaluate and recommend testing... ...Service Virtualization and Contract Testing.... ...Location: Remote / Hybrid / On-site... ...Generative AI validation, and LLM testing frameworks....Contract workRemote workFull timeShift work
Ova Technologies
United States1 day ago $100 - $125 per hour
...Elevate your career as an LLM Architect with an exciting contract opportunity that allows you to work remotely while leveraging your expertise in AWS. In this role, you will be responsible for designing and implementing advanced solutions that utilize AWS products....Contract workRemote work$40 per hour
...a Senior Software Engineer focused on LLM Evaluation and Repository Validation, you will play... ...no medical/paid leave). Duration of Contract: 3 months; expected start date is next... ...software development while working in a fully remote environment on cutting-edge projects....Contract workRemote workFor contractorsSaidGig
United States23 days ago$15 - $20 per hour
Mercor is looking for a Generalist to evaluate AI model responses while working remotely. Candidates must be native Malayalam speakers with a Bachelor’s degree... ...data to enhance AI performance. The position is contract-based with compensation ranging from $15 to $20 an hour...Contract workRemote job$136k - $204k
...requires: The Practice Architect I (PA I) - AI/ML... ...execution, adherence to contract attributes and costing... ...experience designing, evaluating, and guiding Generative... ...large language model (LLM) use cases, prompt engineering... ...Type This is a fully remote position. Application...Contract workRemote workPermanent employmentFull timeTemporary work$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Remote workPart time$40 per hour
...Overview: This position focuses on building LLM evaluation and training datasets aimed at... ...no medical/paid leave). Duration of contract: 3 months with an expected start date... ...Eligibility: This position is fully remote. Open to candidates with the required...Contract workRemote jobFor contractorsSaidGig
United States6 days ago- Vice President / Smart Contract Architect We're seeking a future team member... ...to platform and tooling evaluation to improve developer experience... ...assisted software development, LLM tooling, or developer... ...•Experience working across remote or cross-functional teams in...Contract workRemote work
- ...Professional Services Automation) Architect to join our dynamic IT team.... ...which spans project and contract set-up, customer accounts, billing... ...leadership. * Continuously evaluate and optimize Workday PSA... ...desirable. #Futureoftech #LI-REMOTE Learn more about our EEO &...Contract workRemote work
Fortrea
Durham, NC4 days ago $107.9k - $195.05k
...Description Leidos is seeking an Architect to join the National Airspace System Integration Support Contract (NISC IV) team. In this... .... This position is fully remote - you must live in the... ...facilities ~ Experience in evaluating building enclosures including...Contract workRemote workLive inLocal areaImmediate startLeidos
Reston, VA1 day ago$175k
...Aviation Architect / Project Manager – Orlando, FL Full-time We are... ...profile projects at Orlando In... Remote Salesforce Architect Full-... ...Engineer – Orlando, FL – Contract Job Location: Orlando, FL Job... ...Leading the treasury department, evaluating financial statuses, and...Contract workRemote workFull timeITL Corp
Orlando, FL4 days ago- ...We are seeking a talented Architect who will produce and refine project... ...a hybrid work schedule with remote work on Mondays and Fridays,... ...Type & Location This is a Contract to Hire position based out of... ...sourcing, screening, and evaluating candidates. AI helps assess applications...Contract workRemote workTemporary workWork at officeLocal areaMonday to Friday
Actalent
Chicago, IL1 day ago - ...Job Role NET Architect Location Remote USA but travel once or twice in a quarter all expenses... ..., NYC & NJ) Duration 12+ Month Contract Must Skills – Interview Parameters... ...primary); Python / TypeScript (POCs and evaluation harnesses) Cloud Azure — AKS,...Contract workRemote work
InterSources
United States1 day ago - ...seeking a highly experienced DevOps Architect to lead the design,... ...Location Location: Canada / USA (Hybrid/Remote) Employment Type Employment Type: Contract Key Responsibilities Lead infrastructure... ..., and transformation programs Evaluate emerging technologies and define...Contract workRemote workWork at office
Infocodec Insurance
Raleigh, NC2 days ago $25 - $30 per hour
...seeking independent contractors from the United States to assist in training AI chatbots. This role involves creating diverse prompts, evaluating model outputs, and engaging in independent research. Applicants can choose their projects and work from home, with pay starting...Contract workRemote jobHourly payFor contractorsWork from homeFlexible hours- ...Subject Matter Expert to design challenging evaluation questions that assess advanced AI models... ...in bioinformatics domains. This remote position requires a Master’s degree or PhD... ...commitment of at least 30 hours per week with a contract duration of 2 months. #J-18808-Ljbffr...Contract workRemote job
- ...Summary We are seeking an Okta Architect/SME to assess our current... ...Responsibilities Review and evaluate existing Okta architecture. Recommend... ...teams. This is a 3-month Contract with our Kansas City-based... .... No third-parties, please. #remote Seniority level Mid-Senior level...Contract workRemote work
- ...Job Title: O365 Integration Architect Location: Arlington, VA Eligibility:... ...Solution (DEOS) Cloud Service Offering contract. This position is a combination of remote (20%) and onsite (80%) support at... ...quality assurance reviews and evaluation of existing and new software...Contract workRemote work
Arena Technical Resources
Arlington, VA4 days ago - SME Careers is hiring a Brand & Strategy Subject Matter Expert (SME) for a remote contractor role. You will evaluate AI-generated brand strategies and create expert content to improve AI outputs. This position requires strong brand strategy expertise and a minimum of 5...Contract workRemote jobFor contractors
- ...Subject Matter Expert to develop rigorous evaluation questions for advanced AI models. This... ...or R. The successful candidate will work remotely on cutting-edge AI projects, with a... ...commitment of at least 30 hours per week and a contract duration of 2 months. Join us in...Contract workRemote job
$135k - $216k
...Senior Cyber Architect Job Locations US-AK-Anchorage... ...Traffic Control System (BNATCS) contract. As a trusted partner to the... ...design and implementation. Evaluate technical solutions for alignment... ...travel to field sites and remote locations, as required. Ability...Contract workRemote workShift workPeraton
Anchorage, AK1 day ago- ...We are looking for a "ServiceNow Solution Architect " Location: Remote USA J ob Type: Contract Job Description: We are seeking... ...periodic service reviews and post-implementation evaluations. Required Qualifications & Experience:...Contract workRemote workImmediate startRelocation
3B Staffing LLC
United States1 day ago $20 - $60 per hour
...biology domain expertise to evaluate, annotate, and benchmark AI systems... .... Comfortable working remotely and contributing to... ...Experience with AI/ML or LLM evaluation in a biological context... ...bioinformatics. Work Terms: Contract position, fully remote. Compensation...Contract workRemote jobHourly paySaidGig
United Statesa month ago- ...Cybersecurity Architect MILITARY FRIENDLY & PREFERRED - HOH SPONSOR... ...design authority on the contract. The Cybersecurity Architect... ...(OMB M-22-09) Research and evaluate emerging security capabili es... ...LOCATION: ~ This is a primarily remote position. Candidates must be...Contract workRemote work
Hiring Our Heroes
Arlington, VA5 days ago $45 per hour
...rubrics for AI-generated responses. This remote role demands strong analytical skills... ...focusing on structured assessments and clear evaluation criteria. The ideal candidate will work... ...of 10-40 hours per week, this hourly contract role offers compensation of $45/hour, making...Contract workRemote jobHourly pay10 hours per weekFlexible hours$134.6k - $230.8k
...Digital AI Architect Optum is a global organization that delivers... ...AI architect for our Contract Center Transformation. The successful... ...the flexibility to work remotely * from anywhere within the U... ...telemetry, observability, and evaluation patterns for conversational...Contract workRemote workMinimum wageFull timeWork experience placementWork at officeLocal areaUnitedHealth Group
United States4 days ago- ...Platform Architect Anywhere Type: Contract-to-Hire Category: Architecture Industry: Retail Workplace Type: Remote Reference ID: JN -062026-107452 Date Posted: 06/15/... ...AI, and integration strategies. Evaluate new capabilities such as Now Assist...Contract workRemote workHourly payLocal area
Eliassen Group
Providence, RI4 days ago - ...Remote Mathematics Expert (AI/LLM) - 34877 Remote Mathematics Expert (AI/LLM) - 34877 1 week ago Be among... ...researchers to align problem types with evaluation goals, particularly in areas where... ...LLM companies. Potential for contract extension based on performance and project...Contract workRemote workHourly payPart timeFor contractorsFreelanceInternshipWork from homeWorldwideAfternoon shift
Turing Inc
New York, NY3 days ago - ...highly experienced Cybersecurity Architect with 6+ years of expertise to... ...and standards Evaluate and deploy security technologies... ...Impact: Understand and review contract scope, corresponding cost and... ...position is eligible for a hybrid-remote work schedule (4 days/week in...Contract workRemote workWork at officeImmediate startFlexible hours1 day per week
Hussmann
Bridgeton, MO4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Evaluation Architect - Remote Contract. Be the first to apply!
Related searches
- program coordinator remote Austin, TX
- automation engineer remote Austin, TX
- remote customer service advisor Austin, TX
- it manager remote Austin, TX
- remote financial planning Austin, TX
- remote banking Austin, TX
- remote 3d animation Austin, TX
- tableau developer remote Austin, TX
- software engineering manager remote Austin, TX
- system engineer remote Austin, TX