Remote QA Evaluation Scenario Architect for LLMs
$55 per hourMindrift
A leading technology firm is seeking an Evaluation Scenario Writer - QA to ensure the quality of evaluation scenarios for AI projects. This part-time, flexible role involves reviewing tests, spotting inconsistencies, and collaborating on automation. Ideal for those with a robust QA background, the position offers competitive rates up to $55/hour and valuable experience in advanced AI environments. #J-18808-Ljbffr
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Remote QA Evaluation Scenario Architect for LLMs in New York, NY vacancy
$55 per hour
...experts with cutting-edge AI projects. We are seeking an Evaluation Scenario Writer - QA for a project focused on ensuring the quality and correctness... ..., and project needs Take part in a flexible, remote, freelance project that fits around your commitments Participate...Remote workPart timeFreelanceInternshipFlexible hoursMindrift
New York, NY18 hours ago- ...A tech-focused research lab is seeking Property Manager Experts to design and evaluate property management challenges for training AI models. This remote role allows you to leverage your expertise in real estate operations while making a significant impact on AI solutions...Remote work
AfterQuery Experts
United States18 hours ago $140k
...AI Architect Location: Anywhere in North America (... ...USD 140k/Annum Hybrid/Remote/onsite: Remote About... ...and hybrid deployment scenarios Platform Infrastructure... ...environments Evaluate and recommend AI/ML platforms... ...technologies (GenAI, LLMs, edge AI) and assess...Remote workFull timeYantran LLC
United States18 hours ago- ...Job Title: AI Architect Job Location: - 100% Remote Job type: Long-term Contract Interested in this role... ...in large language models (LLMs), multi-agent systems, orchestration... ...pipelines, orchestration layers, and evaluation frameworks. • Establish best practices...Remote workLong term contractWork from home
Connect Tech+Talent
United, PA3 days ago - ...Conversational & Agentic AI Architect to design, build, and optimize... ...sophisticated NLU models and LLMs.Key Responsibilities Agentic... ..., distillation, and evaluating small/efficient models for latency... ...you'll be working In this remote role, you'll work from home...Remote workTemporary workPart timeWork experience placementWork from homeShift work
Verizon
Irving, TX3 days ago - ...certification year after year. Architect Primary Skills ~ AWS... ...Location: NY Work Type: Remote with occasional travel Job... ...Sales, Support, and Growth. Evaluate foundation models and enterprise... ...AWS Bedrock, and open-source LLMs. Integrate AI solutions with...Remote work
Brillio
Eastern, KY1 day ago $210k - $240k
...Principal Architect At Liatrio, we enable real transformation. We help industry-leading... ...'ve built or integrated AI capabilities— LLMs, agentic workflows, RAG pipelines, or AI-... ...forward You have enough hands-on depth to evaluate approaches, guide your team's...Remote workShift workLiatrio
United States2 days ago- ...Conversational & Agentic AI Architect to design, build, and optimize... ...sophisticated NLU models and LLMs. Key Responsibilities... ...engineering, distillation, and evaluating small/efficient models for latency... ...'ll be working In this remote role, you'll work from home...Remote workTemporary workPart timeWork experience placementWork from homeShift work
Verizon
Irving, TX2 days ago - ...TimeWe're hiring a Principal Architect to reinvent how legal work gets... ...immigration dreams.We are a remote-first team with a small in-... ...work.Design the AI layer: how LLMs, retrieval systems, and structured... ...connect to case data; how we evaluate quality; how we handle...Remote workTemporary workWork at officeImmediate startShift work2 days per week
Boundless Corp
Seattle, WA18 hours ago - ...technically proficient OneStream Architect to lead the enterprise-wide... ...data. Prepare the test scenarios and scripts for the testing... ...tuition assistance. #LI-AO #LI-Remote #Appcast ADA Statement &... ...will be reviewed and evaluated on a case-by-case basis....Remote workTemporary workLocal areaWorldwide
A.O. Smith
Nashville, TN2 days ago - ...insights. The Role The Role: Principal Architect, Digital Services A Presidio Digital... ...) solutions and deployments – including LLMs, GenAI methods (RAG, etc), agentic... ...Opportunity Employer Disability/Vets. We evaluate qualified applicants without regard to race...Remote workFor contractors
Presidio
United States1 day ago - ...Role: Principal Architect Client: Sutherland Global/ NBC Universal... ...Location: US Remote Budget/Rate : $90/Hr... ...support. Familiarity with evaluation techniques such as creating and... ...foundation models, including LLMs and VLMs, as well as pretrained...Remote workH1b
Niktor LLC
United States2 days ago - ...opportunities for people in underrepresented communities. The Architect CM and QA support may be required for the construction projects taking... ...ICE and all government contracts. • Must be willing to work remotely and be accountable and responsible for working independently...Remote workContract workTemporary workFor contractorsWork at officeRelocation
CUBE ROOT Corporation
United States4 days ago - ...Cloud Technology Architect Essential Technical Expertise: • 12+ years of experience... ...and the enterprise technology buying and evaluation process. • Ability to learn/work with... ...all-in cloud deployments and hybrid scenarios • Should work and build a solution with...Remote work
Damco
United States2 days ago - ...Guidewire Solution Architect Location: Markham, ON (Remote work may be considered) Salary: CAD 240K per annum... ...and integration advancements; evaluate and recommend adoption of new features... ...diverse customer and business scenarios. Technology-driven mindset, focused...Remote workTemporary work
Diverse Lynx
United States3 days ago $165.6k - $228.49k
...Principal Architect We're looking for a Principal Architect to lead the design and delivery... ...the senior technical decision-maker Evaluate emerging technologies and recommend tools... ...AI/ML systems for production, including LLMs, MLOps, and model serving (e.g., SageMaker...Remote workLocal areaShift workRobots & Pencils
United States3 days ago$86.8k - $198k
...Number: R0251349 Cybersecurity Architect The Opportunity: As a... ...to not only test, analyze, evaluate, validate, and verify these systems... ...Experience developing threat scenarios to support Cyber Tabletop (... ...Experience with space-based remote sensing systems or ground...Remote workFull timeContract workPart timeLocal areaBooz Allen Hamilton
El Segundo, CA5 hours ago- ...DecisionPoint seeks an AI/ML Architect to design artificial... ...also supports experimentation, evaluation, and integration of AI/ML capabilities... .... This position is fully remote. Duties &... ...~ Familiarity with LLMs, vector embeddings, or retrieval...Remote workFor contractorsLocal area
DecisionPoint | Cortek
United States3 days ago $100 per hour
...Job Title: Full Stack Architect – AI & Intelligent Applications Location: United States (Remote) Candidates must be currently based... ...AI solutions using LLMs, RAG, AI agents, embeddings,... ...and vector databases. ~ Evaluate and select appropriate AI models...Remote workFull timeImmediate startExcelerate Technologies
United, PA5 days ago$300k - $385k
...Chief Architect Remote - US Legion Technologies is building the AI-powered operating system... ...training, model serving, retrieval, evaluation, monitoring, feedback loops, and... ...clear build-versus-buy decisions across LLMs, classical ML, optimization solvers, retrieval...Remote workHourly payPermanent employmentTemporary workInterim roleLocal areaImmediate startFlexible hoursLegion
United States4 days ago- ...Location: Remote, USA Employment Type: Full-Time | Exempt About... ...AI capabilities. As Lead AI Architect , you will define and evolve... ...enabling Large Language Models (LLMs), Agentic AI, and advanced automation... ...prompt engineering , model evaluation, observability, and AI...Remote workFull time
LinkedIn
New York, NY4 days ago $270k - $340k
...Lead AI Architect Salary $270k - $340k No equity Location Remote (Canada United States) Experience 6 years of exp Job Type Full... ...end-to-end AI applications using LLMs, RAG, agents, structured workflows, evaluation pipelines, and modern cloud infrastructure...Remote workFull timeDay shiftJobleads-US
Myrtle Point, OR2 days ago$45 - $60 per hour
...Build realistic evaluation tasks from construction drawings, project... ...details. Author both the task scenario and the correct answer or... ...construction drawing sets as an architect of record, project architect,... .... Work Terms Remote, United States. Hourly engagement...Remote workHourly payWork at officeSaidGig
Remote29 days ago$191k - $255k
...credentialing products. The Lead AI Architect will play a key role in establishing and... ...how AI-enabled solutions are designed, evaluated, deployed, governed, monitored, and continuously... ...Provide technical direction on LLMs, SLMs, embeddings, vector search, model...Remote workLocal areaAccurate Background
United States1 day ago- ...Job Title/Role : AI Architect Job Location : Redmond, WA-Remote Duration : Contract JD Responsibilities... ...- data prep, modeling, training, evaluation, deployment & MLOps Govern... ...Microsoft Agentic Framework ~ LLMs, embeddings, vector databases, RAG...Remote workContract work
VDart Inc
Remote1 day ago - ...Principal AI Search & Conversation Architect will be responsible for... ...establish architectural standards evaluate emerging AI technologies... ...expertise in Large Language Models (LLMs) AI agents multi-agent... ...held and rapidly growing! Remote Work : Yes Employment...Remote workFull timeShift work
Travoom
Austin, TX1 day ago $103k - $143k
...Experience with generative AI, LLMs, RAG, AI agents, and agentic... ...context engineering, and LLM evaluation. ~ Preferred: Experience... ...AI AI Agents Angular Architect Azure CI/CD Claude Code... ...engineering. This is a remote position, but the consultant...Remote workFull timeSaggi solutions
Troy, MI7 days ago- ...Role:- SAP SAC Architect Location:- Boise, Idaho( Remote/Travel) Payrate:- $90/h USD C2C/ $170K Visa... ...and develop end-to-end solutions scenario planning, and budgeting processe Perform... .... All applicants will be evaluated solely based on their ability, competence...Remote work
Black Rock Groups
Idaho County, ID2 days ago - ...We are currently seeking a AI Architect to join our team in Dallas,... ...into AI-driven solutions. Evaluate emerging AI technologies and... ...like Large Language Models (LLMs), Generative AI, Retrieval-Augmented... .... While many positions offer remote or hybrid work options, these...Remote workWork at officeFlexible hours
NTT DATA Services
Dallas, TXmore than 2 months ago $165k - $200k
...iCi is seeking a Business Architect to serve as a senior business... ...accelerate value. Location: Remote - United States Key... ...business-performance evidence to evaluate realized value, identify barriers... ...business information, model scenarios, improve architecture work,...Remote workFull timeTemporary workH1bBlue Acorn iCi
United States27 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote QA Evaluation Scenario Architect for LLMs. Be the first to apply!
Related searches
- c++ remote New York, NY
- senior devops engineer remote New York, NY
- remote .net full stack web developer New York, NY
- nursing recruiter (remote) New York, NY
- agile coach / scrum master (remote) New York, NY
- clinical data coordinator remote New York, NY
- pmp - project manager - remote New York, NY
- part time project manager remote New York, NY
- junior project manager remote New York, NY
- web developer internship remote New York, NY