Remote CS Benchmark Architect for AI Evaluation
Weekday AI
New York, NY
- Remote job
Weekday AI is seeking experienced computer science professionals to author and review high-quality academic assessment content for an AI research initiative. You will develop and validate rigorous multiple-choice questions across CS domains, assess solution quality, and help establish gold-standard benchmarks for evaluating advanced AI systems. You will contribute as a Question Authoring or Question Verification role, developing original questions or reviewing existing ones for accuracy, #J-18808-Ljbffr Weekday AI
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote CS Benchmark Architect for AI Evaluation in New York, NY vacancy
- Weekday AI in the United States seeks an Applied Health & Medicine Benchmark Specialist to author and review high‑quality medical assessment content. You will evaluate existing questions for accuracy, design challenging... .... The role is fully remote and independent...Remote jobWeekly payFor contractorsWeekday work
- micro1 is seeking a Member of Technical Staff, Law Research, to lead the development of evaluation frameworks for AI-enabled legal reasoning. You will design benchmarks and collaborate with researchers to shape enterprise AI workflows, focused on robust evaluation across...Remote job
- A leading AI research accelerator is seeking a Biomedical Informatics Subject Matter Expert to design challenging evaluation questions that assess advanced AI models. You will develop coding... ...in bioinformatics domains. This remote position requires a Master’s degree or...Remote workContract work
Turing
Boston, MA5 days ago - Alice is seeking a seasoned researcher-leader to helm AI safety benchmarks and evaluations. You will own the taxonomy, harness, and release cadence, coordinating researchers and freelancers while reporting to the CTO office. You will influence the public research agenda...SuggestedFreelanceWork at office
- A leading AI research accelerator is seeking Biomedical Informatics Subject Matter Experts to create rigorous evaluation questions for advanced AI models. The ideal candidate will have... ...role offers the opportunity to work remotely and tackle cutting-edge AI projects....Remote job
- A top AI research partner is seeking a Biomedical Informatics Subject Matter Expert to develop rigorous evaluation questions for advanced AI models. This role involves designing complex... ...in the field. This position is fully remote and offers the opportunity to work on...Remote job
- ...skilled Conversational & Agentic AI Architect to design, build, and... ...engineering, distillation, and evaluating small/efficient models for... ...solutions. Performance Benchmarking & ROI: Build "Golden Sets" for... ...'ll be working In this remote role, you'll work from home...Remote workTemporary workPart timeWork experience placementWork from homeShift work
Verizon Wireless
Irving, TX3 days ago $201.3k - $352.3k
...meaningful work. Today, ServiceNow is the AI control tower for business reinvention.... ...security and privacy.• Create rigorous benchmarks and evaluation methods for tool-use correctness, plan... ...and trust. Work personas (flexible, remote, or required in office) are categories...Remote workWork at officeImmediate startFlexible hoursMoveworks
Mountain View, CA4 days ago$110.6k - $178k
Product Architect - AI & Digital ProductsCome make the world and accelerate... ...Product team working as a remote employee. We're building a... ...ideas and technical feasibility.Evaluate commercial platforms, open-... ....Experience evaluating, benchmarking, and optimizing Large Language...Remote workFull timeLocal areaStanley Black & Decker
Towson, MD1 day ago- ...JOB SUMMARYThe Sr. Principal AI Architect is an industry-recognized... ...assists Jabil leadership in evaluating new AI technologies, platforms... ...technical leader for local and remote development, engineering,... ...experimentation, model evaluation, benchmarking, Digital Twin development,...Remote workWork at officeLocal areaWorldwide
Jabil Circuit
Austin, TX2 days ago - ...here!PURPOSE OF THE JOBThe AI Architect II is a senior technical leadership... ...AI gateway design.Lead the evaluation, selection, and integration... ...frontier model evaluation, benchmarking methodologies, and model... ...CategoryITSummaryLocation: San Diego, CA; Remote - USAType: Full timeRemote workFull timeWork at officeLocal area
ICW Group
San Diego, CA2 days ago - Job Title: CS Architect, SrPS Job Title: CS Architect, SrWork Place Flexibility... ...**THIS IS A HYBRID POSITION (Remote & Onsite)******This position... ...on the design, review of AI Security architecture and as... ...for cloud-based solutions by evaluating business strategies anongoing...Remote workWork experience placementWork at officeLocal areaRelocationVisa sponsorshipWork visa
Entergy
Austin, TX2 days ago $175k - $190k
...0 years, Software AG’s AI-enabled process intelligence... .... Be you, join us. AI Architect Full timeLocation: United States East Coast, Remote.Software AG customers,... ...: Design, build, and evaluate prototypes that show... ...evaluation pipelines or benchmarks for AI output.Experience...Remote workWork experience placementHome officeSoftware AG
Reston, VA4 days ago- ...skilled Conversational & Agentic AI Architect to design, build, and... ...engineering, distillation, and evaluating small/efficient models for... ...solutions. Performance Benchmarking & ROI: Build "Golden Sets" for... ...you'll be workingIn this remote role, you'll work from home...Remote workTemporary workPart timeWork experience placementWork from homeShift work
Verizon
Irving, TX4 days ago - OpenTeams seeks a Senior AI/ML Test and Evaluation Engineer to build and operate benchmarking and evaluation capabilities at the core of our AI platform. You will design automated metrics and human judgments to compare models and agentic workflows, surface failure modes...Remote job
- ...Computer Science Domain Experts to act as evaluators for a high-level AI verification project. You will assess... ...role requires advanced credentials in CS, expertise to navigate dense... ...provide precise, reliable feedback. This remote, ad hoc project offers flexible hours...Remote jobFlexible hours
- ...seeking an experienced Producer for an AI evaluation project spanning film, TV, digital, and... ...scenarios, evaluate AI outputs, and develop benchmarks to measure performance and realism. The... ...design, and independent work in a remote setting. This contractor position offers...Remote jobFor contractors
$60 per hour
Prolific seeks Computer Science Specialists to join its Expert Network to train and evaluate AI models. You will pass a quick test, then join as a participant and earn by completing paid tasks, sometimes requiring uninterrupted one-hour blocks. Pay can reach up to $60/hr...Remote jobWork from homeFlexible hours- ...design and refine agentic coding workflows where AI autonomously plans, writes, and tests code.... ...are integrated into development. You will evaluate AI-generated output for correctness and security while developing benchmarks to stress-test autonomous system capabilities...Remote job
- ...high-quality academic assessment content for an AI research initiative. You will write and verify rigorous... ...-choice questions across core business domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...Remote job
- ...high-quality academic assessment content for an AI research initiative. You will write and verify rigorous... ...-choice questions across core chemistry domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...Remote job
- ...high-quality academic assessment content for an AI research initiative. You will write and verify rigorous... ...-choice questions across core physics domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...Remote job
- Sign in to set job alerts for “Informatics Manager” roles. 10,000+ Informatics Manager Jobs in United States Manager of Clinical Research Data Warehousing SHE&S Data Governance & Modelling Manager - Loveland, CO or Deerfield, IL SHE&S Data Governance & Modelling Manager...Remote job
- ...academic assessment content for an AI research initiative. You will... ...core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities... ...Verification, with asynchronous, fully remote collaboration and 10+ hours per...Remote job
- ...academic assessment content for an AI research initiative. You will... ...core mathematics domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities... ...question verification, with a remote, asynchronous schedule. #J-188...Remote job
- ...academic assessment content for an AI research initiative. You will... ...core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities... ...or Question Verification, with remote, asynchronous collaboration and...Remote job10 hours per week
- ...gold standard for integrated AI infrastructure Crux AI is a newly... ...grounded in price/performance benchmarks across accelerators and in the... ...Crux should prioritize, evaluate the right mix of our offering... ...collaboration paired with one remote workday for focused, individual...Remote workContract workWork at office
$191k - $255k
...and credentialing products. The Lead AI Architect will play a key role in establishing... ...how AI-enabled solutions are designed, evaluated, deployed, governed, monitored, and continuously... ...Define evaluation frameworks, quality benchmarks, feedback loops, and AI performance...Remote workLocal areaAccurate Background
United States3 days ago- ...AI Full Stack Architect 12 months contract Remote (Ocassional Travel) Tax Term: W2 About the Role We are seeking an AI Full Stack... ...fine-tuning workflows. Establish model benchmarking and evaluation criteria balancing capability, latency, cost,...Remote workContract work
Tharu Technologies LLC
Atlanta, GA20 days ago $185k - $205k
...Rewards philosophy . AI is a fundamental part... .... As Staff FP&A AI Architect, you’ll design and lead... ...with LLM workflows and benchmarking against human... ...privacy requirements. Evaluate and select tools: Drive... .../yr in Denver & most remote locations, and $225,00...Remote workFull timeWork at officeLocal area2 days per week3 days per weekgusto
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote CS Benchmark Architect for AI Evaluation. Be the first to apply!
Related searches
- software engineering manager remote New York, NY
- remote recruitment consultant New York, NY
- remote data manager New York, NY
- business intelligence analyst remote New York, NY
- benefits specialist remote New York, NY
- junior angular developer remote New York, NY
- remote video game New York, NY
- remote typing work New York, NY
- remote construction estimator New York, NY
- remote fashion New York, NY