Harness Engineer - AI Prompt & Evaluation Architect
$375kVirio
Virio is seeking a Harness Engineer in San Francisco. You will have the responsibility for the intelligence layer that integrates with our AI models and product. Your role involves refining system prompts, designing evaluation frameworks, and collaborating with product teams. The position offers a compensation package ranging from $375K to $625K, including a base salary and cash bonus, alongside benefits such as medical insurance and equity opportunities. #J-18808-Ljbffr Virio
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Harness Engineer - AI Prompt & Evaluation Architect in San Francisco, CA vacancy
$180k - $300k
A leading AI company in San Francisco seeks an experienced candidate to own and elevate core AI systems that power their services... ...role requires expertise in TypeScript and Python, focusing on prompt engineering for text, image, and layout generation. With a hybrid work...Suggested- ...Asana is seeking an AI Prompt & Workflow Designer to lead the design and implementation of AI-driven workflows within their customer support strategies. This role includes creating chatbots, optimizing workflow performance, and working closely with various teams to integrate...SuggestedWork at office
Asana
San Francisco, CA4 days ago - A leading AI company in San Francisco is seeking a Model Behavior Architect to shape their answer engine. This role collaborates with research, design, and engineering teams to... ...engineering strategies and developing effective evaluation pipelines. Candidates should have a...Suggested
- Nohi, based in San Francisco, is seeking a Senior Full-Stack Engineer to lead the architecture and implementation of core systems such as products, orders, and payments. You will drive the end-to-end development, ensuring reliability across both frontend and backend. The...Suggested
$80k - $150k
GatherUp is seeking a GTM Engineer in San Francisco, CA. You'll design and develop systems that enhance our revenue operations. This role offers high ownership and the opportunity to work with AI-driven tools and systems. The ideal candidate has at least 3 years of experience...Suggested$150k - $175k
super{set} in San Francisco is hiring a GTM Engineer to develop and execute a cutting-edge demand generation strategy. This unique role combines technical marketing and AI-driven automation, enabling you to maximize sales outreach efficiently. The position offers a competitive...$150k - $175k
Checksum is looking for a GTM Engineer in San Francisco, California, to design and execute cutting-edge demand generation strategies. You... ...be responsible for maximizing sales team efficiency through an AI-first approach. This is a unique opportunity to work in a forward...- Shared Context Lab is seeking a Founding Engineer in San Francisco, United States, to work directly with the CEO and CTO in building core... ...This opportunity is ideal for someone passionate about shaping the future of AI-powered software. #J-18808-Ljbffr Shared Context Lab
$315k
We are looking for Research Engineers to build “gold standard” evaluations for catastrophic risks, in order to understand what AI Safety Level (ASL) to assign to models. Research leads... ...experience training, working with, and prompting models For all workstreams, experience...Currently hiringWork at officeImmediate startHome officeVisa sponsorshipRelocation package- Welocalize, Inc is looking for a Generative AI Analyst in San Francisco, California. You will be responsible for creatively writing prompts across various topics, leading labeling initiatives, and training teams on best practices for machine learning tools. Applicants should...
- ...building the world’s first AI native BPO, starting with healthcare... ...looking for an exceptional Harness Engineer to build systems around our... ...approaches, and large‑scale evaluations. You either have healthcare... ...how it was built, the prompts you used, and why you chose...3 days per week
$375k
Harness Engineer Location: San Francisco (in-person, in-office, full... ...that sits between our AI models and product—the system prompts, tool definitions, context management, and evaluation framework that makes... ...metrics to measure it. Architect the abstraction layer between...Full timeWork at officeRelocation package- ...inventive research, design, and engineering. Our organization is very... ...you’ll build the measurement, evaluation, and feedback-loop infrastructure... ...product built on the shared harness—and across high-stakes... ...Designing and building best-in‑class AI evaluation system: curated...
- AI Fabrik builds an edge inference delivery network... .... We are builders, architects, engineers, and researchers with... ...own our engineering harness — the tooling and AI... ...through evaluation datasets, grading rubrics... ...practices, including prompt injection defence, PII...Work at office
- ...Nexxa.ai is building artificial super intelligence... ...Job Title: Senior AI Architect Location: Sunnyvale /... ...for a Senior AI Engineer who has spent the last... ...latency, and cost Define evaluation, monitoring, and feedback... ...modeling, eval harnesses) Ability to reason deeply...
Nexxa.AI
San Francisco, CA4 days ago - Known - Conversational AI Engineer, System Prompt and Orchestration San Francisco, CA (In-Person)... ...Orchestration & Context Optimization: Architecting the core system prompts and managing... ...Conversational Quality: Developing custom evaluation frameworks to measure "...
$128k - $145k
Asana in San Francisco is seeking an AI Prompt & Workflow Designer to architect and lead AI workflows and chatbots. This role requires 6+ years in Support Operations or a technical CX role, focusing on optimizing service delivery through automation. The candidate will...- A leading renewable energy software company based in San Francisco is looking for a Head of Marketing to define and lead their marketing strategy. The role will involve managing content creation, leading demand generation initiatives, and maintaining marketing materials...
$171.6k - $392.1k
...working world. ServiceNow – ServiceNow AI Architect Senior Manager In the digital economy... ...capabilities with ServiceNow or evaluating how AI can streamline service delivery... ...pipelines for AI‑driven solutions Skill in prompt engineering and Retrieval‑Augmented Generation (...Summer holidayWorldwideFlexible hoursErnst & Young Oman
San Francisco, CA3 days ago$142.6k - $261.5k
...world. ServiceNow– ServiceNow/Moveworks AI Architect Manager In the digital economy, it... ...in selecting methods, techniques, and evaluation criteria for obtaining results.... ...enterprise environments Strong foundation in prompt engineering, including crafting effective prompts...Summer holidayWorldwideFlexible hoursErnst & Young Oman
San Francisco, CA2 days ago$171.6k - $392.1k
...working world. ServiceNow - ServiceNow AI Architect Senior Manager In the digital... ...enterprise capabilities with ServiceNow or evaluating how AI can streamline service... ...pipelines for AI‑driven solutions Skill in prompt engineering and Retrieval‑Augmented Generation (...Summer holidayWorldwideFlexible hours- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior... ...& Orchestration / Head of Engineering Seniority: Senior-Level (... ...into wealth workflows. Design prompt engineering pipelines,... ...Develop and refine test plans, evaluation pipelines, and debug tools for...Full timeWork at officeRemote work
$180k - $260k
...investment firm in San Francisco is seeking a Model Behavior Architect to enhance their answer engine by collaborating with research, design, and engineering... .... Candidates should demonstrate a strong passion for AI, be familiar with Python, and possess a high-level...Full time- Mercor is seeking experienced management consultants to improve AI-generated business reports as part of a collaboration with a top... ...report standards, analyzing AI-generated business questions, and evaluating report quality. The ideal candidates will have over 3 years at...
$180k - $240k
...Role We are seeking a Senior AI Agent Architect to design and deploy... ...coordination layers Optimize prompting strategy, tool usage, and memory... ...databases and APIs Define evaluations, safety guardrails, and... ...experience in AI, software engineering, or distributed systems Proven...Full time$142.6k - $261.5k
Location: Anywhere in Country ServiceNow AI Architect Manager As a ServiceNow Consulting... ...selecting methods, techniques, and evaluation criteria for obtaining results. Provide... ...environments. Strong foundation in prompt engineering, including crafting effective prompts...Summer holidayFlexible hours$70 - $100 per hour
Join Mercor as a STEM Computational Scientific Software & Evaluation Design Engineer, working remotely from anywhere in the United States. You will design computational problems and collaborate on AI strategies. The ideal candidate holds a graduate-level degree in a STEM...Remote jobHourly payContract work- B Capital is looking for a Lead Agentic Data Systems Engineer in San Francisco to architect and maintain autonomous data products. This hands-on role involves... ...into actionable systems, and leveraging generative AI to drive efficiency. Applicants should have over 5 years...
- A pioneering AI research company in San Francisco seeks a Research-Hardware Codesign Engineer. This hybrid role involves shaping AI silicon architecture, debugging system discrepancies, and writing quantization kernels. Candidates should have a strong background in Python...
- Uber is seeking a Principal Engineer in San Francisco to lead the development of AI-powered developer tools. With 15+ years of experience, you will shape the technical future of Uber, implementing innovative solutions that improve engineering productivity. This role involves...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Harness Engineer - AI Prompt & Evaluation Architect. Be the first to apply!
