Harness Engineer - AI Prompt & Evaluation Architect
$375kVirio
Virio is seeking a Harness Engineer in San Francisco. You will have the responsibility for the intelligence layer that integrates with our AI models and product. Your role involves refining system prompts, designing evaluation frameworks, and collaborating with product teams. The position offers a compensation package ranging from $375K to $625K, including a base salary and cash bonus, alongside benefits such as medical insurance and equity opportunities. #J-18808-Ljbffr Virio
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Harness Engineer - AI Prompt & Evaluation Architect in San Francisco, CA vacancy
$375k
Dormont Manufacturing Co is looking for a Harness Engineer in San Francisco. This full-time, in-person role involves developing the intelligence layer for AI models, crafting system prompts, and designing evaluation frameworks. Competitive compensation of $375K to $625K...SuggestedFull timeRelocation package- United States Digital Space LLC is seeking a Model Behavior Architect to enhance AI products and evaluations. This role involves working within the AI team to design strategies that optimize user experiences across various AI models. Key responsibilities include developing...Suggested
- ...Asana is seeking an AI Prompt & Workflow Designer to lead the design and implementation of AI-driven workflows within their customer support strategies. This role includes creating chatbots, optimizing workflow performance, and working closely with various teams to integrate...SuggestedWork at office
Asana
San Francisco, CA5 days ago - United States Digital Space LLC is seeking a researcher focused on building environments for frontier evaluations that drive progress towards safe AGI/ASI. You will guide ambitious training runs with prominent industry impact. The ideal candidate has a strong foundation...Suggested
- ...technology that enables our customers to engineer a better world. About the Role Soracom... ...is seeking a Customer Success Engineer / Architect to serve as the technical counterpart to... ...and approaches ~ Experience using AI tools to improve personal productivity and...SuggestedTemporary workRemote workFlexible hours
GrabJobs
San Francisco, CA2 days ago $300k
Storm2 is partnering with a YC-backed AI-native FinTech focused on AI-led customer support,... ...rapidly, adding 1,000+ customers a month. The engineering team is scaling now, and they're looking for someone to build out the harness infrastructure that all the AI Agents will...$150k - $175k
super{set} in San Francisco is hiring a GTM Engineer to develop and execute a cutting-edge demand generation strategy. This unique role combines technical marketing and AI-driven automation, enabling you to maximize sales outreach efficiently. The position offers a competitive...$150k - $175k
Checksum is looking for a GTM Engineer in San Francisco, California, to design and execute cutting-edge demand generation strategies. You... ...be responsible for maximizing sales team efficiency through an AI-first approach. This is a unique opportunity to work in a forward...$80k - $150k
GatherUp is seeking a GTM Engineer in San Francisco, CA. You'll design and develop systems that enhance our revenue operations. This role offers high ownership and the opportunity to work with AI-driven tools and systems. The ideal candidate has at least 3 years of experience...- Ambient.ai is seeking a Senior Founding GTM Engineer to architect AI-driven growth workflows and lead the go-to-market strategy. You will work with methodologies involving automation and data integration across multiple platforms. The role demands 6+ years of experience...
$130k - $180k
...Title Forward Deployed Engineer Salary $130k-$180k + Equity Company Synth AI Labs Inc. (Infer) is a... ...time voice agents, LLM evaluations, and telephony integration... ...layers, and evaluation harnesses to accelerate the speed... ...designs and ship prompt improvements that ensure...$375k
Harness Engineer Location: San Francisco (in-person, in-office, full... ...that sits between our AI models and product—the system prompts, tool definitions, context management, and evaluation framework that makes... ...metrics to measure it. Architect the abstraction layer between...Full timeWork at officeRelocation package$200k - $300k
...For The Senior Platform Architect (PA) is responsible for... ...competitive aspects of the Zendesk AI customer engagement. PA's... ...track record in solutions engineering, technical consulting, and... ...LLM/AI agent ecosystems (prompt engineering, evaluation frameworks, guardrails,...Remote workZendesk
San Francisco, CA1 day ago- ...Nexxa.ai is building artificial super intelligence... ...Job Title: Senior AI Architect Location:... ...looking for a Senior AI Engineer who has spent the last... ...latency, and cost Define evaluation, monitoring, and... ...preference modeling, eval harnesses) Ability to reason...
Nexxa.AI
San Francisco, CA2 days ago - Middesk is looking for a Forward Deployed Engineer to serve as a technical leader, managing complex systems integrations and AI-driven solutions. The role involves leading technical design, building and deploying production-grade systems, and providing immediate feedback...Immediate start
$113.4k - $221.75k
...developing a new‑generation, AI‑first web application in an... ...building from scratch, and quality engineering is a core founding‑team... ...application, spanning the prompt and agent layer, the in‑browser... ...‑friendly. Stand up evaluation harnesses for automated workflows: golden...Shift workAdobe
San Francisco, CA17 hours ago- ...foundation of useful, agentic AI. We are here to take a big swing at the most ambitious engineering challenge of our careers. Everyone... ...parallel agents. Build agent harnesses to improve open model (... ...same for open source! Automate prompt optimization techniques like DSPy...Work at officeImmediate start
$128k - $145k
Asana in San Francisco is seeking an AI Prompt & Workflow Designer to architect and lead AI workflows and chatbots. This role requires 6+ years in Support Operations or a technical CX role, focusing on optimizing service delivery through automation. The candidate will...- A leading renewable energy software company based in San Francisco is looking for a Head of Marketing to define and lead their marketing strategy. The role will involve managing content creation, leading demand generation initiatives, and maintaining marketing materials...
- Cursor in San Francisco is seeking an Engineering Manager to lead the Evals team responsible for building high-quality evaluation datasets for coding agents. You will set the roadmap for evaluations and guide a high-impact team of engineers. The ideal candidate has experience...
- Applied Compute is seeking a GTM Engineer in San Francisco to join the central role in our commercial engine, building demos, agents, and... ...outcomes. The ideal candidate ships quickly, works with modern AI tooling, and thrives in a customer-facing engineering context, collaborating...
$180k - $260k
...investment firm in San Francisco is seeking a Model Behavior Architect to enhance their answer engine by collaborating with research, design, and engineering... .... Candidates should demonstrate a strong passion for AI, be familiar with Python, and possess a high-level...Full time- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior... ...& Orchestration / Head of Engineering Seniority: Senior-Level (... ...into wealth workflows. Design prompt engineering pipelines,... ...Develop and refine test plans, evaluation pipelines, and debug tools for...Full timeWork at officeRemote work
$180k - $240k
...Role We are seeking a Senior AI Agent Architect to design and deploy... ...coordination layers Optimize prompting strategy, tool usage, and memory... ...databases and APIs Define evaluations, safety guardrails, and... ...experience in AI, software engineering, or distributed systems Proven...Full time$142.6k - $261.5k
Location: Anywhere in Country ServiceNow AI Architect Manager Job Overview In this role you... ...selecting methods, techniques, and evaluation criteria for obtaining results.... ...environments. Strong foundation in prompt engineering, including crafting effective prompts...Summer holidayFlexible hours- Anthropic is seeking a dedicated individual to build evaluation infrastructure that enhances trust in AI systems. You'll work on constructing real-world data sets and analyzing agent performance to inform risk management. The ideal candidate will have strong proficiency...
- Anthropic is seeking a skilled engineer to build evaluation infrastructure for detecting AI misuse. In this role, you'll craft experiments and datasets to enhance the reliability of Claude's safety systems. Ideal candidates should have a strong Python background, experience...
- As a Forward Deployed Engineer you will work closely with business, operations... ...and convert them into working AI-powered solutions. This is... ..., maintainable solutions. Evaluate build‑vs‑buy options for AI... ...reusable components, templates, prompts, connectors, and playbooks to...Temporary workLocal areaImmediate start
$120k - $140k
We’re looking for OpenFunnel’s Founding Full Stack Engineer (with AI) You’ll work directly with extremely technical founders, be... ...contribution makes their lives easier. Responsibilities Extensive Prompt Engineering, Evaluation, Monitoring - optimizing for accuracy and speed....Full timeWork at office$127k - $296k
...at Figma Identify and define high‑impact AI use cases across marketing, taking them from... ...a GitHub‑managed marketing AI cortex of prompts, skills, context files, and agents,... ...broader org. Measure what works. Define evaluation criteria, instrument AI workflows, and track...Work from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Harness Engineer - AI Prompt & Evaluation Architect. Be the first to apply!
