AI Behavior Architect: Prompt Engineering & Evaluation
United States Digital Space LLC
United States Digital Space LLC is seeking a Model Behavior Architect to enhance AI products and evaluations. This role involves working within the AI team to design strategies that optimize user experiences across various AI models. Key responsibilities include developing evaluation systems, collaborating with cross-functional teams, and ensuring model quality through research and analysis. Ideal candidates should have strong communication skills and 3+ years of experience with LLMs in a product or research context. #J-18808-Ljbffr United States Digital Space LLC
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Behavior Architect: Prompt Engineering & Evaluation in San Francisco, CA vacancy
$375k
Virio is seeking a Harness Engineer in San Francisco. You will have the responsibility for the... ...intelligence layer that integrates with our AI models and product. Your role involves refining system prompts, designing evaluation frameworks, and collaborating with product...Suggested$180k - $260k
...focused investment firm in San Francisco is seeking a Model Behavior Architect to enhance their answer engine by collaborating with research, design, and... ...teams. Candidates should demonstrate a strong passion for AI, be familiar with Python, and possess a high-level understanding...SuggestedFull time- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior... ...& Orchestration / Head of Engineering Seniority: Senior-Level (... ...into wealth workflows. Design prompt engineering pipelines,... ...Develop and refine test plans, evaluation pipelines, and debug tools for...SuggestedFull timeWork at officeRemote work
- ...Asana is seeking an AI Prompt & Workflow Designer to lead the design and implementation of AI-driven workflows within their customer support strategies. This role includes creating chatbots, optimizing workflow performance, and working closely with various teams to integrate...SuggestedWork at office
Asana
San Francisco, CA4 days ago - ...a unique role at the intersection of AI research and systems engineering. You will design experiments, build task generation systems, and evaluate model failures. This is a hands-on role... ...learning, LLM agents, and model behavior analysis, and is excited about building...Suggested
- Gravity Engineering Services Pvt Ltd. is seeking a qualified candidate for a role focused on improving answer quality across Perplexity's products. You will architect evaluation pipelines, design methods to measure tool impact on answers, and develop visual evaluation solutions...
- United States Digital Space LLC is seeking a researcher focused on building environments for frontier evaluations that drive progress towards safe AGI/ASI. You will guide ambitious training runs with prominent industry impact. The ideal candidate has a strong foundation...
- ...Nexxa.ai is building artificial super intelligence... ...Job Title: Senior AI Architect Location: Sunnyvale /... ...for a Senior AI Engineer who has spent the last... ...practices to understand user behavior, system performance,... ...latency, and cost Define evaluation, monitoring, and...
Nexxa.AI
San Francisco, CA4 days ago $217k - $325k
...next Senior Staff Machine Learning Engineer to help design our AI platform and develop our next generation... ..., agentic tool ecosystems, and LLM prompt management solutions. Design,... ...expertise in agentic workflows, AI evaluation solutions, prompt management, and secure...Full timeWork at officeFlexible hours$128k - $145k
Asana in San Francisco is seeking an AI Prompt & Workflow Designer to architect and lead AI workflows and chatbots. This role requires 6+ years in Support Operations or a technical CX role, focusing on optimizing service delivery through automation. The candidate will...$200k - $250k
A leading voice AI startup in California is seeking a highly technical builder to join their Forward Deployed Engineering team. This hands-on role focuses on developing voice AI systems for real-world applications. Ideal candidates will have experience in product development...- ...seeking a CRM Systems & Lifecycle Manager. This individual will own the data foundation for lifecycle marketing and work closely with Engineering and Marketing Ops teams to drive impactful campaigns across various channels. The ideal candidate has over 5 years in marketing...Remote job
- A leading renewable energy software company based in San Francisco is looking for a Head of Marketing to define and lead their marketing strategy. The role will involve managing content creation, leading demand generation initiatives, and maintaining marketing materials...
- Gravity Engineering Services Pvt Ltd. seeks an experienced professional for a key role in managing executive relationships with frontier AI lab partners. This position involves working closely with MongoDB teams to align product development and enhance the developer experience...
- Gravity Engineering Services Pvt Ltd. is seeking a Cloud Architect to design and maintain AI operations platforms using AWS. The ideal candidate will have over 10 years of experience in cloud architecture, with a strong focus on Kubernetes and data engineering. Responsibilities...
$80k - $150k
GatherUp is seeking a GTM Engineer in San Francisco, CA. You'll design and develop systems that enhance our revenue operations. This role offers high ownership and the opportunity to work with AI-driven tools and systems. The ideal candidate has at least 3 years of experience...- Sphere, Inc. in San Francisco is seeking an international VAT/GST subject matter expert to collaborate with AI and engineering teams on enhancing global tax solutions. You will work across jurisdictions to simplify tax compliance for cross-border transactions. This role...
- Shared Context Lab is seeking a Founding Engineer in San Francisco, United States, to work directly with the CEO and CTO in building core... ...This opportunity is ideal for someone passionate about shaping the future of AI-powered software. #J-18808-Ljbffr Shared Context Lab
- Out in Science, Technology, Engineering, and Mathematics is looking for an AI/Technology Evangelist to enhance AI integration across the organization. This role entails designing training programs, crafting enablement materials, and facilitating AI adoption among various...
$180k - $240k
...Role We are seeking a Senior AI Agent Architect to design and deploy... ...coordination layers Optimize prompting strategy, tool usage, and memory... ...databases and APIs Define evaluations, safety guardrails, and... ...experience in AI, software engineering, or distributed systems Proven...Full time- ...development of next-generation user interfaces while mentoring a growing engineering team. The ideal candidate has extensive frontend/UI experience and a deep passion for emerging technologies, especially AI. This role includes competitive compensation, remote/hybrid work...Remote job
$150k - $175k
Superset is looking for a GTM Engineer to maximize sales effectiveness through an AI-first approach to demand generation. You will architect and manage the technical stack that powers our marketing efforts. The ideal candidate will combine growth engineering with marketing...- A cutting-edge AI company in San Francisco is seeking a Technical Recruiter to manage full-cycle hiring across various tech roles. You will work closely with engineering leadership to shape the hiring process, design performance assessments, and enhance candidate experience...
- ...is a Series A-funded agentic AI company building the intelligence... ...building our Silicon Valley engineering team — a small, senior group... ...development. Prototype and evaluate breakthrough AI capabilities... ...a principal engineer or lead architect role. Demonstrated history of...Work at officeVisa sponsorshipFlexible hours3 days per week
HopHR
San Francisco, CA2 days ago - A pioneering AI company in property management seeks a Staff Engineer to shape the technical foundation of its innovative platform. You will lead system rewrites, optimize data storage, and build deployment pipelines within a collaborative environment. Ideal candidates...
- A tech startup in AI software is seeking a Staff Engineer to lead the architecture and execution of backend systems powering its rapidly growing product. This crucial role involves designing APIs and managing databases while ensuring scalability and performance. The ideal...
$157.5k - $254.35k
...Docusign is seeking a Lead, results-oriented AI Architect to drive the design, development, and... ...reporting to the Sr. Director Data Engineering & Architecture. Responsibility Develop... ...architectures for complex applications and systems Evaluate, select, and integrate appropriate AI...Permanent employmentFull timeWork at officeRemote work2 days per weekDocuSign
San Francisco, CA3 days ago$132k - $178.5k
...and Rakuten Viber, Mixpanel’s AI‑first digital analytics help... ...Customer Success & Solutions Engineering teams are analytics consultants... ...Success Manager, Solutions Architect, or similar role. Experience... ...companies to understand user behaviors and easily track overarching...Contract work- ...for enterprises to build and orchestrate AI workforces. Our AI workers don't just... ...functional role, you'll collaborate with engineering, operations, and customer success to execute... ...your personal data for the purpose of evaluating and selecting you as a candidate for the...Immediate startWorldwideShift work
$146k
About the Role The AI Knowledge Architect (customer support) role sits within the Global Digital Experience (GDX) team and is responsible... ...Technical Writer, empathy of a UX Designer, and the logic of a Prompt Engineer. Your role starts with writing articles but extends to...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Behavior Architect: Prompt Engineering & Evaluation. Be the first to apply!
