Frontier AI Evaluation Architect
United States Digital Space LLC
United States Digital Space LLC is seeking a researcher focused on building environments for frontier evaluations that drive progress towards safe AGI/ASI. You will guide ambitious training runs with prominent industry impact. The ideal candidate has a strong foundation in machine learning and experience with modern methods. Join us to help shape the future of artificial intelligence development and deployment. #J-18808-Ljbffr United States Digital Space LLC
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Frontier AI Evaluation Architect in San Francisco, CA vacancy
- A cutting-edge AI research firm in San Francisco is seeking a Growth Associate to architect and scale its expert supply engine for frontier AI training. This operational and strategic role involves building expert pipelines, collaborating with marketing, and expanding...Suggested
- United States Digital Space LLC is seeking a Model Behavior Architect to enhance AI products and evaluations. This role involves working within the AI team to design strategies that optimize user experiences across various AI models. Key responsibilities include developing...Suggested
$375k
...Francisco. You will have the responsibility for the intelligence layer that integrates with our AI models and product. Your role involves refining system prompts, designing evaluation frameworks, and collaborating with product teams. The position offers a compensation...Suggested- ...Nexxa.ai is building artificial super intelligence for heavy... ...industry. Job Title: Senior AI Architect Location: Sunnyvale / SF, CA... ...building real AI products at the frontier—someone who understands... ...performance, latency, and cost Define evaluation, monitoring, and feedback...Suggested
Nexxa.AI
San Francisco, CA4 days ago - OpenAI is seeking a senior policy expert in San Francisco to shape the development of policies related to AI systems, particularly concerning biological and chemical risks. The candidate will create frameworks to guide AI behavior and collaborate across teams to ensure...Suggested
- The Consulting Solutions is seeking a cybersecurity policy expert to define behavior frameworks for AI models in high-risk situations. This role encompasses policy creation, threat model translation, and safeguarding against dual-use risks in cybersecurity. The successful...Work at officeRelocation package
$207k - $295k
Slope is looking for a cybersecurity policy specialist to define and implement policies for high-risk AI systems. This role involves designing model policies, building frameworks for implementation, and collaborating with engineering teams. Candidates should have strong...$180k - $260k
...focused investment firm in San Francisco is seeking a Model Behavior Architect to enhance their answer engine by collaborating with research,... ...teams. Candidates should demonstrate a strong passion for AI, be familiar with Python, and possess a high-level understanding...Full time- ...Draup is a Series A-funded agentic AI company building the intelligence layer for how... ...proprietary model development. Prototype and evaluate breakthrough AI capabilities — predictive... ...2 years in a principal engineer or lead architect role. Demonstrated history of building...Work at officeVisa sponsorshipFlexible hours3 days per week
HopHR
San Francisco, CA2 days ago - ...Ltd. is seeking a qualified candidate for a role focused on improving answer quality across Perplexity's products. You will architect evaluation pipelines, design methods to measure tool impact on answers, and develop visual evaluation solutions. Ideal candidates should...
$157.5k - $254.35k
...Analytics (GDA) Team at Docusign is seeking a Lead, results-oriented AI Architect to drive the design, development, and implementation of... ...-to-end AI architectures for complex applications and systems Evaluate, select, and integrate appropriate AI technologies, frameworks...Permanent employmentFull timeWork at officeRemote work2 days per weekDocuSign
San Francisco, CA3 days ago- Artificial Analysis Inc is hiring Members of Technical Staff in San Francisco. This role involves designing evaluations and producing analysis to influence how AI is measured and understood. Applicants should have strong analytical skills, proficiency in Python, and a...
- ...and ensure compliance with medical necessity criteria. The role requires mapping clinical evaluations to established guidelines and creating structured decision modules for the AI platform. The ideal candidate is a licensed clinician or has extensive clinical policy experience...
- ...is the infrastructure for enterprises to build and orchestrate AI workforces. Our AI workers don't just communicate - they make decisions... ...to the processing of your personal data for the purpose of evaluating and selecting you as a candidate for the position. Your personal...Immediate startWorldwideShift work
- Composio is seeking a skilled Technical Recruiter in San Francisco, CA, to lead sourcing and evaluation across open roles while building a streamlined recruiting process. The role involves running technical screenings, collaborating with team leads, and utilizing Composio...
- ...seeking a Protocol Specialist to translate clinical experience into structured decision logic for their AI platform. This role involves mapping clinical evaluations to medical necessity criteria and guiding appropriate device selection. The ideal candidate will possess...
- Gravity Engineering Services Pvt Ltd. seeks an experienced professional for a key role in managing executive relationships with frontier AI lab partners. This position involves working closely with MongoDB teams to align product development and enhance the developer experience...
- Obsidian is looking for an individual to create benchmark tasks evaluating AI models on financial document understanding. You will develop multi-step requests using real-world financial files, ensuring AI can follow instructions and generate structured responses. The role...
$206.4k - $379.1k
Principal Architect For Adobe Express Adobe Express enables all users, whether individuals or... ...produce impressive content. The AI Foundations team constructs a flexible, scalable... ...layers, session analytics, and continuous evaluation frameworks. This role blends applied research...Temporary workLocal areaWorldwideFlexible hours- ...executing full-cycle recruiting for a range of roles including AI/ML research and engineering. Successful candidates will design interviews... ...relationships within the AI community, and ensure rigorous evaluation processes to maintain high hiring standards. #J-18808-Ljbffr...
$180k - $240k
...Senior $180k - $240k About the Role We are seeking a Senior AI Agent Architect to design and deploy autonomous, multi-agent systems using... ...LLMs with external enterprise databases and APIs Define evaluations, safety guardrails, and reinforcement loops for agent tasks...Full time- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior AI Architect - Multi-Agent Systems & Platform Infrastructure... ...and Semantic Kernel components. Develop and refine test plans, evaluation pipelines, and debug tools for cross-agent messaging and...Full timeWork at officeRemote work
$240k - $315k
...create reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...member at Anthropic, you will be a Pre-Sales architect focused on becoming a trusted technical... ...journey, from discovery to initial evaluation through deployment. You will need to coordinate...Full timeWork at officeVisa sponsorshipFlexible hours3 days per week$155k - $240k
Snorkel AI is seeking an experienced AI Engineer to serve as their primary technical voice in the AI community. The role requires 6... ...applied ML research or AI engineering experience, focusing on data evaluation and community engagement. You will own technical content...- ...every day. We turn ideas into reality. We are Secure, Responsible AI & Data Protection professionals who enable trust, resilience,... ...manager-level teams, contribute to pursuit activity, and maintain frontier expertise that keeps Accenture's methods current and...Work experience placementLive inWork at officeLocal area
- ...Asana is seeking an AI Prompt & Workflow Designer to lead the design and implementation of AI-driven workflows within their customer support strategies. This role includes creating chatbots, optimizing workflow performance, and working closely with various teams to integrate...Work at office
Asana
San Francisco, CA4 days ago - ...in San Francisco is seeking a candidate for a unique role at the intersection of AI research and systems engineering. You will design experiments, build task generation systems, and evaluate model failures. This is a hands-on role that requires the ability to transform...
- Mercor is seeking an Education Expert to evaluate and create educational content for AI tutoring systems. This role involves assessing AI-generated materials for accuracy and teaching quality in a remote setting. The ideal candidate will have a graduate degree in Education...Remote job
- ...A technology company specializing in AI infrastructure is seeking a Member of Technical Staff to design and implement compiler systems. This role involves building compiler pipelines for heterogeneous hardware while ensuring performance and scalability. The ideal candidate...
Gimlet Labs
San Francisco, CA3 days ago - ...00+ and boost ARR from $10M to $50M. This pivotal role involves the development of innovative growth programs and metrics, utilizing AI tools to enhance outreach efforts. Ideal candidates will have a track record in early-stage startups, be data-savvy, and possess a creative...
Lassie
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontier AI Evaluation Architect. Be the first to apply!
