ML Evaluation Architect for AI Benchmarks
Causal
Causal is building a Large Physics foundation Model to predict and influence physical systems, starting with weather. We seek research engineers to design a central evaluation framework and reusable pipelines that span models and teams. You will implement evaluation pipelines, benchmark suites, baselines, and visualization tools to turn results into shared, actionable understanding. Strong SWE and statistics are essential. #J-18808-Ljbffr Causal
Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the ML Evaluation Architect for AI Benchmarks in San Francisco, CA vacancy
- Vals AI, Inc. in San Francisco is seeking exceptional researchers and research engineers to design and build the next generation of AI benchmarks that evaluate real-world LLM capabilities. You will lead development of novel benchmarks shaping how foundation models are...Suggested
- Mercor seeks contributors for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following in the Architecture domain. This is a fully remote independent contractor role, roughly 15-20 hours per week, available to candidates...SuggestedRemote jobWeekly payFor contractorsFlexible hours
$122k - $240.5k
Position Summary Google AI Architect/AI and EngineeringJoin our AI & Engineering team... ..., security, and cost.Design, fine-tune, evaluate, and govern LLM solutions with Gemini on... ...Implement security and governance for AI/ML systems (data privacy, model poisoning,...SuggestedLocal areaVisa sponsorshipFlexible hours$206.4k - $379.1k
...produce impressive content. The AI Foundations team constructs a... ...We're looking for a Principal Architect to build and implement the AI... ...Adobe Express, merging strong ML skills with proficiency in distributed... ...analytics, and continuous evaluation frameworks.This role blends...SuggestedFull timeTemporary workLocal areaWorldwideFlexible hours$141.2k - $278.3k
Position Summary Google AI Lead Architect/AI & Engineering:Join our AI & Engineering team in... ..., security, and cost.Design, fine-tune, evaluate, and govern LLM solutions with Gemini on... ...security and governance for AI/ML systems (data privacy, model poisoning,...SuggestedLocal areaVisa sponsorshipFlexible hours$164.7k - $266k
...CLM).What you'll doWe are seeking a Lead AI Architect to turn enterprise data, metadata,... ..., and semantic retrievalPartner with AI/ML, product, and engineering teams to operationalize... ..., engineers, analysts, and vendors to evaluate and implement strategic AI solutionsJob...Contract workWork at officeLocal areaRemote work2 days per week- ...is a Series A-funded agentic AI company building the intelligence... ...development. Prototype and evaluate breakthrough AI capabilities —... .../PhD in Computer Science, AI/ML, or related field. PhD or... ...a principal engineer or lead architect role. ~ Demonstrated history...Work at officeVisa sponsorshipFlexible hours3 days per week
- United States Digital Space LLC is seeking a researcher focused on building environments for frontier evaluations that drive progress towards safe AGI/ASI. You will guide ambitious training runs with prominent industry impact. The ideal candidate has a strong foundation...
- Mercor is partnering with a leading AI research organization to engage experienced accountants for a project that evaluates how well AI systems perform real‑world accounting work. You will design task‑specific grading criteria and define what excellent work looks like....
- Notion is seeking a role focused on quality for Notion AI products. You will shape evaluation systems, analyze data, and collaborate with engineering, product, design, and data teams to ensure reliable AI experiences. This role blends operations, strategy, and product...
$230k - $287.5k
About the Director, AI Architect at Headspace At Headspace, our mission is to transform mental... ...the intersection of applied research, ML science, and platform engineering. This... ...specs that establish AI design principles, evaluation frameworks, guardrails, and reusable...Full timeWork at officeLocal area3 days per week- Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior AI Architect - Multi... ...testing. Collaborate with backend and ML engineers to integrate OpenAI, Anthropic... ...components. Develop and refine test plans, evaluation pipelines, and debug tools for cross-...Full timeWork at officeRemote work
- ...executing full-cycle recruiting for a range of roles including AI/ML research and engineering. Successful candidates will design interviews... ...relationships within the AI community, and ensure rigorous evaluation processes to maintain high hiring standards. #J-18808-Ljbffr...
$154.38k - $193.13k
Job DescriptionAI Architect, AI & AutomationAbout the Role The applicant should have deep, hands-on experience architecting, designing, and... ...following experience:Experience architecting and implementing AI/ML solutions across multiple domains, including:Generative AI and...Full timeTemporary workWork experience placement- ...-gen neural network accelerators optimize tensor compute pipelines define memory architecture for large AI workloads Tech: ASIC architecture ML compute pipelines memory hierarchy design Darwin Recruitment is acting as an Employment Agency in relation...Full timeSan Francisco, CAmore than 2 months ago
- ...for a Principal Engineer in San Francisco to define and own the architectural vision for next-generation AI systems. The role requires a minimum of 5 years in AI/ML engineering, including at least 2 years in a leadership capacity. Responsibilities include prototyping breakthrough...
- Whatnot in the United States is seeking an AI/ML Platform Engineer to design and scale the core infrastructure powering machine learning and self-hosted large language model applications. You will work with ML scientists to bring cutting-edge models into production and...Remote work
$240k - $315k
...create reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...member at Anthropic, you will be a Pre-Sales architect focused on becoming a trusted technical... ...adoption journey, from discovery to initial evaluation through deployment. You will need to...For contractorsFor subcontractorWork at officeVisa sponsorshipFlexible hours3 days per week- Hayden AI is seeking a Senior MLOps Engineer to lead the design and evolution of our machine learning platform within the Perception Deep... ...for training and operationalizing models. You will shape ML infrastructure architecture from data ingestion to deployment, monitoring...
$215k - $300k
...Partnerships Lead to drive strategic partnerships and adoption of AI capabilities within the startup ecosystem. This role involves building... .... The ideal candidate will have a deep understanding of the AI/ML landscape, exceptional communication skills, and experience in...- ...leading software company is seeking a Software Architect to join their COO Architecture team in San... ...Go-to-Market systems with a focus on AI-driven automation. Ideal candidates will have... ...solutions and strong expertise in AI/ML technologies. This high-impact position offers...
- ...challenge: stopping the new wave of adversarial AI attacks already hitting organizations... ...don’t stand a chance. Your Mission Architect a constellation of AI Agents — fast, cheap... ...customizing LLM models 5+ Years Building AI/ML systems Bonus Experience security/detection...Flexible hours
- Autodesk, Inc. in San Francisco seeks a Senior Principal AI/ML Developer to shape data-driven personalization and analytic initiatives across the customer lifecycle. You will design scalable ML pipelines, drive experimentation, and translate insights into business impact...
- Obsidian is looking for an individual to create benchmark tasks evaluating AI models on financial document understanding. You will develop multi-step requests using real-world financial files, ensuring AI can follow instructions and generate structured responses. The role...
- Artha Nexgen is seeking an AI / Generative AI Architect in San Francisco, CA, to design and deliver enterprise-grade AI platforms. Ideal candidates... ...experience in software architecture and significant expertise in AI/ML systems, particularly Generative AI and LLMs. The role...
- Obsidian is seeking a Computational Astrophysics & Cosmology Expert to design graduate-level problems that test AI systems using real scientific software, including simulations and data analysis in cosmology workflows. You will develop challenging problems, test them against...Remote work
- A tech startup tackling AI cybersecurity challenges is seeking engineers to architect AI Agents aimed at detecting and stopping evolving threats. Ideal candidates will... ...experience customizing LLM models and building AI/ML systems. The role demands speed and adaptability in...Flexible hours
- OpenAI is seeking an experienced SoC Architect in San Francisco to lead the development of custom AI silicon for edge deployments. The role involves defining SoC architecture... ...a strong background in SoC/ASIC architecture, AI/ML, and energy-efficient design. This is an...
- Cogent is launching the world’s first AI cyber taskforce with AI agents for cybersecurity tasks. We seek talented AI/ML engineers to build in the Applied AI space, delivering production-grade autonomous AI systems and scalable platforms. You will contribute to designing...
- A fast-growing AI startup is seeking a Specialist Recruitment Consultant to design and implement cutting-edge agentic AI systems. This... ...performance of the AI agents. The ideal candidate has over 3 years of AI/ML experience, strong skills in Python, and familiarity with LLM...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Evaluation Architect for AI Benchmarks. Be the first to apply!
Related searches
- machine learning scientist San Francisco, CA
- machine learning part time San Francisco, CA
- machine learning intern San Francisco, CA
- machine learning remote San Francisco, CA
- machine learning researcher San Francisco, CA
- machine learning San Francisco, CA
- machine learning research scientist San Francisco, CA
- internship machine learning San Francisco, CA
- artificial intelligence - machine learning intern San Francisco, CA
- data engineer machine learning San Francisco, CA