AI Benchmark Architect for Scientific Computing
Obsidian
Mercor is seeking researchers to author AI evaluation tasks and original, executable problems for frontier models. You will source material, write prompts, and define grading criteria across subdomains with a focus on two areas in mathematics. Engagement is six weeks, part-time, with start date immediate. Experience with Python or R for scientific computing and familiarity with Git/GitHub and Docker workflows are required to ensure reproducible runs and automated quality checks. #J-18808-Ljbffr Obsidian
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Benchmark Architect for Scientific Computing in San Francisco, CA vacancy
- Mercor is seeking PhD and Master's level scientists to author AI evaluation tasks for Sci Code, collaborating with leading AI labs on a new benchmark for scientific computing. You will craft original, executable research problems that current frontier models cannot solve...ScientificPart timeImmediate start
- Obsidian in San Francisco seeks a Computational Statistics and Applied Mathematics Expert to design benchmark problems that test AI systems' ability to solve real scientific workflows. You will craft graduate-level problems requiring advanced software, run simulations,...Scientific
- Mercor is building a large-scale benchmark to test how well AI systems solve advanced scientific problems. You will design graduate-level computational challenges that use real software to run simulations, interpret results, and design experiments. The role emphasizes...Scientific
- Obsidian is seeking a Computational Seismology & Geophysics Expert to design challenging problems that apply real scientific software to research-level tasks. You will craft graduate-level... ...refine problems against state-of-the-art AI models. The role emphasizes strategic...ScientificPart timeRemote work
- Obsidian is seeking a Computational Astrophysics & Cosmology Expert to design graduate-level problems that test AI systems using real scientific software, including simulations and data analysis in cosmology workflows. You will develop challenging problems, test them against...ScientificRemote work
- Mercor is hiring PhD and Masters scientists to author AI evaluation tasks and build a robust benchmark for scientific computing. You will craft original, executable research problems that current frontier models struggle to solve, with focus on semiconductor materials and...Scientific
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) for a new benchmark in scientific computing. You will author original, executable research problems that today’s frontier models cannot solve, sourced from published papers, datasets,...Scientific
- Mercor seeks a Computational Seismology & Geophysics Expert to design graduate-level problems using open-source tools like... ...tasks, run simulations, and interpret results to benchmark AI models against real scientific workflows. The role emphasizes independent problem design...ScientificPart timeRemote work
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) for a new benchmark in scientific computing, partnering with leading AI labs. You will author original, executable research problems that frontier models cannot solve. Engagement lasts...ScientificPart timeImmediate start
- Mercor seeks contributors for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following in the Architecture domain. This is a fully remote independent contractor role, roughly 15-20 hours per week, available to candidates...Remote jobWeekly payFor contractorsFlexible hours
- Mercor is seeking AI experts for a benchmark dataset project evaluating models on visual document understanding and instruction-following in the Education domain. This remote role offers ~15-20 hours per week with flexible scheduling from the US or Canada. Payments are...Remote jobFlexible hours
- Vals AI, Inc. in San Francisco is seeking exceptional researchers and research engineers to design and build the next generation of AI benchmarks that evaluate real-world LLM capabilities. You will lead development of novel benchmarks shaping how foundation models are...
- Conductor is seeking memory subsystem architects to own the memory subsystem for a high-bandwidth system. You will design and implement... ...memory fabric, memory controllers, and interfaces with the XPUs/compute complex. You will evaluate LLm inference workloads, memory...
$171.6k - $222.2k
...Silicon (MQS) Center for Quantum Computing (CQC) is a multi-disciplinary... ...physicists to develop scientific software workflows that enable... ...eligibility.Key job responsibilities- Architect extensible & intuitive... ...Experience with machine learning and AI- Experience with common open-...ScientificPermanent employmentLocal areaFlexible hours- ..., Inc. in San Francisco is seeking an experienced Chip Architect to lead the design of edge compute chips, guiding microarchitecture, PPA, timing, area, and... ...that endure verification and signoff, and evangelizing AI-enabled tooling to accelerate hardware development. #J...
- The San Francisco Compute Company is hiring a senior in-house counsel to develop and oversee the company’s legal strategy in a fast-growing fintech context. You will help navigate complex regulatory and data privacy regimes while guiding corporate governance, fundraising...
- Obsidian is looking for a Computational Bayesian Statistics and Applied Mathematics Expert in San Francisco. You... ...original and challenging problems for advanced AI systems, testing their capabilities using real scientific software. The ideal candidate has graduate-level...Scientific
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code). You will author original, executable research... ..., with immediate start. You will work with Python or R for scientific computing and use GitHub and Docker in a PR-driven workflow. #J-18808-...ScientificPart timeImmediate start
- Obsidian is seeking a Computational Statistics and Applied Mathematics Expert to design graduate-level problems that test AI systems using real scientific software. You will create challenging, reproducible computational tasks, run simulations, interpret results, and refine...Scientific
- ...company. We build and deploy software and biological AI systems to safeguard humanity. Applied Computational Biologist Valthos is an applied biological... ...understanding of our models, working directly with external scientific and technical teams to identify priority use cases...ScientificFull timeWork at office
- ...Edison Scientific seeks a Computational Biologist to develop and evaluate AI agent systems that automate biological discovery and clinical development. You will partner with leading R&D organizations to create benchmarks and improve agent performance across drug discovery...Scientific
Edison
San Francisco, CA1 day ago - Member of Technical Staff - Computational Biologist Valthos | Posted Mar 3 Full-time Negotiable... ...and deploy software and biological AI systems to safeguard humanity. The same... ...experiments High proficiency in Python and its scientific package ecosystem Experience with...ScientificFull timeWork at office
- ...contract role. You will design and refine AI-evaluative problems in Particle &... ..., strong Python skills, and experience with scientific libraries. The role requires independent work in Linux/terminal environments with remote compute sandboxes. #J-18808-Ljbffr MercorScientificRemote jobContract work
- Obsidian seeks a Computational Bayesian Statistics and Applied Mathematics Expert... ...computational problems for AI. You will create problems based on real scientific workflows and evaluate them against... ...software. Familiarity with benchmark design and problem-set creation...Scientific
$234.3k - $349k
...leading enterprises orchestrate AI-powered work. Our vision is... ...— it's about building the scientific foundation that powers some of... ...workflowsBuild novel evaluation benchmarks and methodologies that push... ...measurable differenceA Ph.D. in Computer Science, Machine Learning,...ScientificFull timeWork at officeLocal area$300 per month
...About us Edison Scientific builds and deploys AI scientist agents to accelerate science... .... Responsibilities Architect, implement, and maintain... ..., tool-use pipelines, benchmarks – that improves every... ...engineering foundation in Computer Science, Software Engineering...ScientificFull timeWork at officeEdison Scientific Inc.
San Francisco, CA11 hours ago- Oho Group is hiring a senior architect to shape the software stack for a programmable accelerator platform. You will connect models, frameworks, compilers, runtimes and hardware from high-level workload behavior to kernel execution and code generation. You will work across...
- OXMIQ designs GPU and AI silicon for large‑scale model inference... ...Role The Founding Principal Architect sets the architecture and... ...technologies through prototypes, benchmarks, and operational evidence,... ...requirements and interfaces with compute, storage, and networking...
- ...Computational Biologist (AI/ML)Reporting to the Head of Product & Engineering, and working alongside... ...computational approaches to solve real scientific problems.Track record of individual... ..., including setting up appropriate benchmarks and controls.Finally, we seek...Scientific
Verge Genomics
San Francisco, CA5 days ago - ...broader opportunity is advancing scientific research into intelligence... ...Develop tooling for benchmarking, observability, and temporal... ...fundamentals across robotics, computer vision, and perception systems... ...experience in robotics, embodied AI, reinforcement learning, motion...ScientificFull timeShift work
Human Archive
San Francisco, CA11 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Benchmark Architect for Scientific Computing. Be the first to apply!
Related searches
- scientific marketing manager San Francisco, CA
- boston scientific San Francisco, CA
- senior scientific director San Francisco, CA
- associate scientific director San Francisco, CA
- scientific software engineer San Francisco, CA
- scientific consultant San Francisco, CA
- scientific sales San Francisco, CA
- scientific advisor San Francisco, CA
- scientific manager San Francisco, CA
- scientific communications San Francisco, CA