Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Benchmark Architect: Computational Mathematician

Mercor Inc

Mercor is seeking PhD and Master's scientists to author AI evaluation tasks (Sci Code) and contribute to a new benchmark for scientific computing in collaboration with leading AI labs. You will craft original, executable research problems that current frontier models struggle to solve. You will source materials, write prompts, and define grading criteria, calibrating against models to ensure robust evaluation during a 6-week, part-time (20+ hours/week) engagement with immediate start. #J-18808-Ljbffr Mercor Inc

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Benchmark Architect: Computational Mathematician in San Francisco, CA vacancy
  • Vals AI, Inc. is seeking exceptional researchers and research engineers to design and build AI benchmarks that push the boundaries of evaluation for foundation models. You will lead the development of novel benchmarks and collaborate with labs and enterprises to understand... 
    Suggested

    Vals AI, Inc.

    San Francisco, CA
    1 day ago
  • $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  ...PhD in mathematics, applied mathematics, computational mathematics, or a closely related field.... 
    Suggested
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    27 days ago
  • $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  ...mathematics , applied mathematics , computational mathematics , or a closely related field.... 
    Suggested
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    1 day ago
  • A leading AI research accelerator is seeking Biomedical Informatics Subject Matter Experts to create rigorous evaluation questions for advanced AI models. The ideal candidate will have a strong academic background and experience in designing evaluative materials within... 
    Suggested
    Remote job

    Turing

    San Francisco, CA
    2 days ago
  • $330k

     ...-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture...  ...multiplier for the world's leading AI labs and AI-native companies. You will bridge...  ...distributed systems architecture, high-performance computing, or large-scale infrastructure. Deep... 
    Suggested
    Work at office
    Shift work

    Datadog

    San Francisco, CA
    1 day ago
  • $171k - $280k

     ...stakeholders and the broader community impacted by AI. Accordingly, our Global Affairs team...  ...-management standards, evaluation and benchmarking requirements, and approaches to...  ...conditional offer of employment: protect computer hardware entrusted to you from theft, loss... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  • $136.8k - $142.2k

     ...Our optimism transforms outcomes. Sia’s AI & Data Business Unit is the powerhouse of...  ...drive continuous research in areas like computer vision, MLOps, and deep learning, partnering...  ...are looking for an experienced Solution Architect to join our AI Platforms team. In this role... 
    Part time
    Work at office
    Immediate start
    Worldwide
    3 days per week

    Sia Partners

    San Francisco, CA
    17 hours ago
  •  ...will combine deep expertise in full-stack engineering and advanced AI systems to deliver transformative outcomes for clients. You will...  ...solutions.Your backgroundBachelor’s or master’s degree in computer science, engineering, or a related technical field10+ years of experience... 
    Apprenticeship
    Immediate start
    Easy work
    Flexible hours

    McKinsey & Company

    San Francisco, CA
    17 hours ago
  •  ...Draup is a Series A-funded agentic AI company building the intelligence layer for how...  ...team. What we require ~ BS/MS/PhD in Computer Science, AI/ML, or related field. PhD or...  ...2 years in a principal engineer or lead architect role. ~ Demonstrated history of building... 
    Work at office
    Visa sponsorship
    Flexible hours
    3 days per week

    HopHR

    San Francisco, CA
    3 days ago
  • $280k - $300k

    About the roleWe’re looking for a Manager, Applied AI Architect to lead a team of Applied AI Architects. In this role, you’ll combine technical...  ...the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $218.7k - $300.8k

     ...At Dolby, science meets art, and high tech means more than computer code. As a member of the Dolby team, you’ll see and hear the...  ...the achievement of company goals.About the RoleThe AI Solution Architect is a senior technical leader within Dolby's AI & Business Enablement... 
    Full time
    Local area
    Worldwide
    Flexible hours

    Dolby

    San Francisco, CA
    1 day ago
  • $146.4k - $235.38k

     ...permitted by local law. What you bring BasicBachelor’s degree in computer science or equivalent12+ years of experience in quality...  ...manual effort and bring productivity gains, such as building an AI agent testing experience or tool usage for day-to-day productivity... 
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    16 hours ago
  • $185k - $205k

     ...about our Total Rewards philosophy . AI is a fundamental part of how work gets...  ...with AI at the center. As Staff FP&A AI Architect, you’ll design and lead the technical and...  ...models with LLM workflows and benchmarking against human forecasts. Automate analysis... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    gusto

    San Francisco, CA
    1 day ago
  • $240k - $315k

     ...create reliable interpretable and steerable AI systems. We want AI to be safe and...  ...Deployed Engineer Sales Engineer Solutions Architect or Cybersecurity Engineer working with governments...  ...biology as with traditional efforts in computer science. Were an extremely collaborative... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    7 days ago
  • $320k - $405k

     ...Anthropics mission is to create reliable interpretable and steerable AI systems. We want AI to be safe and beneficial for our users and...  ...management interfaces or to capacity overallocation in large compute fleets strongly preferred. Ability to translate between... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    7 days ago
  • $129.81k - $206.4k

     ...Together.SummaryThe Data Scientist, Applied AI Solutions collects, explores, and...  ...representative test datasets, test cases, benchmarks, validation protocols, and monitoring approaches...  ....Minimum EducationBachelor's degree in computer science, data science, statistics,... 
    Full time
    Work at office
    Remote work
    Visa sponsorship

    DLA Piper

    San Francisco, CA
    3 days ago
  • $350k

     ...system. Job Description: The Managing Director AI Platform Architect is the founding architect of Baker Tillys AI Product Group...  ...duties as assigned. Qualifications ~ Bachelors degree in computer science engineering or a related field or equivalent... 
    Full time
    Local area
    Worldwide

    Baker Tilly

    San Francisco, CA
    7 days ago
  • Conductor seeks an architect to own the logical architecture for the A-0 and A-1 wafer products. You will collaborate with the XPU/Compute chip architect and memory architect to synthesize the...  ...candidate has deep hands-on experience in AI chip design (GPUs, TPUs, XPUs, ASICs... 

    Conductor

    San Francisco, CA
    2 days ago
  • $80 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  ...fail, identifying subtle errors a working mathematician would catch immediately. Collaborate... 
    Contract work
    Part time
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $300k - $400k

     ...create reliable interpretable and steerable AI systems. We want AI to be safe and...  ...partner with account executives account architects and generalist Applied AI engineers who own...  ...and biology as with traditional efforts in computer science. Were an extremely collaborative... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    2 days ago
  • $150k - $170k

     ...highly motivated, mission-oriented Applied AI Engineer to help develop, integrate, and...  ...reliability, by conducting testing, benchmarking, observability, interpretability, failure...  .... Minimum Requirements ~ BS/MS in Computer Science, Engineering, Machine Learning,... 
    Work experience placement
    Casual work
    Work at office
    Relocation package
    2 days per week

    Chaos Industries

    San Francisco, CA
    3 days ago
  •  ...diagnose advertiser performance, define benchmarks, identify growth opportunities, and turn...  ...outcomes. About OpenAI OpenAI is an AI research and deployment company dedicated...  ...conditional offer of employment: protect computer hardware entrusted to you from theft,... 

    OpenAI

    San Francisco, CA
    4 days ago
  • $184.2k - $291.4k

    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing...  ...of AI.What is The RoleElastic is expanding the Ecosystem Architects team focused on the most consequential AI providers in the AI Ecosystem... 
    Local area
    Flexible hours

    elastic

    San Francisco, CA
    2 days ago
  • $197.3k - $365.2k

     ...CategorySoftware EngineeringJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together....  ...to Agents. We’re looking for deeply technical, product-savvy AI architects who can operate across two critical moments in the deal... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $120 - $170 per hour

     ...Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey... 
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    San Francisco, CA
    27 days ago
  •  ...Turn computational work from your own math research into paid evaluation tasks for AI models. Open to research-track Bachelor's students, Master's and PhD students, postdocs, and recent graduates. AfterQuery is building a network of researchers to author and validate... 
    Contract work
    Temporary work
    For contractors
    Visa sponsorship
    Flexible hours

    AfterQuery

    San Francisco, CA
    3 days ago
  •  ...Description Draup is a Series A-funded agentic AI company building the intelligence layer...  ...datasets. • Design experiments and benchmarks to measure model accuracy, reduce bias,...  ...What we require • BS/MS in Statistics, Computer Science, Applied Mathematics, or a quantitative... 
    Work at office
    Visa sponsorship

    Hop

    San Francisco, CA
    a month ago
  • $183.8k - $244.7k

     ...you ready to make an impact? West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is...  ...structures, and mapping schemes Architect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms... 
    Full time
    Local area
    Immediate start
    Flexible hours

    West Monroe

    San Francisco, CA
    1 day ago
  • $150k - $300k

     ...Description About the Role Build evaluation environments and benchmarks that measure whether AI agents can perform realistic company work and meet or...  ...conviction in the potential of AI agents to perform computer-based work. Compensation & Benefits Base salary is $... 
    Visa sponsorship

    Clera

    San Francisco, CA
    1 day ago
  •  ...Collinear AI, Inc. is seeking a Member of Technical Staff - Product to help decide what Collinear builds and then build it. You’ll work directly with researchers and engineers at cutting-edge AI labs, identify their hardest problems, and turn those problems into products... 

    Jobleads-US

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Benchmark Architect: Computational Mathematician. Be the first to apply!