Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Scientific Computing AI Evaluation Expert

$300 per month

OpenTrain AI, Inc.

The work You will turn mathematical and research workflows into self-contained, terminal-based tasks that test AI agents. Your work will cover numerical analysis, optimization, statistics, mathematical modeling, probability, dynamical systems, numerical integration, differential equations, matrix computation, stochastic modeling, and algorithm analysis. Build tasks with datasets, equations, model definitions, constraints, and expected outputs. Implement expert solutions in Python, R, Julia, C/C++, Bash, or another relevant language. Create grading criteria covering accuracy, convergence, complexity, feasibility, and mathematical correctness. Define tolerances, stopping criteria, stability requirements, and reproducibility controls. Write automated tests for edge cases and alternative valid implementations. Debug floating-point precision, solver, conditioning, convergence, and performance issues. Document assumptions, mathematical formulations, expected outputs, and known limitations. What it pays and takes This is a remote contractor assignment for five weeks. The role requires advanced technical experience in mathematics, statistics, or a closely related field, along with the ability to independently implement, test, and validate computational algorithms. Pay: $300 per approved task. Schedule: At least 6 hours per day and 40 hours per week. Time overlap: At least 4 hours overlapping with Pacific Standard Time. Location: Remote and open worldwide. Language: English. Background: Ph.D., postdoctoral experience, or equivalent advanced technical experience in mathematics, statistics, or a closely related discipline. Programming: Strong ability in Python, R, Julia, C/C++, Bash, or another relevant language. Environment: Experience working in Linux or terminal-based environments. Expertise: Practical experience in numerical methods, optimization, statistics, mathematical modeling, or scientific computation. About AI training work AI training is the human work behind systems that learn from examples, including writing, testing, and evaluating model outputs. This role uses specialized mathematical and programming knowledge to create reliable evaluations that show whether AI agents can solve computational problems correctly. #J-18808-Ljbffr OpenTrain AI, Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Scientific Computing AI Evaluation Expert in New York, NY vacancy
  • $60 - $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: STEM Researcher — Computational Fields Type: Contract...  .... Define criteria for sound scientific reasoning versus superficial reasoning. Evaluate models by reviewing attempts and... 
    Scientific
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    10 days ago
  • YO AI Labs seeks established Physics Professors and Principal Investigators to provide high-level scientific expertise for a project advancing next-generation AI systems. In this remote...  ...contested physics arguments, evaluate competing approaches, and draft rigorous... 
    Scientific
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    4 days ago
  • $60 - $70 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Role Responsibilities Evaluate AI-generated responses for...  ...Policy, Law, Biology, Chemistry, Computer Science, or a related discipline...  ..., journalism, public policy, scientific research, security, or a... 
    Scientific
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $70 - $100 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Dorsey . Position: Computational Chemistry & Electronic Structure Expert Type: Contract Compensation...  ...computational problems to evaluate AI systems using real scientific software. Develop... 
    Scientific
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    2 days ago
  • $70 - $90 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Dorsey . Position: Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab...  ...statistical, mathematical, or scientific software packages. Evaluate AI's ability to compute... 
    Scientific
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    10 days ago
  • Computational Structural & Mechanical Engineering Expert About the Project We're building a large-scale benchmark...  ...test how well advanced AI systems can solve hard computational scientific and engineering problems....  ...with benchmark or evaluation design Background in scientific... 
    Scientific
    Remote work

    Obsidian

    New York, NY
    4 days ago
  • $180k - $250k

     ...founded in 2024 to accelerate scientific knowledge and...  ...The organization focuses on AI and advanced computing, astrophysics, biosciences...  ...producing technical writing for expert and general audiences....  ...initiatives and projects, such as evaluating hardware scalability,... 
    Scientific
    Local area

    Schmidt Sciences

    New York, NY
    1 day ago
  • Prolific is seeking experts who hold PhDs in STEM to train and evaluate cutting-edge AI models. For this project we are seeking experts in subjects like Computer Science, Statistics, Mechanical Engineering, Maths, Physics and more who are comfortable narrating their approach... 
    Remote job

    Prolific Academic Ltd

    New York, NY
    3 days ago
  • AuraOne seeks a Computational Biology & Genomics Analyst to evaluate AI outputs across biology reasoning, calculations, and research workflows. Reviewers grade...  ...derivations hold up under scrutiny. AuraOne uses scientific specialists to grade outputs, check assumptions,... 
    Scientific
    Remote job

    AI Trainer Jobs

    New York, NY
    1 day ago
  • $197.3k - $245.6k

     ...Requirements: Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering...  ...opportunities. Ability to assess scientific publications and apply relevant...  ...systems for model training, evaluation, and online inference at petabyte scale... 
    Scientific
    Full time

    Capital One

    New York, NY
    8 days ago
  • Obsidian seeks a Computational Chemistry & Electronic Structure Expert to design graduate-level problems using real scientific workflows. You will craft challenging...  ...related tools to test AI systems. Applicants...  ...scalable problem design for evaluation. #J-18808-Ljbffr... 
    Scientific

    Obsidian

    New York, NY
    20 hours ago
  • $200k - $300k

     ...highly advanced CPU and GPU compute, storage, and networking technology...  ...River Trading (HRT) brings a scientific approach to trading financial...  ....Please be advised: Use of AI tools during interviews or...  ...We employ various methods to evaluate the authenticity of candidate... 
    Scientific
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    2 days ago
  • $136.4k - $225.1k

     ...personalized, compassionate, expert care to patients of all...  ...III - High Performance Computing At Memorial Sloan...  ...research, analytics, and AI innovation. The...  ...support mission-critical scientific discovery. Role OverviewDefine...  ...-grade resilience. Evaluate and integrate cloud resources... 
    Scientific
    Full time

    Memorial Sloan-Kettering

    New York, NY
    4 days ago
  • OpenTrain AI, Inc. seeks a expert mathematical and statistical problem-solver to turn research workflows into self-contained terminal tasks. You will design datasets, models, constraints, and tests, and implement solutions in Python, R, Julia, C/C++, Bash, or other languages... 
    Scientific
    Remote job
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • Mercor seeks experts in atomic layer deposition and thin‑film processes to support AI research for semiconductors and physical sciences. You will generate, structure, and evaluate scientific data to guide how models reason about deposition and processing. This is hands‑... 
    Scientific
    Remote job

    Obsidian

    New York, NY
    2 days ago
  • $70 - $84 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...hallucinations, and policy failures. Evaluate model robustness across...  ...'s degree or higher in Computer Science , Cybersecurity ,...  ...content, misinformation, or scientific safety. Application Process... 
    Scientific
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    29 days ago
  • $40 per hour

    Prolific is seeking Neuroscience Experts to act as evaluators for a high-level AI verification project. You will assess AI-generated graphical abstracts for accuracy and scientific integrity, navigating dense literature to ensure faithful summaries. This remote advisory... 
    Scientific
    Remote job
    Work from home
    Flexible hours

    Prolific Academic Ltd

    New York, NY
    3 days ago
  • $60 per hour

    Computer Sciences - Graduates - AI Training We’re looking for Computer Science Specialists to join our Expert Network to help train and evaluate cutting‑edge AI models. If you have a background in CS research...  ...and summarize complex scientific data. Researchers looking... 
    Scientific

    Prolific

    New York, NY
    2 days ago
  • $60 per hour

     ...Computer Sciences - Graduates - AI Training About Prolific Prolific is not just another player...  ...Science Specialists to join our Expert Network to help train and evaluate cutting-edge AI models. If you...  ...and summarize complex scientific data. Researchers looking for... 
    Scientific
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 hours ago
  • $8 - $65 per hour

     ...Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    4 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) At Capital One, we are creating responsible...  ...to intuitively understand scientific publications and...  ...Qualifications: Bachelor's degree in Computer Science, AI, Electrical... 
    Scientific
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • Prolific is recruiting Mental Health Professionals to train and evaluate AI models as Domain Experts. You will be invited after a quick test and paid to complete AI tasks requiring focused hours. Expect earnings per task ranging with flexible hours and remote work. Successful... 
    Remote job
    Flexible hours

    Prolific Academic Ltd

    New York, NY
    3 days ago
  • Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    4 days ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • Terac is conducting a paid study to evaluate the accuracy and clinical utility of AI diagnostic tools in dermatology. Practicing dermatologists or clinical professionals with dermatology diagnostics expertise will review de-identified records and dermatological images... 
    Remote job
    Hourly pay

    Terac

    New York, NY
    3 days ago
  • Mercor is partnering with a leading AI lab to design and evaluate disability adjudication processes for frontier AI models. You will craft realistic disability scenarios, generate determinations and evidence summaries, and assess AI-generated responses against established... 

    Obsidian

    New York, NY
    20 hours ago
  • Obsidian is seeking a Medical Expert to help train AI models with high-quality healthcare reasoning data. You will design clinical scenarios, evaluate model outputs, and provide essential feedback to improve AI-driven patient care. This remote, asynchronous role defaults... 
    Remote job
    Flexible hours

    Obsidian

    New York, NY
    20 hours ago
  • $229.9k - $262.4k

     ...AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluations) At Capital One, we are creating responsible and reliable...  ...to intuitively understand scientific publications and judiciously...  ...Qualifications: Bachelor's Degree in Computer Science, AI, Electrical... 
    Scientific
    Full time
    Part time
    Local area

    Jobleads-US

    New York, NY
    1 day ago
  • $150 per hour

     ...Join Turing as a Physics Expert (PhD, Remote) and help...  ...world’s most advanced AI models reason about physics...  ...challenging problems, evaluate model outputs, and...  ...generated solutions for scientific rigor, correctness, and...  ...Reliable technical setup (computer + internet). Why... 
    Scientific
    Hourly pay
    Contract work
    Freelance
    Remote work
    10 hours per week
    Flexible hours

    Turing

    New York, NY
    1 day ago
  •  ...is building a next-generation scalable computing, data, and analytics platform to significantly...  ...credit, pricing, valuation, risk, scientific computing, or other computationally intensive...  ...Cloud Platforms, CI/CD pipelines, ML and AI financial applications Please send... 
    Scientific
    Full time

    Analytic Recruiting Inc.

    New York, NY
    20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Scientific Computing AI Evaluation Expert. Be the first to apply!