Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer, Code Generation & Model Evaluation

$50 - $100 per hour

SaidGig

Apply advanced software engineering and problem-solving expertise to code generation and model evaluation work that helps improve how next-generation AI systems learn, reason, and perform. This remote contract role centers on real-world coding challenges, codebase improvement, technical evaluation, and precise feedback. Prior AI experience is not required. Key Responsibilities

  • Analyze, debug, and resolve issues across codebases written in Python 3, Java, Rust, C++, Go, or TypeScript.
  • Design and implement new features and enhancements for code generation workflows.
  • Refactor and optimize codebases to improve performance, maintainability, and adaptability.
  • Develop and review realistic coding tasks used to evaluate AI model performance and accuracy.
  • Write clear, actionable feedback and annotations that support model training and assessment.
  • Collaborate with open-source contributors and technical stakeholders to establish technical direction and produce robust outputs.
  • Document technical decisions, best practices, and solutions to support transparency and knowledge sharing.
Qualifications
  • Expertise in competitive programming and coding problem analysis.
  • Expertise in at least one of the following languages: Python 3, Java, Rust, C++, Go, or TypeScript.
  • Solid knowledge of algorithms and data structures.
  • Proven open-source contributions or experience participating in collaborative software projects.
  • Strong analytical ability to interpret complex problem constraints and evaluate multiple solution paths.
  • Exceptional written and verbal communication skills, including the ability to explain technical details clearly.
  • Meticulous attention to detail when validating code and maintaining output consistency.
  • Experience working independently in a remote, collaborative environment.
  • Ability to produce high-quality, well-documented code under tight deadlines.
  • Relevant experience may include bug fixing, feature implementation, codebase refactoring, and performance optimization.
Work Terms
  • Remote contractor engagement.
  • Work is task-based, and completion time may vary based on experience and individual workflow.
  • Minimum submission requirements apply, including a required minimum number of tasks each week. The source does not specify the exact weekly task count.
  • Roles are typically filled within 48 hours, with preference for experts who are available to begin promptly.
  • Participation is subject to selection for the project.
Compensation
  • The listed compensation range is $50 to $100 per hour.
  • The compensation structure is described as output-based, with payment made for each task that meets project specifications.
Application Process

Candidates apply for consideration and, if selected, complete the required onboarding process. Selected experts are expected to begin their first tasks within 24 to 48 hours after onboarding is completed.

Vacancy posted 28 days ago
Similar jobs that could be interesting for youBased on the Research Engineer, Code Generation & Model Evaluation in United States vacancy
  •  ...Role Title: Research Engineer - Code Generation & Model Evaluation Role Type: Contractor Location: Remote micro1 is engaging Research Engineers to participate in a project focused on code generation and model evaluation for a customer's initiative. In this role... 
    Suggested
    Temporary work
    For contractors
    Remote work

    micro1

    Remote
    24 days ago
  •  ...Research Engineer - Code Generation & Model Evaluation is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $136.44k - $265.11k

     ...data, and run AI agents and models directly in their workflows....  ....You’ll build the datasets, evaluations, and systems that help close...  ...the intersection of software engineering, biology, and frontier AI:...  ...engineers, scientists, and external research partners.Desire to work in a... 
    Suggested
    Work at office
    Local area
    Monday to Friday
    Shift work

    Benchling

    San Francisco, CA
    1 day ago
  • $224k - $356.5k

     ...Tools organization is seeking a Senior Research Engineer to join our Research team, where we build the AI coding agents, models, datasets, and evaluations at the heart of NVIDIA's strategy...  ...to rigorous evaluations for code generation or agentic systemsTrack record of shipping... 
    Suggested
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $147k - $220k

     ...Senior Research Engineer Seattle, Washington | Hybrid The position...  ...Senior Research Engineer on the model scaling team, reporting to a...  ..., RLVR). Release models, code, and associated research...  ...limited to retrieval-augmented generation or application-level fine-... 
    Suggested
    Remote work
    Visa sponsorship

    Intelix.AI

    Seattle, WA
    3 days ago
  •  ...worldwide.We’re a team of engineers, clinicians, and...  ...for next-generation robotic platforms....  ...As a Senior AI/ML Research Engineer, you will...  ...tune the foundation models—VFMs, VLMs, and VLA...  ...ResponsibilitiesDevelop, fine-tune, and evaluate the AI/ML models—...  ...product: writing code others can build... 
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    3 days ago
  •  ...a JavaScript Specialist to join our Expert Network, evaluating AI-generated JavaScript/TypeScript code for accuracy and reliability. You will complete a short...  ..., participate as a paid contributor training AI models. Expect to review logic, run code in Node.js or browser... 
    Remote work
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  •  ...Francisco, California. The Role: As a Research Engineer - Language Model Pre-Training , you'll shape our...  ...your insights into our next-generation models. You'll Work Across:...  ...Dataset collection, processing, and evaluation Architecture and methodology research... 
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    a month ago
  •  ...solving to improve and evaluate large language models. You will design...  ...numerical results with code, and review model...  ...Accelerate frontier AI research by contributing high...  ...and annotate model generated solutions, identify...  ...level expected for engineering entrance exams and for... 
    Contract work
    For contractors
    Freelance
    Remote work

    SaidGig

    United States
    more than 2 months ago
  • $295k

     ...cutting-edge foundation AI models and end-to-end products that...  .... Cohere is a team of researchers, engineers, designers, and more, who are...  ...Seoul. Join us!Role Overview:Evaluation is critical to making progress...  ...for creating these next-generation evaluation methods and infrastructure... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    5 days ago
  •  ...Software Engineers: Share Your AI Coding Sessions for Model Evaluation is a remote review track for evaluating AI outputs across builders developers share your ai coding sessions specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and... 
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago
  •  ...We are seeking an experienced Engineer, AI – AI Evaluation & Model Risk Lead to lead how AI models are evaluated, cleared, monitored, and documented...  ...SYSTEMS BrickRed Systems is a global leader in next-generation technology consulting and workforce solutions,... 
    Full time
    Work experience placement

    BrickRed Systems

    Washington DC
    2 days ago
  • $400 per month

     ...partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured...  ...infrastructure engineering workflows and model evaluation...  ...tasks. Review model-generated implementations... 

    Mercor Inc

    Doral, FL
    2 days ago
  • $80 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Data Engineer (Coding Agent Experience) Type:...  ...coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving ETL... 
    Contract work
    Summer work
    Remote work

    Mercor

    Philadelphia, PA
    13 days ago
  •  ...this through pioneering research in multimodal AI for modeling human-to-human communication...  ..., and video), as well as generating audio-visual avatar...  ...experienced Research Scientist/Engineer with a focus on model...  ...fundamentals Strong Python coding skills and reliable... 
    Full time
    Remote work
    Relocation package
    Flexible hours

    Tavus

    San Francisco, CA
    13 days ago
  •  ...compound foundation model of the extracellular...  ...Applied Deep Learning Research Engineer to work on the model...  ...architecture, training, and evaluation of the Meshwork...  ...networks, diffusion or generative models applied to...  ...publications, preprints, or code are preferred over... 
    Full time

    Opeongo-ai

    United States
    1 hour ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type:...  ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving... 
    Contract work
    Summer work
    Remote work

    Mercor

    Miami, FL
    13 days ago
  •  ...Job Description Research Engineer, Clinical Reasoning \n...  ...can be used to test, evaluate, and improve clinical...  ...experiments, post-train models, build high-quality data...  ...and implement next-generation clinical AI reasoning...  ...Fast problem-solving and code comprehension skills,... 
    Full time

    Nxt Level

    Mundelein, IL
    4 days ago
  • Prolific is seeking Biology Experts and Life Science Professionals to join an expert network that evaluates and trains AI models. This role involves reviewing AI-generated scientific content for accuracy and validation, requiring candidates with a BS, MS, or PhD in relevant... 
    Remote job
    Flexible hours

    Prolific

    Charlotte, NC
    5 days ago
  •  ...Competitive Programmer track. This remote contractor role evaluates production code, debugging traces, and AI outputs for correctness,...  ...will reproduce failures and explain fixes so the modeling team can target gaps. Engineering model quality hinges on compiling code, passing... 
    Remote job
    For contractors

    AI Trainer Jobs

    New York, NY
    3 days ago
  • Ignite IT Hub is seeking a senior Model Evaluation Analyst to assess the accuracy and reliability of the U.S. Census Bureau's LLM Autocoder...  ...will maintain evaluation datasets, run comparisons, investigate coding errors, and produce evidence for Government review. Working... 
    Contract work
    Work at office

    Ignite IT

    Suitland, MD
    3 days ago
  • $20 per hour

     ...and technical talent with leading AI research labs. Headquartered in San Francisco...  ...public sources and external tools. Generate high-quality human evaluation data by identifying response strengths...  ...completeness of responses. Ensure model responses align with expected conversational... 
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    New York, NY
    2 days ago
  • $60 per hour

     ...and Life Science Professionals to join their Expert Network. This role involves evaluating and training AI models with real scientific expertise. Successful candidates will review AI-generated content for accuracy and assist in fact-checking technical claims. The... 
    Hourly pay

    Prolific

    Arizona City, AZ
    4 days ago
  • Ignite IT Hub is seeking a senior Model Evaluation Analyst to assess the accuracy and reliability of the U.S. Census Bureau's LLM Autocoder...  ...will maintain evaluation datasets, run comparisons, investigate coding errors, and produce evidence for Government review. Working... 
    Contract work
    Work at office
    Flexible hours

    Ignite IT, LLC

    Suitland, MD
    3 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    1 day ago
  • $113.84k - $170.76k

     ...Technology, Systems & Engineering, ProfessionalCompany:...  ...Analyst - SonarQube & Code Quality Engineering is...  ...Agentic AI workers and Model Context Protocol (MCP)...  ...suggestions, boilerplate generation, and static analysis...  ....Continuously evaluate and implement emerging... 
    Full time

    Citigroup

    Tampa, FL
    2 days ago
  •  ...Professionals in Jacksonville, Florida, to join our Expert Network for evaluating AI-generated science models. Candidates should hold a BS, MS, or PhD in relevant fields and have experience in research or academia. Responsibilities include fact-checking AI technical... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    Jacksonville, FL
    5 days ago
  • $100 per hour

     ...rigorous, real-world analysis, evaluation, and feedback. This remote,...  ...Analyze, review, and edit AI-generated financial content for accuracy...  ...financial data, reports, and model outputs using detailed...  ..., due-diligence reports, and research summaries. Evaluate outputs... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    SaidGig

    United States
    more than 2 months ago
  •  ...As the Manager of Model Validation & Verification (VnV) for Behavior Autonomy, you will lead an engineering and data science team responsible for evaluating, benchmarking, and validating the machine...  ...with reinforcement learning, generative AI, or distributed ML systems.... 
    Full time
    Temporary work
    Relocation package

    Zoox

    California
    28 days ago
  • $70 - $90 per hour

     ...tasks that support the training and evaluation of advanced AI models. This role focuses on assessing...  ...kernel task types: specification-based generation, cross-framework translation or...  ...or TPU. Background in compiler engineering, MLIR, or intermediate-representation... 
    Hourly pay
    Remote work

    SaidGig

    Remote
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer, Code Generation & Model Evaluation. Be the first to apply!