Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer for AI Code Evaluation

$25 per hour

SaidGig

Role Overview

Software Engineers will apply their real-world development experience to evaluate AI-generated code and technical content, providing structured, practical feedback that helps improve AI behavior on programming tasks, system design, and engineering best practices.

Key Responsibilities
  • Evaluate AI-generated code and technical explanations for correctness, efficiency, clarity, and alignment with real-world engineering practices.
  • Design job-related coding questions and problem prompts that reflect realistic engineering scenarios.
  • Provide structured feedback on AI responses, documenting issues and recommended improvements.
  • Follow detailed technical guidelines and quality rubrics when reviewing outputs.
  • Work independently in an asynchronous environment to meet review and evaluation goals for assigned projects.
Qualifications
  • Based in India, with a background in Backend, Frontend, Full-Stack, or Systems engineering.
  • At least 2 years of professional software engineering experience, internships excluded.
  • Strong coding ability in one or more major languages, such as Python, Java, C++, JavaScript, or Go.
  • Experience building, debugging, and maintaining production-level code.
  • Ability to work independently, follow detailed instructions, and apply technical guidelines consistently.
  • Strong written communication skills and attention to detail.
  • Applicants will be required to pass a coding assessment as part of the selection process.
Work Terms
  • Employment type: Part time, flexible, hourly contract work that can be done alongside primary employment.
  • Remote and asynchronous, work independently from your location in India.
  • No minimum weekly hours required, flexible scheduling.
  • Ongoing, project-based engagement, with placement dependent on project availability.
  • This engagement is invite only, not a traditional full-time software engineering position.
Compensation
  • Up to $25/hr (depending on the project)
Eligibility and Application Process
  • Eligibility: Candidates must be based in India and meet the qualifications listed above.
  • Placement into projects depends on availability and successful completion of the selection steps.
  • Application steps: create a candidate profile, complete identity verification, complete the required coding assessment, and complete onboarding for any project you are invited to. Once onboarded to a project, begin assigned review work and receive payment for hours worked.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Software Engineer for AI Code Evaluation in United States vacancy
  •  ...brilliance. Surge was founded by engineers and researchers who dreamed...  ...the next generation AI. We're building a platform...  ...to conducting rigorous evaluations that go beyond benchmarks....  ...funding. The Role As a Software Engineer, Coding Evaluation & Training Data... 
    Suggested
    Full time

    Surge AI

    United States
    1 day ago
  • $40 per hour

     ...specialists with project-based AI opportunities for...  ..., focused on testing, evaluating, and improving AI...  ...dataset to evaluate AI coding agents - how well a model...  .... Not prompt engineering. Not writing code from...  ...Qualifications ~5+ years in software development. ~Core... 
    Suggested
    Part time

    Mindrift

    Remote
    3 days ago
  •  ...Role Overview Evaluate and benchmark the coding abilities of frontier AI models by reviewing AI-generated solutions, validating them against real-world software engineering tasks, and shaping high-quality evaluation datasets and benchmarks. This role suits experienced... 
    Suggested
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    10 days ago
  • $90 per hour

     ...Role Overview Software Engineers evaluate AI-generated code and technical content, providing structured, experience-based feedback to improve how AI systems understand programming tasks, system design, and engineering best practices. This is an ongoing, project-based,... 
    Suggested
    Hourly pay
    Ongoing contract
    Contract work
    Part time
    Internship
    Remote work
    Flexible hours

    SaidGig

    United States
    more than 2 months ago
  • $90 per hour

     ...Software Engineers evaluate AI-generated code and technical content, provide structured feedback, and help improve how AI understands programming tasks, system design, and engineering best practices. Role Overview This is an ongoing, project-based, hourly contract role... 
    Suggested
    Hourly pay
    Ongoing contract
    Full time
    Contract work
    Part time
    Internship
    Remote work
    Flexible hours

    SaidGig

    United States
    3 days ago
  • $50 per hour

     ...Role Overview Evaluate, benchmark, and help improve the coding capabilities of advanced AI models by assessing AI-generated solutions against real software engineering problems. You will review code for correctness and quality, reproduce and debug issues, design evaluation... 
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    7 days ago
  • $25 per hour

     ...Role Overview Software Engineers based in India will evaluate AI-generated code and technical content, provide structured feedback, and help improve how AI models understand programming tasks, system design, and engineering best practices. This is a part-time, project... 
    Hourly pay
    Part time
    For contractors
    Internship
    Immediate start
    Remote work
    Flexible hours

    SaidGig

    United States
    1 day ago
  •  ...Senior Software Engineer — AI Coding Evaluator is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  • $60 - $100 per hour

     ...and technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Software Engineering, Data Science, and Systems Design...  ...Role Responsibilities Evaluate LLM-generated responses to coding and software engineering queries... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    1 day ago
  • $175k - $215k

     ...state-of-the-art Generative AI to create a training ground for...  ...Waymo Driver. The Simulator Evaluation team faces the ultimate data...  ...real"? We are looking for a Software Engineer to build the metrics and pipelines...  ...and AI, writing the code that processes petabytes of simulation... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $320k

     ...interpretable, and steerable AI systems. We want AI to...  ...committed researchers, engineers, policy experts, and...  ...looking for a Software Engineer to help us build...  ...and maintain new agentic coding tools for developers. The...  ...experimenting with new tools, evaluating emerging techniques,... 
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    Seattle, WA
    1 day ago
  • $170k - $216k

     ...the Waymo Driver. Our software allows the Waymo Driver...  ...sensors, enabling software engineers like you to develop...  ...an automated system Evaluate new hardware specifications...  ...in industrial AI applications involving...  ...with robust and efficient code We prefer: MS... 
    Full time
    Remote work

    Waymo

    Remote
    1 day ago
  • $170k - $216k

     ...the Waymo Driver. Our software allows the Waymo Driver...  ...sensors, enabling software engineers like you to develop...  ...critical automation and evaluation frameworks that establish...  ...in industrial AI applications involving...  ...with robust and efficient code We Prefer MS or... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  •  ...organize human intelligence to power the AI economy. We partner with leading AI...  ...context that can't be captured in code alone. Today, more than 30,000 experts...  ...About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of... 
    Full time
    Work at office
    Relocation package

    Mercor

    San Francisco, CA
    1 day ago
  • $144.7k - $221.4k

     ...About the Organization The Evaluation team builds and evolves...  ...clear feedback for engineering and leadership, and help...  ...autonomous driving software performance at interfaces...  ...thoughtful system design, code reviews, testing,...  ...Experience leveraging AI-assisted development and... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $129.4k - $198.4k

     ...About the Organization:The Evaluation team builds and evolves...  ...for autonomous vehicle software validation. Develop and...  ...insights to engineering teams and leadership, including...  ...high standards for code quality and software architecture...  ...practices. Leverage AI-assisted development... 
    Full time
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, TX
    3 days ago
  • $147k - $211k

     ...product or system development code.Participate in, or lead...  ...years of experience with software development in one or more...  ...of labeling, ratings, and evaluations.Experience with Natural Language...  ...Learning, or Generative AI.Google's software engineers develop the next-... 

    Google

    Mountain View, CA
    1 day ago
  • AI Systems Modernization DeveloperBentley Systems...  ...dedicated expert team in code modernization. This...  ...support and guide other software developers in the company...  ...: Manual evaluation of the quality of the conversion...  ...solutions for architecture, engineering, and construction -... 
    Worldwide

    Bentley Systems

    Exton, PA
    2 days ago
  • $224k - $356.5k

     ...autonomous driving, and evaluation is how we know the drive...  ...our organization develops AI drivers!We are looking for a senior engineer to own the engine that...  ...end by this person, in code and in the room, not from...  ...experience).12+ years building software, with significant time... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $80 - $100 per hour

     ...employment verification for this role. What You'll Be Doing Design and build the coding benchmarks and evaluation pipelines used to test frontier AI models on real software engineering work: Design coding benchmarks that evaluate frontier models on real-world... 
    Remote job
    Full time
    Contract work
    For contractors

    G2i

    Miami, FL
    1 day ago
  • $405k

     ...interpretable, and steerable AI systems. We want AI to...  ...committed researchers, engineers, policy experts, and...  ...re looking for a Staff Software Engineer to set...  ...research on the Claude Code team. In this role, you...  ...systems, tooling, and evaluation infrastructure that determine... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    1 day ago
  • $50 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: Software Engineering Expert Type: Contract...  ...Role Responsibilities Write and evaluate code across diverse programming languages... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    1 day ago
  •  ...Software Engineer, Agent Evaluation and Quality Engineering · Full-time · San Francisco; New York Our mission is to automate coding. The first step in our journey is to build the best tool for professional...  ...and building best-in-class AI evaluation system: curated... 
    Full time
    Work at office

    Anysphere

    New York, NY
    3 days ago
  • $50 - $150 per hour

    A fast-growing AI company in New York is seeking a contractor for a software engineering role focused on improving LLM performance. Responsibilities...  ...and reviewing model-generated code. Ideal candidates will have...  ...scalable applications and evaluating code quality. The position... 
    Hourly pay
    For contractors
    10 hours per week
    Flexible hours

    Turing Inc

    New York, NY
    3 days ago
  • A leading AI research accelerator in San Francisco is looking for an experienced Software Engineer to evaluate AI-generated code for efficiency and reliability. You will work closely with cross-functional teams to develop innovative coding solutions and design verification... 
    Remote job
    For contractors
    10 hours per week
    Flexible hours

    Turing

    San Francisco, CA
    1 day ago
  •  ...Job Description Join Code for Good, a social impact hackathon...  ...and be considered for a 2027 Software Engineer Program Summer Internship....  ...effectively prompting approved AI-assisted development tools to...  ...and validation. Critically evaluate AI-generated outputs and... 
    Full time
    Summer work
    Internship
    Summer internship
    Visa sponsorship

    JPMorgan Chase & Co.

    Chicago, IL
    10 days ago
  • $70 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Jack Dorsey . Position: Software Engineer Type: Freelance...  ...multiple categories, such as code review, debugging, and error...  ...Collaborate with AI labs to enhance evaluation datasets for AI reasoning and... 
    Full time
    Summer work
    Freelance
    Immediate start

    Mercor

    Remote
    1 day ago
  • $35 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Code-Data Eval Author — Software Engineer Type: Contract...  ...quality through structured review. Evaluate the accuracy and depth of AI-generated... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    1 day ago
  •  ...Senior Software Engineer, AI Code Modernization   Location: Hybrid – Exton, PA/Philadelphia   Position Summary Bentley is building...  ...accelerate the conversion/test/correction process.   Evaluate and improve AI systems for accuracy, reliability, performance... 
    Worldwide

    Bentley Systems

    Exton, PA
    7 days ago
  •  ...development of high-quality datasets and evaluation pipelines that improve and benchmark large language models for code generation and software engineering tasks. You will curate and author reference code, evaluate and refine AI-generated solutions across multiple programming... 
    Full time
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    SaidGig

    United States
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer for AI Code Evaluation. Be the first to apply!