Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Coding Evaluator — Software Engineering QA

agency

New York, NY
  • Remote job

Agency is seeking a contractor to help evaluate and improve an AI model’s software engineering knowledge. You will test coding tasks and CS questions, judge accuracy and logic, and document errors with clear examples. Responsibilities include assessing topics from data structures to secure coding, and recording failure cases to improve prompts and evaluation criteria. Remote contract work with rate based on experience. #J-18808-Ljbffr agency

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Coding Evaluator — Software Engineering QA in New York, NY vacancy
  •  ...Senior Software Engineer — AI Coding Evaluator is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    7 days ago
  • $20 - $71 per hour

     ...GPU deep learning ignited modern AI - the next era of computing - with...  ...: a Computer Science or Computing Engineering grad student to support our NVIDIA...  ...ability to follow best practices for Software Engineering. You possess strong coding skills with C++ Ways to stand... 
    Remote job
    Hourly pay
    Summer work
    Internship
    Worldwide

    NVIDIA

    Redmond, WA
    3 days ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type:...  ...: $85/hour Location: Remote Role Responsibilities Use...  ...agents to complete and evaluate complex infrastructure engineering... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    4 days ago
  • $29 - $34 per hour

     ...through connected insights, AI-powered technology, and...  ...solutions. Our software enables customers to manage...  ...(AMS) Software Engineering Team is looking for an...  ...Infrastructure. You will ship code alongside senior...  ...Location: This position is remotely based within the United... 
    Remote work
    Hourly pay
    Summer work
    Internship
    Summer internship
    Local area
    Worldwide

    Siemens

    Raleigh, NC
    1 day ago
  • $91.62k - $134.38k

     ...Assurance Automation Engineer, you will work...  ...closely with software development partners...  ...use approved AI-assisted...  ...test creation, code review, documentation...  ...into repeatable QA processes. Validate...  ...and test context, evaluate AI-generated...  ...Whether you’re remote, hybrid, or on-site... 
    Remote work
    Full time
    Relocation
    Flexible hours

    Entrust

    Shakopee, MN
    5 days ago
  •  ...Why Blue Coding? At Blue Coding, we specialize...  ...Saas providers, and software consulting firms are...  ...Our team of over 150 engineers, project managers, QA, UX/UI designers, and...  ...Americas. We are a fully remote company working with...  ...CD pipelines. Use AI coding tools (Claude,... 
    Remote work
    Full time
    Local area

    Blue Coding

    Remote
    13 days ago
  • $10,500 per month

     ...the world's leading software for data-driven decisions...  ...As a Software Engineer Intern on Sovereign AI Infrastructure, you...  ...identity or permissions, evaluations, and the core...  ...interns with strong coding fundamentals and experience...  ...that allow for Remote" work on an exceptional... 
    Remote work
    Full time
    Work experience placement
    Internship
    Work at office
    Work from home

    Palantir

    New York, NY
    2 days ago
  • $8 - $65 per hour

    agency is seeking a remote contract contractor to evaluate and improve AI responses to coding tasks in Latin American Spanish. You will examine technical problem solving...  ..., natural language usage. The role blends software evaluation with Spanish-language quality review... 
    Remote job
    Hourly pay
    Contract work
    For contractors

    agency

    New York, NY
    2 days ago
  • $179.13k - $234.1k

     ...Avaya is an enterprise software leader that helps the world...  ...Senior Consulting Engineer to help lead and expand...  ...Artificial Intelligence (AI) technologies, and...  ...Experience using AI coding tools to create innovative...  ...any time for any reason. #LI-REMOTE #LI-HB... 
    Remote work
    Full time
    For contractors
    Work at office
    Visa sponsorship

    Avaya

    Remote
    8 days ago
  • agency is conducting a hands-on evaluation role where you apply Bash and software engineering principles to assess AI-generated technical guidance. You’ll test the model on realistic...  ...programming tasks, judge reasoning and code quality, and document failures to support... 
    Remote job
    Contract work
    For contractors

    agency

    New York, NY
    2 days ago
  • $55.56 per hour

     ...It all started when engineer Fred Luddy wrote code that automated a tedious...  ..., ServiceNow is the AI control tower for...  ...stack Associate Software Development Engineer...  ...delivery while critically evaluating AI-generated output...  ...personas (flexible, remote, or required in... 
    Remote work
    Full time
    Summer work
    Internship
    Work at office
    Immediate start
    Flexible hours

    ServiceNow

    Santa Clara, CA
    4 days ago
  •  ...is looking for a Sr. Full-Stack Software Engineer based in United States. Join an AI training project where your...  ...technical problem-solving, debugging, code evaluation, and cross-language...  ...maintainability. This is a fully remote contractor opportunity offering... 
    Remote work
    Hourly pay
    Part time
    For contractors
    Work at office
    Flexible hours

    Jobgether

    Remote
    4 days ago
  • $111k - $145k

     ...looking for a Senior Software Engineer based in the United States...  ...practices through code reviews, automation, and...  ...processes. Evaluate and integrate open-source...  ...Review and validate AI-generated code for correctness...  ...service. Fully remote working arrangement... 
    Remote work
    Full time
    Temporary work
    Work at office
    Immediate start
    Work from home

    Jobgether

    Remote
    5 days ago
  • $1,000 per unit

     ...We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US...  ...measure and train AI coding models. Remote, any location. US$1,000 per task...  ...writing tests, rubrics or evaluation criteria, ideally for AI models ~... 
    Remote work
    Contract work

    Askable

    United States
    2 days ago
  • $104k - $208k

     ...systems through real-world software engineering challenges. The...  ...to improve the coding, reasoning, debugging,...  ...capabilities of next-generation AI models. For this...  ..., and reliable evaluation frameworks. CONFISA...  ...professionals for this fully remote, project-based... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Flexible hours

    ELITEBRAIN

    Remote
    6 days ago
  • $104k - $208k

     ...Work Arrangement: Fully remote Technical...  ...for experienced Backend Software Engineers to contribute to the development...  ...(RLEs) designed to evaluate and improve the capabilities of advanced AI models in solving real-...  ...complex, repository-based coding tasks that assess a... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Flexible hours

    Weekday AI

    Remote
    5 days ago
  • $150k - $350k

     ...partner is looking for a Software Engineer, Cybersecurity...  ...will play a key role in evaluating the cybersecurity capabilities of advanced AI models through rigorous...  ...developments in AI agents, coding harnesses, and their...  ...in a fully remote setting while collaborating... 
    Remote work
    Full time
    Flexible hours

    Jobgether

    Remote
    5 days ago
  • $98.61k - $167.64k

    Software Engineers (Generalists)At ICF Next, we are fearless in finding new ways...  ...tested fixes.Apply secure coding, least-privilege access, role...  ...Benefits) Coverage Act.Candidate AI Usage PolicyAt ICF, we are...  ...4.00 - $167,644.00Nationwide Remote Office (US99)SummaryLocation:... 
    Remote work
    Full time
    Contract work
    Work experience placement
    H1b
    Work at office

    ICF

    Reston, VA
    3 days ago
  • $104k - $208k

     ...initiatives that leverage real-world software engineering expertise to improve the...  ...of next-generation AI systems. The organization...  ..., system architecture, and code evaluation across multiple programming...  ...professionals worldwide for this fully remote, project-based opportunity.... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Worldwide
    Flexible hours

    ELITEBRAIN

    Remote
    6 days ago
  • $125k - $175k

     ...seeking a Senior Full Stack Software Engineer to join the team. In this role...  ...brief onboarding, this is a remote position offering significant...  ...will help the team drive best coding and testing practices across...  ...is comfortable incorporating AI coding tools into their day-to... 
    Remote work
    Permanent employment
    Full time
    Flexible hours
    Weekday work

    WellHive

    Remote
    12 days ago
  •  ...partner is looking for a Full Stack Software Engineer – AI-First based remotely in United States. In this role,...  ...than relying on traditional manual coding, you will leverage advanced AI coding...  ...workflows. Ability to evaluate, review, debug, and improve AI-generated... 
    Remote work
    Full time
    Flexible hours

    Jobgether

    Remote
    5 days ago
  •  ...About the role We're looking for a software engineer who's productive in Rails, comfortable...  ...their disposal to do the same — including AI coding tools like Cursor, Copilot, and Claude...  ...startup environments is a plus ~ Located in Canada or US time zones (fully remote)... 
    Remote work
    Full time

    InTandem Talent

    Remote
    4 days ago
  • $111.43k - $192.89k

     ...'re looking for a Full Stack Software Engineer with expertise across the frontend...  ...role focuses on hands-on coding and software design, spanning...  ...platforms and mission-ready AI to federal agencies at commercial...  ..., and security clearances. Job Locations US-Remote... 
    Remote work
    Full time
    Contract work

    LMI

    Remote
    15 days ago
  • $104k - $208k

     ...leveraging real-world software engineering expertise and open-source...  ...of next-generation AI systems. The organization...  ..., and technical evaluation. For this project,...  ...professionals for this fully remote, project-based...  ...scalability, and overall code quality. Optimize... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    ELITEBRAIN

    Remote
    6 days ago
  • $130k - $190k

     ...What if your next engineering role involved architecting...  ...designed around an AI-augmented software development model...  ...driven systems. Use AI coding agents as part of the...  ...prompts, context, evaluation approaches, and agentic...  ...U.S. can work fully remote. What You Bring:... 
    Remote work

    Kismet Search

    San Diego, CA
    13 days ago
  • $170k - $200k

     ...partner is looking for a Senior Software Engineer based in the United States....  ...opportunity to join a fully remote, AI-first engineering team...  ...products. You will use advanced AI coding tools and agents to...  ...maintain software quality. Evaluate emerging AI tools and models... 
    Remote work
    Full time
    Home office

    Jobgether

    Remote
    8 days ago
  •  ...immediate opening for a Full-Stack Software Engineer in Dayton, OH.Position...  ...Research is a seeking a Full Stack Remote Sensing Software Engineer to...  ..., automated testing, secure coding standards, and supply‑chain...  ...emerging technologies (LLMs/AI, synthetic data, augmented development... 
    Remote work
    Immediate start

    deciBel Research

    Dayton, OH
    3 days ago
  •  ...Health Bask Health is a software platform that enables...  ...entrepreneurial, product-focused engineering team that values...  ...Engineering at Bask is AI-first and builder-led....  ...like Cursor and Claude Code throughout development...  ...manage assigned tasks in a remote team environment.... 
    Remote work
    Full time
    Internship

    Bask Health

    Remote
    6 days ago
  • $98.62 per hour

     ...Workforce (AGW) is seeking a Software Engineer for a Remote position with a Leading...  ...Software Engineer will build AI-native systems that change...  ...and retrieval strategies, evaluation harnesses, and human-in-the...  ...development tools (Claude Code, Cursor, Copilot, or equivalent... 
    Remote work
    Hourly pay
    Contract work

    ApTask Global Workforce

    United States
    2 days ago
  • $82 per hour

     ...Job Title: MES Software Engineer Industry: Manufacturing Location: Remote, must reside within 1-2 hours' commutable distance of Charlotte, NC...  ...Agile team environment Familiarity with AI assisted coding tools About Elevait Elevait Solutions... 
    Remote work

    ElevaIT Solutions

    Charlotte, NC
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Coding Evaluator — Software Engineering QA. Be the first to apply!