Remote AI Coding Evaluator — Software Engineering QA
agency
- Remote job
Agency is seeking a contractor to help evaluate and improve an AI model’s software engineering knowledge. You will test coding tasks and CS questions, judge accuracy and logic, and document errors with clear examples. Responsibilities include assessing topics from data structures to secure coding, and recording failure cases to improve prompts and evaluation criteria. Remote contract work with rate based on experience. #J-18808-Ljbffr agency
- ...Senior Software Engineer — AI Coding Evaluator is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should...Remote jobHourly payFor contractors10 hours per week
$20 - $71 per hour
...GPU deep learning ignited modern AI - the next era of computing - with... ...: a Computer Science or Computing Engineering grad student to support our NVIDIA... ...ability to follow best practices for Software Engineering. You possess strong coding skills with C++ Ways to stand...Remote jobHourly paySummer workInternshipWorldwide$85 per hour
...technical talent with leading AI research labs. Headquartered... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type:... ...: $85/hour Location: Remote Role Responsibilities Use... ...agents to complete and evaluate complex infrastructure engineering...Remote workContract workSummer work$29 - $34 per hour
...through connected insights, AI-powered technology, and... ...solutions. Our software enables customers to manage... ...(AMS) Software Engineering Team is looking for an... ...Infrastructure. You will ship code alongside senior... ...Location: This position is remotely based within the United...Remote workHourly paySummer workInternshipSummer internshipLocal areaWorldwide$91.62k - $134.38k
...Assurance Automation Engineer, you will work... ...closely with software development partners... ...use approved AI-assisted... ...test creation, code review, documentation... ...into repeatable QA processes. Validate... ...and test context, evaluate AI-generated... ...Whether you’re remote, hybrid, or on-site...Remote workFull timeRelocationFlexible hours- ...Why Blue Coding? At Blue Coding, we specialize... ...Saas providers, and software consulting firms are... ...Our team of over 150 engineers, project managers, QA, UX/UI designers, and... ...Americas. We are a fully remote company working with... ...CD pipelines. Use AI coding tools (Claude,...Remote workFull timeLocal area
$10,500 per month
...the world's leading software for data-driven decisions... ...As a Software Engineer Intern on Sovereign AI Infrastructure, you... ...identity or permissions, evaluations, and the core... ...interns with strong coding fundamentals and experience... ...that allow for Remote" work on an exceptional...Remote workFull timeWork experience placementInternshipWork at officeWork from home$8 - $65 per hour
agency is seeking a remote contract contractor to evaluate and improve AI responses to coding tasks in Latin American Spanish. You will examine technical problem solving... ..., natural language usage. The role blends software evaluation with Spanish-language quality review...Remote jobHourly payContract workFor contractors$179.13k - $234.1k
...Avaya is an enterprise software leader that helps the world... ...Senior Consulting Engineer to help lead and expand... ...Artificial Intelligence (AI) technologies, and... ...Experience using AI coding tools to create innovative... ...any time for any reason. #LI-REMOTE #LI-HB...Remote workFull timeFor contractorsWork at officeVisa sponsorship- agency is conducting a hands-on evaluation role where you apply Bash and software engineering principles to assess AI-generated technical guidance. You’ll test the model on realistic... ...programming tasks, judge reasoning and code quality, and document failures to support...Remote jobContract workFor contractors
$55.56 per hour
...It all started when engineer Fred Luddy wrote code that automated a tedious... ..., ServiceNow is the AI control tower for... ...stack Associate Software Development Engineer... ...delivery while critically evaluating AI-generated output... ...personas (flexible, remote, or required in...Remote workFull timeSummer workInternshipWork at officeImmediate startFlexible hours- ...is looking for a Sr. Full-Stack Software Engineer based in United States. Join an AI training project where your... ...technical problem-solving, debugging, code evaluation, and cross-language... ...maintainability. This is a fully remote contractor opportunity offering...Remote workHourly payPart timeFor contractorsWork at officeFlexible hours
$111k - $145k
...looking for a Senior Software Engineer based in the United States... ...practices through code reviews, automation, and... ...processes. Evaluate and integrate open-source... ...Review and validate AI-generated code for correctness... ...service. Fully remote working arrangement...Remote workFull timeTemporary workWork at officeImmediate startWork from home$1,000 per unit
...We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US... ...measure and train AI coding models. Remote, any location. US$1,000 per task... ...writing tests, rubrics or evaluation criteria, ideally for AI models ~...Remote workContract work$104k - $208k
...systems through real-world software engineering challenges. The... ...to improve the coding, reasoning, debugging,... ...capabilities of next-generation AI models. For this... ..., and reliable evaluation frameworks. CONFISA... ...professionals for this fully remote, project-based...Remote workHourly payContract workFor contractorsFlexible hours$104k - $208k
...Work Arrangement: Fully remote Technical... ...for experienced Backend Software Engineers to contribute to the development... ...(RLEs) designed to evaluate and improve the capabilities of advanced AI models in solving real-... ...complex, repository-based coding tasks that assess a...Remote workHourly payContract workFor contractorsFlexible hours$150k - $350k
...partner is looking for a Software Engineer, Cybersecurity... ...will play a key role in evaluating the cybersecurity capabilities of advanced AI models through rigorous... ...developments in AI agents, coding harnesses, and their... ...in a fully remote setting while collaborating...Remote workFull timeFlexible hours$98.61k - $167.64k
Software Engineers (Generalists)At ICF Next, we are fearless in finding new ways... ...tested fixes.Apply secure coding, least-privilege access, role... ...Benefits) Coverage Act.Candidate AI Usage PolicyAt ICF, we are... ...4.00 - $167,644.00Nationwide Remote Office (US99)SummaryLocation:...Remote workFull timeContract workWork experience placementH1bWork at office$104k - $208k
...initiatives that leverage real-world software engineering expertise to improve the... ...of next-generation AI systems. The organization... ..., system architecture, and code evaluation across multiple programming... ...professionals worldwide for this fully remote, project-based opportunity....Remote workHourly payContract workFor contractorsWorldwideFlexible hours$125k - $175k
...seeking a Senior Full Stack Software Engineer to join the team. In this role... ...brief onboarding, this is a remote position offering significant... ...will help the team drive best coding and testing practices across... ...is comfortable incorporating AI coding tools into their day-to...Remote workPermanent employmentFull timeFlexible hoursWeekday work- ...partner is looking for a Full Stack Software Engineer – AI-First based remotely in United States. In this role,... ...than relying on traditional manual coding, you will leverage advanced AI coding... ...workflows. Ability to evaluate, review, debug, and improve AI-generated...Remote workFull timeFlexible hours
- ...About the role We're looking for a software engineer who's productive in Rails, comfortable... ...their disposal to do the same — including AI coding tools like Cursor, Copilot, and Claude... ...startup environments is a plus ~ Located in Canada or US time zones (fully remote)...Remote workFull time
$111.43k - $192.89k
...'re looking for a Full Stack Software Engineer with expertise across the frontend... ...role focuses on hands-on coding and software design, spanning... ...platforms and mission-ready AI to federal agencies at commercial... ..., and security clearances. Job Locations US-Remote...Remote workFull timeContract work$104k - $208k
...leveraging real-world software engineering expertise and open-source... ...of next-generation AI systems. The organization... ..., and technical evaluation. For this project,... ...professionals for this fully remote, project-based... ...scalability, and overall code quality. Optimize...Remote workHourly payContract workFor contractors$130k - $190k
...What if your next engineering role involved architecting... ...designed around an AI-augmented software development model... ...driven systems. Use AI coding agents as part of the... ...prompts, context, evaluation approaches, and agentic... ...U.S. can work fully remote. What You Bring:...Remote work$170k - $200k
...partner is looking for a Senior Software Engineer based in the United States.... ...opportunity to join a fully remote, AI-first engineering team... ...products. You will use advanced AI coding tools and agents to... ...maintain software quality. Evaluate emerging AI tools and models...Remote workFull timeHome office- ...immediate opening for a Full-Stack Software Engineer in Dayton, OH.Position... ...Research is a seeking a Full Stack Remote Sensing Software Engineer to... ..., automated testing, secure coding standards, and supply‑chain... ...emerging technologies (LLMs/AI, synthetic data, augmented development...Remote workImmediate start
- ...Health Bask Health is a software platform that enables... ...entrepreneurial, product-focused engineering team that values... ...Engineering at Bask is AI-first and builder-led.... ...like Cursor and Claude Code throughout development... ...manage assigned tasks in a remote team environment....Remote workFull timeInternship
$98.62 per hour
...Workforce (AGW) is seeking a Software Engineer for a Remote position with a Leading... ...Software Engineer will build AI-native systems that change... ...and retrieval strategies, evaluation harnesses, and human-in-the... ...development tools (Claude Code, Cursor, Copilot, or equivalent...Remote workHourly payContract work$82 per hour
...Job Title: MES Software Engineer Industry: Manufacturing Location: Remote, must reside within 1-2 hours' commutable distance of Charlotte, NC... ...Agile team environment Familiarity with AI assisted coding tools About Elevait Elevait Solutions...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Coding Evaluator — Software Engineering QA. Be the first to apply!
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- ads evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY





