AI Code Quality Engineer: Software Evaluator
Aston Carter
Aston Carter is seeking a Software Engineering Evaluator to assess and improve the quality of AI-generated software development work. You will design realistic coding scenarios, evaluate AI-produced solutions, and provide structured feedback on code quality, correctness, and technical execution. This role suits engineers who enjoy reviewing code, solving technical problems, and applying strong engineering judgment to ensure production-ready outcomes across multiple languages and platforms. #J-18808-Ljbffr Aston Carter
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the AI Code Quality Engineer: Software Evaluator in New York, NY vacancy
- Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses... ...for multilingual experts with coding knowledge and a solid understanding... ...background in customer service, software development, or technical...SuggestedPart timeFor contractorsRemote work
- Anyone AI Inc. is seeking multilingual coding experts to evaluate AI-generated responses on a part-time remote contract lasting up to 3 months. This opportunity... ...technical content for clarity, correctness, and quality, validating JSON structure and giving actionable guidance...SuggestedRemote jobContract workPart time
- Anyone AI is seeking multilingual coding experts to evaluate AI-generated responses. This part-time remote contract lasts up to 3 months and supports frontier... ...and technical content for clarity, correctness, and quality. Validate JSON structure and provide clear feedback...SuggestedRemote jobContract workPart timeFor contractors
- Anyone AI is seeking multilingual evaluators to assess AI-generated responses for clarity, usefulness, and JSON accuracy. This independent contractor,... ...feedback to improve AI systems. Strong language skills and coding knowledge are essential. Experience with APIs and...SuggestedRemote jobPart timeFor contractorsFlexible hours
- ...seeking independent contractor experts to evaluate AI-generated outputs. You will assess language fluency, customer service judgment, and coding knowledge, focusing on JSON structure, formatting accuracy, and response quality. Responsibilities include reviewing responses...SuggestedFor contractors
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will review responses for clarity, usefulness,... ...role combines language fluency, customer service judgment, and coding knowledge, and includes completing JSON Skills Assessments and...For contractorsRemote workFlexible hours
- OpenTrain AI, Inc. is seeking a remote contractor to review and improve AI-generated code, prompts, solutions, and explanations. The work blends programming judgment with multilingual technical communication and strict adherence to guidelines. The four-week assignment requires...Remote jobFor contractors
- OpenTrain AI, Inc. is seeking a detail-oriented contractor to help evaluate AI systems by reviewing software code, technical documentation, and AI-generated answers. The work focuses on accuracy, clarity, and usefulness in real developer workflows. You will analyze code...Remote jobContract workPart timeFor contractorsFlexible hours
$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...frontier AI coding agents to complete and evaluate complex infrastructure engineering...Contract workSummer workRemote workMercor
New York, NYa month ago- Meridial is seeking independent contractor experts to evaluate AI-generated outputs focusing on JSON structure, formatting accuracy, and response quality. You will review responses for clarity, accuracy, and technical soundness, ensuring alignment with project guidelines...Contract workFor contractorsRemote work
$150 per hour
...is seeking talented Junior Software Engineers to participate in an innovative... ...focused on improving the quality accuracy and technical capabilities of advanced AI models. This fully remote... ...professionals will evaluate AI-generated code develop complex programming...Hourly payContract workTemporary workFor contractorsRemote workELITEBRAIN
New York, NYa month ago$90 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Remote Role Responsibilities Evaluate the quality and correctness of AI-assisted software-development traces to enhance... ...evaluation. Assess end-to-end coding sessions produced with AI-assisted...Remote jobContract workSummer work$1,000 per unit
Askable is seeking experienced software engineers to build AI coding tasks from a codebase they know well. You will convert real changes from repositories into tasks that push AI models beyond their current capabilities, earning US$1,000 per task that passes review. Remote...Remote job$1,000 per unit
...Description We're looking for experienced software engineers to build AI coding tasks from a codebase they know... ...writing tests, rubrics or evaluation criteria, ideally for AI models You... ...,000 for each task that passes our quality review, paid directly to you Once...Contract workRemote work$1,000 per month
Askable is seeking a remote Software Engineer focused on AI coding tasks. You will transform a known repository into challenging tasks for AI models, delivering a short proposal, a correct solution, and robust grading checks. The role offers $1,000 per task, with a minimum...Remote job- ...research accelerator for frontier AI labs and a trusted partner for... ...frontier research with high-quality data, advanced training... ...researchers who specialize in coding, reasoning, STEM, multilinguality... ...contained questions. Experience evaluating AI-generated scientific responses...Contract workFor contractorsFreelanceImmediate startRemote workFlexible hours
- Jobgether is seeking a software developer to design, develop, test, and maintain secure, high-quality software components for enterprise-grade products. The role involves integrating AI coding assistants such as Claude Code, Cursor, and GitHub Copilot into daily workflows...Remote job
- ...Responsibilities: Design robust test scenarios to validate AI agent behavior and performance. Analyze Product Requirement Documents... ...scalability. Utilize agentic tools such as Windsurf, Claude Code, and Cursor for advanced automation tasks. Implement AI-...Local area
Macpower Digital Assets Edge Private Limited
New York, NY18 days ago $405k
...Staff Software Engineer, Code RL San Francisco, CA | New York City, NY | Seattle, WA About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our...Full timeWork at officeRemote workVisa sponsorshipFlexible hoursAnthropic
New York, NY9 days ago- Coding Author — Software Engineering Tasks for AI Evaluation is a remote review track for evaluating AI outputs across coding author specialist operations workflows... ...playbooks or firm guidance. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications...Hourly payFor contractorsWork experience placementRemote work10 hours per week
- Bring a software project you own and work on it with an AI coding assistant, while getting paid for your time. You build what you'd build anyway. We ask for your... ...by a company or startup; AI model training or evaluation; ML infrastructure; security exploit tooling; projects...Temporary workRemote work
- SME Careers, a fast-growing AI data services company and subsidiary of SuperAnnotate, is hiring a Senior Java Engineer for remote, hourly contractor work to review AI-generated Java code and provide high-quality reference implementations and explanations. You will assess...Remote jobHourly payFor contractorsFlexible hours
$30 per hour
Explicitly requires vibe coding skills and uses platforms like Claude, DeepSeek, Cursor and Replit to prototype and build AI-powered apps. About the Role Join a small, fast-moving... ...This is a fast-paced, non-traditional engineering role that relies on AI and vibe coding...Hourly payPart timeRemote work10 hours per weekFlexible hours$25 per hour
Turing is seeking experienced software engineers for a contractor assignment... ...assess LLM performance on real code. The role emphasizes hands-on... ..., issue triaging, and evaluating test coverage in open-source... ...potential collaboration with AI researchers on repository challenges...Remote jobFor contractors$159.8k - $235k
About the TeamThe Code Quality team sits within the Developer Platform... ...is to make sure the signals engineers rely on before shipping — test... ...About the RoleWe're looking for Software Engineers to help build and... ...debugging, and rolloutsExplore how AI agents and tools can automate...Hourly payWork at officeLocal areaRemote workFlexible hoursDoordash
New York, NY4 days ago- ...Francisco / New York City is hiring an entry-level Customer & Solutions role focused on AI code review. This hands-on position helps teams trust and integrate AI tools into existing software delivery processes. You will explore how an AI product that indexes entire...
$1,000 per unit
NoDesk is seeking experienced software engineers to craft AI coding tasks from repositories you know well. You will propose changes, reconstruct the repo... ...checks. Tasks are paid $1,000 each once they pass quality review, with a minimum of one task per week and roughly...Remote job$1,000 per month
Higlobe, Inc. seeks experienced software engineers to create AI coding tasks from repos they know well. Each task pays US$1,000 upon passing review... ...and the grading checks, then stress-test and run model evaluations until the task is solid. #J-18808-Ljbffr Higlobe, Inc...Remote job$1,000 per unit
Askable is seeking experienced software engineers to build AI coding tasks from a familiar codebase. You will transform real repository changes into tasks... ...propose changes, implement them, write tests and rubrics, and ensure quality before submission. #J-18808-Ljbffr AskableRemote job- Alignerr Corp. seeks a seasoned software engineer to own a substantial project... ...environment, with Claude Code CLI token costs covered. You... ...development, rigorous code quality assessment, and critical evaluation of Claude's responses to guide AI training while preserving ownership...Remote jobFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Code Quality Engineer: Software Evaluator. Be the first to apply!
Related searches
- ai prompt engineer New York, NY
- ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- senior ai engineer New York, NY
- machine learning ai engineer New York, NY
- ai developer New York, NY
- quality test engineer New York, NY
- quality systems engineer New York, NY