Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Code Generation Reviewer

$35 - $55 per hour

Claru

Pay: $35-55/hour Your primary work is reviewing Python code produced by language models in response to natural-language coding prompts. For each task you'll receive the original prompt, one or more model-generated code snippets, and a rubric covering correctness, efficiency, readability, and edge-case handling. You'll run or mentally trace the code, identify bugs or logic errors, and submit structured feedback — including a preference ranking if multiple variants are presented and inline comments where issues occur. Tasks arrive through a web-based review interface. You'll encounter a mix of prompt types: algorithmic challenges (sorting, graph traversal, dynamic programming), data manipulation with pandas or NumPy, API integration stubs, and general scripting tasks. Some sessions focus on ranking two completions; others ask you to rewrite a flawed snippet to a higher standard. You'll be working asynchronously and should expect 6-10 tasks per hour depending on code length and complexity. Ideal candidates have 2+ years of Python development experience and are comfortable quickly reading unfamiliar code without an IDE scaffolding everything for you. You don't need deep ML knowledge - the job is software quality review, not model development. Familiarity with common Python anti-patterns, time complexity basics, and standard library modules (itertools, collections, os, etc.) will serve you well. Skills & requirements Python proficiency Code correctness review Algorithmic complexity analysis Bug identification Inline code annotation Preference ranking Category: Coding Review #J-18808-Ljbffr Claru

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Python Code Generation Reviewer in New York, NY vacancy
  • Crossing Hurdles is seeking a Reviewer to rate AI-generated Python code in a remote contract role. This position offers 20-40 hours per week with flexible scheduling and the chance to influence AI code quality from anywhere. You will analyze GitHub issues, set up repositories... 
    Python
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    3 days ago
  • $25 per hour

    Position: Reviewer and rate AI-generated code - Python Type: Contract Compensation: $25/hr Location: Remote Commitment: 20 40 hours/week Role Responsibilities Analyze and triage GitHub issues across trending open-source libraries Set up and configure code repositories,... 
    Python
    Remote job
    Contract work

    Crossing Hurdles

    New York, NY
    3 days ago
  • Turing is seeking experienced software engineers at tech-lead level to analyze GitHub issues and evaluate Python code quality for open-source projects. The role involves hands-on development, environment automation, issue triage, and assessing test coverage across communities... 
    Python
    Remote job
    Freelance

    Turing

    New York, NY
    1 day ago
  • $25 per hour

    Analyze GitHub issues and evaluate Python code quality for open-source projects. About Turing Turing is one of the world’s leading AGI infrastructure...  ...task Location : LATAM Evaluation Process (approximately 75 mins) : Assessment based review Skills: Python #J-18808-Ljbffr Turing
    Python
    Contract work
    For contractors
    Freelance
    Remote work

    Turing

    New York, NY
    1 day ago
  • $50 - $70 per hour

    OpenTrain AI, Inc. is seeking a Certified Coding Specialist (CCS) AI Data Reviewer to remotely review inpatient medical records and AI-generated clinical notes using ICD-10, CPT, HCPCS and E/M standards. This part-time contract role offers $50-$70 per hour for up to 20... 
    Suggested
    Remote job
    Hourly pay
    Contract work
    Part time

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $135k - $230k

    Team Leader - Code Generation, Data AI Location New York Business Area Data Ref # 10053334 Description & Requirements...  ...-facing generative AI applications.Hands-on experience with Python, SQL, APIs, structured data, schemas, data pipelines, or... 
    Python
    Temporary work
    For contractors
    Work experience placement
    Work at office

    Bloomberg

    New York, NY
    18 hours ago
  • $20 - $30 per hour

     ...ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An...  ...at yet and judge it step by step. • Review — Take an existing annotation, written by...  ...then record what caused them. Mostly Python and Go, with some Rust, C, and Ct+. A trajectory... 
    Python
    Hourly pay
    Full time
    Contract work
    Immediate start
    Remote work

    Bespoke Labs

    New York, NY
    2 days ago
  • OpenTrain AI, Inc. is seeking a remote contractor to review and improve AI-generated code, prompts, solutions, and explanations. The work blends programming judgment with multilingual technical communication and strict adherence to guidelines. The four-week assignment... 
    Remote job
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • OpenTrain AI, Inc. is seeking a detail-oriented contractor to help evaluate AI systems by reviewing software code, technical documentation, and AI-generated answers. The work focuses on accuracy, clarity, and usefulness in real developer workflows. You will analyze code... 
    Remote job
    Contract work
    Part time
    For contractors
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $20 - $45 per hour

    Quant STEM Bachelor AI Training Reviewer (English) Review homework problems and AI responses...  ...analysis and problem-solving, Python proficiency, and familiarity with finance...  ...eligible assistant account. Review AI-generated text, images, and diagrams using knowledge... 
    Python
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • AI Trainer Jobs is seeking a Python code reviewer to assess model-generated code snippets and prompts. You will identify bugs, analyze correctness, and annotate code inline, helping improve model outputs through structured feedback. This role emphasizes fast reading of... 
    Python
    Remote work

    Claru

    New York, NY
    18 hours ago
  •  ...months. You will help design, evaluate, and interpret advanced generative AI systems while collaborating with Scale’s research team...  ...engineering or related academic experience and strong coding skills in Python, Java, Rust, Swift, JavaScript, or C++. #J-18808-Ljbffr Scale... 
    Python
    Remote job

    Scale AI Human Frontier Collective

    New York, NY
    3 days ago
  • Machinify is seeking a DRG Dispute Reviewer to evaluate provider appeals and audit findings and determine correct DRG assignments. You will apply MS-DRG/APR-DRG theories, coding guidelines, and documentation standards to ensure accurate payments and compliant outcomes.... 
    Remote work

    Machinify

    New York, NY
    1 day ago
  • $70k

    Coding and OASIS Reviewer- Full Time/Remote Position Healthcare Provider Solutions is a growing healthcare company providing billing, coding, financial, operational, educational, and clinical consulting to the home care and hospice industries. Healthcare Provider Solutions... 
    Remote job
    Full time
    Work at office
    Local area
    Immediate start
    Monday to Friday
    Flexible hours
    Shift work
    Day shift

    Healthcare Provider Solutions, Inc.

    New York, NY
    3 days ago
  •  ...worldwide Posted 1 day ago Role Title: Coding Expert Role Type: Contractor Location: Remote...  ...apply your expertise to help train next-generation AI systems. Your work will shape how...  ...and perform through high-quality, real-world input. Python C++ #J-18808-Ljbffr Softechub
    Python
    For contractors
    Remote work
    Worldwide

    Softechub

    New York, NY
    1 day ago
  • Softechub is seeking a Coding Expert contractor to join a remote team and contribute to a customer’s coding...  ...to real-world problems and help train next-generation AI systems with high-quality input. Proficiency in Python or C++ and the ability to work independently on... 
    Python
    Remote job
    For contractors
    Worldwide
    Flexible hours

    Softechub

    New York, NY
    1 day ago
  •  ...engineering patterns, and standards for generative AI, machine learning, retrieval, and agentic...  .... Develop critical components, review code and designs, troubleshoot complex technical...  ..., and safety evaluation. ~ Strong Python and software-engineering skills, including... 
    Python

    Atlantic Partners

    New York, NY
    18 hours ago
  • $32 per hour

     ...Our mission is to unlock the potential of Generative AI by tapping into real-world expertise...  ...freelance role for a Tendem project. As a Vibe Code specialist, you'll handle data scraping...  ..., or related technical fields is a plus Python web scraping: Build reliable scraping... 
    Python
    Part time
    Freelance
    Remote work

    Mind Rift

    New York, NY
    4 days ago
  • Machinify, a leading healthcare intelligence company, seeks a DRG Dispute Reviewer to evaluate provider appeals and audit findings for correct MS-DRG/APR-DRG outcomes. You will apply coding guidelines and clinical validation to ensure defensible decisions across health... 
    Remote job

    Work Whisper

    New York, NY
    1 day ago
  • $45 - $60 per hour

    Code Plan Reviewer (Plans Examiner) — Vulcan is a remote review track for evaluating AI outputs across code plan vulcan specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the... 
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    Auraone

    New York, NY
    2 days ago
  • $67.72k - $111.72k

    SUMMARY Reporting to the Professional Validation Manager, the Coding Quality Reviewer and Educator is responsible for performing comprehensive audits of professional coding and clinical documentation across a multispecialty ambulatory environment. This role validates the... 
    For contractors
    Work at office
    Remote work
    Shift work

    Brownhealth

    New York, NY
    3 days ago
  • AuraOne, Inc. is seeking a remote Coding Author — Software Engineering Tasks for AI Evaluation contractor to review AI outputs and grade workflow fidelity. You will apply policy, assess tone and escalation logic, and document next steps for model training. Ideal candidates... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    1 day ago
  •  ...Training Specialist with a focus on Bash coding, you will play a crucial role in...  ...effective data annotation and labeling. Review and validate AI-generated content for accuracy and relevance....  ...other programming languages such as Python. Background in computer science or a... 
    Python
    Hourly pay
    Remote work
    Flexible hours

    Risedatalabs

    New York, NY
    1 day ago
  • Machinify is seeking a DRG Reviewer to join its Complex Payment Solutions Team. You will conduct thorough DRG payment validation reviews, including clinical and coding assessments of medical records, to ensure accurate payment determinations and compliant documentation... 
    Remote job

    Rawlings Company

    New York, NY
    1 day ago
  • $45 - $60 per hour

    AI Trainer Jobs is seeking a Code Plan Reviewer (Plans Examiner) to remotely review AI outputs across code plan vulcan specialist operations workflows. You will assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk, and document the... 
    Hourly pay
    For contractors
    Remote work

    Auraone

    New York, NY
    2 days ago
  • $269.1k - $307.2k

     ...Director, Data Scientist - Generative AI Systems Data is at the center of everything we do...  ...people At least 5 years of experience in Python, Scala, or R for large scale data...  ...Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York... 
    Python
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    New York, NY
    4 days ago
  • Prolific is seeking Senior Python Developers to join our Expert Network to train and evaluate AI models. You will assess AI-generated Python code, test in real environments, and provide feedback to improve accuracy and reliability. Ideal candidates have a strong Software... 
    Python
    Remote job
    Flexible hours

    Prolific Academic Ltd

    New York, NY
    1 day ago
  • $65k - $80k

    Join our team as a Junior Generative AI Engineer and help develop, test...  ...discipline. Proficiency in Python and a solid understanding of...  ...maintainable, and well-tested code. Troubleshoot application, integration...  ...issues. Participate in code reviews, testing, documentation, and... 
    Python
    H1b
    Remote work
    Visa sponsorship

    BeaconFire Inc.

    New York, NY
    8 hours ago
  • $142.32k - $213.48k

     ...a culture that values clean code, thoughtful design, and direct...  ...seeking an exceptional Staff Generative AI Engineer to join our team....  ...especially OpenShift), strong Python programming, and advanced LLM...  ...robust testing, code reviews, documentation, and continuous... 
    Python
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours

    Citigroup Inc

    New York, NY
    18 hours ago
  •  ...architecture, integration strategy, and code quality standards for a...  ...validation, and code reviews. The role will define and enforce...  ...(LLMs), Retrieval-Augmented Generation (RAG), Agentic AI workflows,...  ...Angular, TypeScript, JavaScript, Python, SQL, PowerShell, and YAML ,... 
    Python
    Contract work
    Remote work

    Crossfire Consulting Corp

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Code Generation Reviewer. Be the first to apply!