Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Junior Software Engineer for AI Code Evaluation

$150 per hour

OpenTrain AI, Inc.

The Work You will evaluate AI-generated code on real-world software engineering tasks. Your feedback will help improve how AI systems write, debug, and design software. Review AI-generated code for correctness, quality, maintainability, and design. Create challenging software engineering problems, reference solutions, and test cases. Assess model reasoning about architecture, debugging, and system design. Write detailed feedback on technical decisions and model performance. Identify design weaknesses and evaluate whether implementations work as intended. What It Pays and Takes This is an entry-level, part-time contractor role for software engineers with practical experience. You should be comfortable making and explaining technical judgments in written English. Pay: $150 to $200 per hour. Work type: Part-time contract work. Location: Open to candidates in the United States, Canada, and the United Kingdom. Language: Professional fluency in English, including clear technical writing. Experience: At least one year of professional software engineering experience, including some experience from the past three years. Required knowledge: Code review, debugging, algorithms, data structures, and software architecture. Helpful background: Experience at a major technology company, evaluating implementations, identifying design weaknesses, and writing testable reference solutions. About AI Training Work AI training is the human work behind better software models, including reviewing model outputs, writing tests, and explaining what makes a technical answer correct or useful. OpenTrain helps people find these projects, present their experience, and apply to roles that match their skills. #J-18808-Ljbffr OpenTrain AI, Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Junior Software Engineer for AI Code Evaluation in Brooklyn, NY vacancy
  • $100 per hour

    Senior AI Interaction Evaluator (Codex / Claude Code) Contract | $100-$200/hour | 10-20 hrs/week | Start ASAP (through early May) Check out this Loom...  ...more details! We’re looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions... 
    Suggested
    Contract work
    Immediate start

    Precision Labs

    Brooklyn, NY
    3 days ago
  • $18 per hour

    Junior Software Engineer (Part-Time, 6-Month Term) Aithical Hub hybrid full-time entry $18 / Hr Job Description...  ...sessions Writing clean, maintainable code and supporting software quality...  ...contribute to team success Curiosity about AI and emerging technologies and how they... 
    Junior
    Hourly pay
    Full time
    Part time

    Aithical Hub Inc.

    Brooklyn, NY
    5 days ago
  • $60k - $70k

     ...experience. We develop proprietary software that learns and adjusts to...  ...to join our team as a Junior AI Engineer remotely in the US. iFIT is...  ...practical technical solutions. - Evaluate emerging AI tools and...  ...automation platforms, and low-code tools. - Document solutions,... 
    Junior
    Currently hiring
    Remote work

    OpenKrill

    Brooklyn, NY
    2 days ago
  •  ...with a leading technology innovator, is looking for a skilled software engineer with expertise in Python and LLM applications... Position...  ...Develop and optimize retrieval pipelines Implement and evaluate embeddings and vector search methodologies Enhance observability... 
    Junior
    Full time

    Optomi

    Jersey City, NJ
    4 days ago
  •  ...Junior AI Engineer Optomi, in partnership with a leading technology innovator, is seeking a...  ...Jersey City, NJ! This role is ideal for a software engineer with a strong Python...  ...Familiarity with retrieval pipelines and evaluations. ~ Understanding of OpenTelemetry.... 
    Junior
    Contract work

    Optomi

    Jersey City, NJ
    1 day ago
  •  ...We are looking for a motivated and enthusiastic Junior AI Engineer to join our team and contribute to the development, implementation, and...  ...Prepare, clean, and process datasets for model training and evaluation. Integrate AI models and APIs into existing applications... 
    Junior
    Full time

    Emonics LLC

    Queens, NY
    2 days ago
  •  ...opportunity for you to take your software engineering career to the next level. As...  ...and high-quality production code and maintains algorithms that...  ...enterprise-authorized AI coding assist tools within the...  ...demonstrated ability to critically evaluate, validate, and refine AI-... 
    Work experience placement

    JP Morgan Chase

    Jersey City, NJ
    1 day ago
  •  ...opportunity for you to take your software engineering career to the next level....  ...Perform design reviews and peer code reviews, and promote code...  ...Leverages enterprise-authorized AI coding assist tools within...  ...demonstrated ability to critically evaluate, validate, and refine AI-... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    1 day ago
  •  ...career — and we have the perfect software engineering opportunity for you. As a...  ...troubleshootingWrites secure and high-quality code using the syntax of at least...  ...enterprise-authorized AI coding assist tools within...  ...ability to critically evaluate and validate AI-generated outputsUnderstanding... 

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  •  ...opportunity for you to take your software engineering career to the next level. As...  ...and high-quality production code and maintains algorithms that...  ...enterprise-authorized AI coding assist tools within the...  ...demonstrated ability to critically evaluate, validate, and refine AI-... 

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  •  ...of what's possible. As a Lead Software Engineer at JPMorganChase within Asset...  ...and high-quality production code, and reviews and debugs code...  ...adoption of enterprise-authorized AI-assisted engineering...  ...applications and systemsLeads evaluation sessions with external vendors... 

    JP Morgan Chase

    Jersey City, NJ
    8 hours ago
  • $180k - $230k

     ...TRM Labs provides AI-powered intelligence...  ...experienced Senior Frontend Engineer to join a small but...  ...Participating in code and design reviews...  ...of enterprise software Staying current on...  ...mentorship to junior engineers, and enhances...  ...while allowing you to evaluate TRM. Most interview... 
    Worldwide

    TRM Labs

    Brooklyn, NY
    3 days ago
  •  ...a highly experienced Senior Software Engineer with deep expertise in Python...  ..., and production-grade AI applications . The ideal candidate...  ...and maintain standards for code reviews, automated testing, CI...  ...drift, latency optimization, evaluation quality, and cost management.... 
    Full time

    BrickRed Systems

    Manhattan, NY
    1 day ago
  •  ...of what's possible.As a Lead Software Engineer at JPMorganChase within the Commercial...  ...and high-quality production code, and reviews and debugs code...  ...of enterprise-authorized AI-assisted engineering...  ...applications and systems. Leads evaluation sessions with external vendors... 
    Bank staff

    JP Morgan Chase

    Jersey City, NJ
    1 day ago
  • $25k - $40k

     ...Remote Senior Frontend Software Engineer, Consumer Engineering Job...  ...jsGraphQLRustJavaRESTArtificial Intelligence (AI)ExcelMedicalML engineer“...  ...through thorough code reviews, detailed design doc evaluations, and constructive...  ...practices, and mentor junior and mid-level engineers... 
    Full time
    For contractors
    Work experience placement
    Remote work
    Flexible hours

    FarCoder

    Brooklyn, NY
    4 days ago
  • AcuityMD is the AI platform for MedTech trusted by...  ...agency, where every engineer takes responsibility for...  ...currently looking for Software Engineers to join our growing...  ...agentic tools (Claude Code, Codex, etc) and are...  ...professional experience when evaluating candidates. Obsessed... 
    Remote job
    For contractors
    Work at office
    Work from home
    Home office
    Flexible hours

    AcuityMD, Inc.

    Brooklyn, NY
    1 day ago
  •  ...Optiver, the velocity of our software development is a...  ...Experience team is a strategic engineering function with a clear...  ...are treating AI as something that helps...  ...after. Make automated code review trustworthy. Review...  ...production environments. Build evaluation into the platform.... 
    Work at office
    Remote work
    Shift work

    Optiver

    Brooklyn, NY
    1 day ago
  • $210.8k - $272.8k

    # Senior Software Engineer, Developer ExperienceThumbtack179k-273k USDFull-timeremote...  ...personalized guidance to AI tools and a best-in-class...  ...developer tools like Claude Code, Codex, and Cursor, backed by...  ...org depends on.-Prototype and evaluate new AI developer tools as... 
    Seasonal work
    Local area
    Immediate start

    Devconnectplatform

    Brooklyn, NY
    1 day ago
  • # Software Engineer Simulation Vehicle ModelingApply**Job#: 3054137****Job Description...  ..., the team plays a role in evaluating and advancing autonomous...  ...and help raise the bar on code quality, process, and testing...  ...you agree to receive calls, AI-generated calls, text messages... 
    Full time
    Remote work

    Apex Systems

    Brooklyn, NY
    4 days ago
  •  ...fast, and we need senior engineers who can grow with the...  ...product work, build agentic AI systems that automate...  ..., orchestration, and evaluation pipelines. Streaming &...  ...years of professional software engineering experience...  ...and infrastructure-as-code (Terraform, Pulumi, or... 
    Flexible hours

    Forward

    Brooklyn, NY
    4 days ago
  • Senior Software Engineer - Dev Tools Full-time · Engineering · San Francisco...  ...into our development stream - code review, investigation...  ...and whatdidn't. Enthusiasm for AI tooling is necessary here. It...  ...build and test reliability Evaluate new tools and models against... 
    Full time
    Work at office
    Local area
    Weekend work
    3 days per week

    Meanwhile

    Brooklyn, NY
    4 days ago
  • $180k - $230k

     ...builds telemetry analysis software for hardware engineering teams, and this role works...  ...systems for Sift Agents.* Evaluate agent usefulness and monitor...  ...Similar open jobs: We Love AI Jobs lists 1,635 open senior...  ...design, context management, code execution environments, evaluation... 
    Permanent employment
    Remote work

    We Love AI Jobs

    Brooklyn, NY
    1 day ago
  •  ..., participate in design and code reviews, and promote code quality...  ...efforts. Use authorized AI-assisted development tools...  ...or certification in software engineering concepts and at least 3 years...  ...development tools and critically evaluating and refining their outputs.... 
    Full time

    JPMorgan Chase

    Jersey City, NJ
    1 day ago
  • $61k - $101k

     ...Formal training or certification in software engineering concepts, plus at least 3 years...  ..., debugging, and maintaining code in a large corporate environment...  ...experience with enterprise-authorized AI-assisted development tools, including evaluating and validating generated output... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    2 days ago
  • $42.5k - $70.5k

     ...training or certification in software engineering concepts, with at...  ..., and maintaining code in a large corporate environment...  ...enterprise-authorized AI-assisted development...  ..., with the ability to evaluate, validate, and refine...  ...knowledge and mentor junior engineers. Use... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    4 days ago
  • $61k - $101k

     ...training or certification in software engineering concepts, plus at least 3...  ...applied experience working with AI/ML solutions. Practical...  ...applications, including tracing, evaluations, and guardrails. Deep...  ...those insights to improve coding hygiene and system architecture... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    1 day ago
  •  ...Responsibilities Execute standard software solutions, design,...  ...secure, high-quality code with limited guidance...  ...enterprise-authorized AI-assisted development...  .... Apply software engineering processes, methodologies...  ...ability to critically evaluate and validate AI-generated... 
    Full time

    JPMorgan Chase

    Jersey City, NJ
    4 days ago
  •  ...for you to take your software engineering career to the next level...  ....  Participate in code reviews, testing, and...  ...sharing and mentoring of junior engineers to foster a...  ...enterprise-authorized AI coding assist tools within...  ...ability to critically evaluate, validate, and refine... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    5 days ago
  • $61k - $101k

     ...training or certification in software engineering concepts, along with 3+...  ...of delivering high-quality code. We need hands-on experience...  ...using enterprise-authorized AI-assisted development tools in...  ...investigation, presentation, and evaluation skills, with the ability to... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    4 days ago
  • $130k - $200k

     ...seeking a talented, innovative Senior Software Engineer to join our growing team. As one of...  ...architectural decisions and writing code to expand our AI product line. You will play a...  ...systems, databases, and APIs Implement evaluation and observability infrastructure to... 
    Full time
    Work at office
    Local area
    3 days per week

    CareLink (by Asepha)

    Manhattan, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Junior Software Engineer for AI Code Evaluation. Be the first to apply!