Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote | Open Source Code Evaluation Engineer — Up to $90/hour

$90 per hour

24-MAG

New York, NY
  • Remote job

We are sharing a specialised part-time consulting opportunity for experienced open-source software engineers with strong public contribution histories and deep expertise in Python, Java, C, JavaScript, TypeScript, or comparable programming languages.

This role supports current and upcoming remote consulting opportunities focused on software engineering evaluation, coding task design, test case development, code quality review, and technical assessment across real-world programming scenarios. Selected professionals may apply their open-source experience to evaluate code behaviour, assess engineering approaches, review software architecture, and contribute high-quality technical judgment across multiple programming languages.

Key Responsibilities

Professionals in this role may contribute to:

Coding Evaluation & Task Design

  • Design and review evaluations for a wide range of coding tasks across JavaScript, TypeScript, Python, Java, C, or comparable languages
  • Assess coding problems for clarity, correctness, practical relevance, and engineering difficulty
  • Develop test cases that accurately evaluate system behaviour across diverse software engineering scenarios
  • Review task structure, expected outputs, edge cases, and implementation quality standards

Open-Source Engineering Review

  • Apply open-source engineering experience to assess code quality, maintainability, architecture, performance, and scalability
  • Review software contributions, libraries, frameworks, and implementation patterns based on real-world development practices
  • Evaluate whether proposed solutions align with established programming fundamentals and open-source project standards
  • Identify areas where code, tests, documentation, or evaluation logic can be improved

Software Architecture & Performance Assessment

  • Analyze system behaviour across real-world user scenarios and software workflows
  • Evaluate architecture choices, code patterns, dependency usage, performance trade-offs, and scalability considerations
  • Review technical outputs for correctness, efficiency, reliability, and long-term maintainability
  • Provide structured feedback on strengths, weaknesses, and improvement areas in engineering deliverables

Technical Communication & Collaboration

  • Communicate evaluation results clearly to technical project teams
  • Document technical reasoning, review decisions, test case logic, and code assessment outcomes
  • Collaborate within distributed, asynchronous teams using Git-based workflows and engineering review practices
  • Contribute independent technical judgment while maintaining clear standards for quality and consistency

Ideal Profile

Strong candidates may have:

  • A strong GitHub or comparable public engineering presence with frequent, high-quality contributions to respected open-source projects within the last 12 months
  • Expertise in one or more of the following languages: Python, Java, C, JavaScript, or TypeScript
  • Deep familiarity with widely used libraries, frameworks, developer tools, and ecosystem standards in their language areas
  • Excellent understanding of programming fundamentals, software architecture, performance tuning, scalable code patterns, and testing practices
  • Experience using Git, CI/CD systems, code review workflows, and open-source governance practices
  • Ability to independently identify contribution areas, execute technical improvements, and explain engineering decisions clearly
  • Strong written communication skills and comfort working independently in a remote, project-based environment

Educational Background

  • A degree in Computer Science, Software Engineering, Computer Engineering, Information Systems, or a related technical field is helpful
  • Equivalent professional experience and a strong open-source contribution record are also highly relevant
  • Demonstrated public software engineering work may be especially valuable for this opportunity

Nice to Have

  • Experience maintaining or contributing regularly to widely used open-source libraries, frameworks, tools, or developer platforms
  • Familiarity with benchmarking, coding assessments, test harnesses, automated evaluation workflows, or technical review systems
  • Experience with multiple programming languages across backend, frontend, systems, or tooling environments
  • Background in distributed engineering teams, asynchronous collaboration, technical documentation, or community-driven software development
  • Experience reviewing pull requests, triaging issues, writing tests, improving documentation, or participating in release workflows

Why This Opportunity

  • Flexible, remote consulting work aligned with your open-source engineering expertise
  • Opportunity to contribute to high-impact software evaluation projects across multiple programming languages and engineering domains
  • Suitable for experienced open-source contributors who enjoy code review, technical assessment, test case design, and practical engineering problem-solving
  • Project-based work that can align with part-time availability and remote schedules

Contract Details

  • Independent contractor engagement
  • Fully remote and flexible scheduling
  • Part-time, project-based availability
  • Expected commitment may vary depending on project scope and matching needs
  • Compensation may reach up to $90/hour, depending on project scope, experience, and fit
  • Payments are made weekly via Stripe or Wise based on services rendered
  • Projects may be extended, shortened, adjusted, or concluded based on project needs and performance
  • Candidates requiring H1-B or STEM OPT sponsorship support are not eligible at this time
  • Work must not involve sharing confidential or proprietary information from any employer, client, or institution

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: .

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote | Open Source Code Evaluation Engineer — Up to $90/hour in New York, NY vacancy
  • $90 per hour

     ...About the job Remote | Secure Code & Architecture Evaluation Engineer - Up to $90/hour We are sharing a specialised remote consulting opportunity for experienced security engineers with strong coding agent experience, practical secure engineering judgment, and... 
    Remote work
    Contract work
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    1 day ago
  • $90 per hour

     ...About the job Remote | Machine Learning Systems Evaluation Engineer - Up to $90/hour We are sharing a specialised remote consulting opportunity for experienced machine learning engineers with strong coding agent experience, production ML judgment, and the ability... 
    Remote work
    Contract work
    For contractors
    Flexible hours

    24-MAG LLC

    United States
    1 day ago
  • $150 per hour

     ...0/hr - $150.00/hr Type: Hourly contract Compensation: $...  ...starting rate) Location: Remote Commitment: Flexible,...  ...and maintain well-known open‑source repositories through meaningful code contributions. Author, review...  .... Apply expert‑level engineering judgment to solve complex... 
    Remote work
    Hourly pay
    Contract work
    Immediate start
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • $60 - $90 per hour

     ...and mechanical engineering professionals experienced...  ...and benchmark evaluation workflows....  ...and upcoming remote consulting...  ...Experience writing code that calls...  ...publications, open-source contributions,...  ...approximately 15–20 hours per week depending...  ...between $60–$90 per hour depending... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    24-MAG

    New York, NY
    6 days ago
  • $90 per hour

     ...sharing a specialised remote consulting...  ...and trust & safety engineering professionals with strong coding agent experience and...  ...and risk engineering evaluation, coding-agent-assisted...  ...run in focused 12–24 hour sprint windows depending...  ...Compensation may reach up to $90/hour, depending on... 
    Remote job
    Contract work
    For contractors
    Flexible hours

    24-MAG

    New York, NY
    5 days ago
  •  ...A leading open source software company is hiring software engineers with strong skills in C/C++, Go, and Rust. The role focuses...  ..., and writing high-quality code. Candidates should have a solid academic...  ...skills. The position allows for remote work with occasional in-person... 
    Remote work

    Canonical

    New York, NY
    4 days ago
  •  ...A leading open source software provider seeks exceptional software engineers to work on virtualization and container technology....  ...features and writing high-quality code. Ideal candidates have strong...  ...The company offers a flexible remote-first environment with competitive... 
    Remote work
    Flexible hours

    Canonical

    Spokane, WA
    4 days ago
  •  ...A leading open source software provider in Ohio is looking for exceptional software engineers to work on virtualization and container technology....  ...related fields. This role offers remote work opportunities with a focus on high-quality code development and collaboration... 
    Remote work

    Canonical

    Delhi, OH
    4 days ago
  •  ...Join Our Team Are you passionate about clean code? Love open-source technology? Do you want to be a part of building this country's fastest-growing social media company that champions free speech? If you are interested in joining our team but do not see a role that... 
    Remote work
    Apprenticeship
    Local area

    TMTG

    United States
    1 day ago
  • $150 per hour

    A tech company fostering open-source collaboration is seeking a software engineer to contribute to well-known repositories. This remote role requires active participation in managing pull...  ...independently. The position offers flexible hours at a competitive rate of $150 per hour... 
    Remote job
    Hourly pay
    Contract work
    Immediate start
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • $60 per hour

     ...contribute to innovative AI systems. This fully remote role allows you to choose projects and...  ...earning competitive pay of up to $60 USD/hour. Responsibilities include solving coding problems, writing high-quality code, and evaluating AI-generated outputs. Candidates should... 
    Remote job

    DataAnnotation

    Oklahoma City, OK
    5 days ago
  • A leading open source software company is looking for a Junior Software Developer for a remote position primarily for the Americas region. The role involves collaborating with...  ...globally distributed team, writing high-quality code, and debugging issues. Strong skills in... 
    Remote job

    Canonical

    Tacoma, WA
    5 days ago
  •  ...Canonical is a leading provider of open source software and operating...  ...public cloud, data science, AI, engineering innovation and IoT. Our...  ...critical and mission-critical code, focused on software delivery...  ...technologies. Location : we have remote container and virt... 
    Remote work
    Work at office
    Local area
    Worldwide

    Canonical

    Los Angeles, CA
    4 days ago
  • $60 per hour

     ...to cutting-edge AI systems. This remote role allows you to choose your projects...  ...include designing coding problems, writing code snippets, and evaluating AI-generated code. Candidates should...  ...languages. Competitive pay up to $60/hour is offered, with opportunities for... 
    Remote job

    DataAnnotation

    Phoenix, AZ
    2 days ago
  •  ...practices Position: Principal Open Source Technologist Location: Austin, TX (Remote) About The Opportunity The...  ...contributions from client's engineersEnsure code quality and adherence to open...  ...community leaders Mentor engineers on open source contribution... 
    Remote work
    Permanent employment
    Local area
    Visa sponsorship

    ALTEN

    Austin, TX
    4 days ago
  •  ...SME Careers is looking for a Vue.js / Nuxt Engineer to work remotely on an hourly basis. You will review AI-generated code, develop training content, and assess AI performance...  ...focus on performance optimization and detailed code evaluation is essential. #J-18808-Ljbffr... 
    Remote work
    Hourly pay

    SME Careers

    New Bremen, OH
    23 hours ago
  • Storyblok is seeking a Developer Experience (DX) Engineer to enhance the developer experience for our open-source packages. This involves coordinating...  ...skills. This position is fully remote with flexible working hours and offers a comprehensive benefits package... 
    Remote job
    Flexible hours

    Storyblok

    New Bremen, OH
    4 days ago
  • $80 per hour

     ...research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding...  ...realistic fraud, risk, and trust & safety engineering workflows and model evaluation....  ...based project that runs in 12-24 hour stretches based on client... 
    Remote job
    Hourly pay

    Mercor

    Redwood City, CA
    1 day ago
  • $400 per month

     ...an exciting project to improve frontier AI coding models. The role involves using AI coding agents to evaluate complex engineering tasks and assess model-generated outputs. Candidates...  ...is $400 per accepted task, with tasks typically taking 2-3 hours. #J-18808-Ljbffr Mercor
    Remote job

    Mercor

    Mesquite, TX
    2 days ago
  • $400 per month

    Mercor is looking for Frontier Code Agents to evaluate and improve coding models based on structured...  ...candidates will have 2+ years of systems engineering experience and knowledge of AI coding...  ...task, with typical tasks requiring 2-3 hours of work. #J-18808-Ljbffr Mercor
    Remote job

    Mercor

    Hanover Park, IL
    2 days ago
  • $400 per month

     ...research lab to support a Frontier Code Agents project. This role involves evaluating and improving frontier AI coding...  ...using AI coding agents for engineering tasks, reviewing generated code,...  ...0 each, with projects in sprints of 12-24 hours. #J-18808-Ljbffr Mercor
    Remote job

    Mercor

    Kent, WA
    2 days ago
  •  ...Computer Systems Engineer - 2 Openings Location: Onsite...  ...extension Working hours: Typically 8-4 or...  ...hours). Hybrid/Remote Option: Not...  ...activities include coding, integrating, implementing...  ...products. • Evaluate technical options...  ...Success in first 90 days: Ability to... 
    Remote work
    Work at office
    Local area
    Relocation

    divihn.com

    Saint Paul, MN
    2 days ago
  • $400 per month

     ...a role supporting a Frontier Code Agents project in collaboration...  ...lab. Applicants will evaluate AI coding models through structured...  ...assessments, focusing on systems engineering workflows. Candidates should...  ...task, typically taking 2-3 hours. If you possess relevant... 
    Remote job

    Mercor

    Littleton, CO
    2 days ago
  • $230.8k - $271.2k

     ...platform is seeking an experienced Staff Engineer to enhance Flink SQL components for...  ...on developing systems, maintaining code quality, and engaging in open source contributions. Ideal candidates...  ...mentoring skills. The position is remote, offering competitive compensation... 
    Remote job

    Confluent

    Nashville, TN
    4 days ago
  •  ...A leading open source software company is seeking exceptional software engineers focused on virtualization and container technology. Candidates should have experience with Go, Rust, or C/C++, and a strong background in open-source projects. The role includes designing... 
    Remote work

    Canonical

    Boise, ID
    4 days ago
  •  ...A leading open source software firm is seeking exceptional software engineers to work on virtualization and container technology. You'll engage with upstream communities...  ...analysis, and work collaboratively in a remote-first environment. Ideal candidates have strong... 
    Remote work

    Canonical Group Ltd

    Charlotte, NC
    4 days ago
  •  ...A leading open-source technology company seeks exceptional software engineers to focus on virtualisation and container technology. You'll work remotely in a collaborative environment with global teams on next-generation open-source projects. Ideal candidates have strong... 
    Remote work

    Canonical Group Ltd

    Baltimore, MD
    4 days ago
  •  ...technology firm is seeking skilled software engineers for roles focused on virtualization and...  ...with Linux-based systems. This remote-first company values performance and security...  ...communication skills, with a commitment to excellence in open-source development. #J-18808-Ljbffr... 
    Remote work

    Canonical Group Ltd

    Chicago, IL
    4 days ago
  •  ...A leading open source software company is seeking exceptional software engineers to work on virtualization and container technology. Candidates should have strong backgrounds...  ...in open-source projects. The role supports remote work, requiring collaboration with a distributed... 
    Remote work

    Canonical

    Atlanta, GA
    4 days ago
  •  ...A leading open source software company is seeking exceptional software engineers to focus on virtualization and container technology. This is a remote position where candidates will design new features, conduct security analysis, and collaborate with a distributed team... 
    Remote work

    Canonical

    Buffalo, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote | Open Source Code Evaluation Engineer — Up to $90/hour. Be the first to apply!