Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Open Source Code Evaluation Engineer

$90 per hour
Temporary

24-MAG

Role Description

We are sharing a specialised part-time consulting opportunity for experienced open-source software engineers with strong public contribution histories and deep expertise in Python, Java, C, JavaScript, TypeScript, or comparable programming languages. This role supports current and upcoming remote consulting opportunities focused on software engineering evaluation, coding task design, test case development, code quality review, and technical assessment across real-world programming scenarios. Selected professionals may apply their open-source experience to evaluate code behaviour, assess engineering approaches, review software architecture, and contribute high-quality technical judgment across multiple programming languages.

Key Responsibilities

  • Coding Evaluation & Task Design
    • Design and review evaluations for a wide range of coding tasks across JavaScript, TypeScript, Python, Java, C, or comparable languages.
    • Assess coding problems for clarity, correctness, practical relevance, and engineering difficulty.
    • Develop test cases that accurately evaluate system behaviour across diverse software engineering scenarios.
    • Review task structure, expected outputs, edge cases, and implementation quality standards.
  • Open-Source Engineering Review
    • Apply open-source engineering experience to assess code quality, maintainability, architecture, performance, and scalability.
    • Review software contributions, libraries, frameworks, and implementation patterns based on real-world development practices.
    • Evaluate whether proposed solutions align with established programming fundamentals and open-source project standards.
    • Identify areas where code, tests, documentation, or evaluation logic can be improved.
  • Software Architecture & Performance Assessment
    • Analyze system behaviour across real-world user scenarios and software workflows.
    • Evaluate architecture choices, code patterns, dependency usage, performance trade-offs, and scalability considerations.
    • Review technical outputs for correctness, efficiency, reliability, and long-term maintainability.
    • Provide structured feedback on strengths, weaknesses, and improvement areas in engineering deliverables.
  • Technical Communication & Collaboration
    • Communicate evaluation results clearly to technical project teams.
    • Document technical reasoning, review decisions, test case logic, and code assessment outcomes.
    • Collaborate within distributed, asynchronous teams using Git-based workflows and engineering review practices.
    • Contribute independent technical judgment while maintaining clear standards for quality and consistency.

Qualifications

  • A strong GitHub or comparable public engineering presence with frequent, high-quality contributions to respected open-source projects within the last 12 months.
  • Expertise in one or more of the following languages: Python, Java, C, JavaScript, or TypeScript.
  • Deep familiarity with widely used libraries, frameworks, developer tools, and ecosystem standards in their language areas.
  • Excellent understanding of programming fundamentals, software architecture, performance tuning, scalable code patterns, and testing practices.
  • Experience using Git, CI/CD systems, code review workflows, and open-source governance practices.
  • Ability to independently identify contribution areas, execute technical improvements, and explain engineering decisions clearly.
  • Strong written communication skills and comfort working independently in a remote, project-based environment.

Requirements

  • A degree in Computer Science, Software Engineering, Computer Engineering, Information Systems, or a related technical field is helpful.
  • Equivalent professional experience and a strong open-source contribution record are also highly relevant.
  • Demonstrated public software engineering work may be especially valuable for this opportunity.

Nice to Have

  • Experience maintaining or contributing regularly to widely used open-source libraries, frameworks, tools, or developer platforms.
  • Familiarity with benchmarking, coding assessments, test harnesses, automated evaluation workflows, or technical review systems.
  • Experience with multiple programming languages across backend, frontend, systems, or tooling environments.
  • Background in distributed engineering teams, asynchronous collaboration, technical documentation, or community-driven software development.
  • Experience reviewing pull requests, triaging issues, writing tests, improving documentation, or participating in release workflows.

Why This Opportunity

  • Flexible, remote consulting work aligned with your open-source engineering expertise.
  • Opportunity to contribute to high-impact software evaluation projects across multiple programming languages and engineering domains.
  • Suitable for experienced open-source contributors who enjoy code review, technical assessment, test case design, and practical engineering problem-solving.
  • Project-based work that can align with part-time availability and remote schedules.

Contract Details

  • Independent contractor engagement.
  • Fully remote and flexible scheduling.
  • Part-time, project-based availability.
  • Expected commitment may vary depending on project scope and matching needs.
  • Compensation may reach up to $90/hour, depending on project scope, experience, and fit.
  • Payments are made weekly via Stripe or Wise based on services rendered.
  • Projects may be extended, shortened, adjusted, or concluded based on project needs and performance.
  • Candidates requiring H1-B or STEM OPT sponsorship support are not eligible at this time.
  • Work must not involve sharing confidential or proprietary information from any employer, client, or institution.

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: .

Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Open Source Code Evaluation Engineer in Remote vacancy
  • $100 - $150 per hour

     ...Role Overview Design, build, and evaluate coding assessments and test suites that measure real-world software behavior across multiple languages, helping shape high-impact open source engineering projects used globally. Key Responsibilities Design and lead creation... 
    Suggested
    Hourly pay
    Remote work

    SaidGig

    United States
    14 hours ago
  • $180k - $240k

     ...Deepgram is looking for a Senior Software Engineer - Model Evaluation & AI Systems to join the team...  ...continuously. ~Help raise the bar through code reviews, technical design discussions...  ...systems. ~Prior involvement in open-source projects, through contributions,... 
    Suggested
    Full time

    Deepgram

    Remote
    1 day ago
  •  ...Canonical is a leading provider of open source software and operating...  ...cloud, data science, AI, engineering innovation and IoT. Our customers...  ..., harnesses, dashboards and code. Our performance and...  ...NodeJS Database performance evaluation - plans, indexing, data modelling... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Worldwide

    Canonical

    Remote
    7 days ago
  •  ...detecting changes in cloud security risk with runtime insights and open source Falco. We are looking for driven team members who want to join...  .... Requirements ~5 years of experience as Software Engineer in cloud native or security domains. ~Excellent analytical... 
    Suggested
    Full time

    Sysdig

    Remote
    14 hours ago
  • $60 - $90 per hour

     ...integrity of complex, multi-step evaluation tasks used to benchmark...  ...task logic and verification code, actively using Python to investigate...  ...in a research-heavy or engineering-heavy domain. At least 1 year...  ...independently on ambiguous, open-ended problems.... 
    Suggested
    Hourly pay
    Full time
    Freelance
    Remote work

    SaidGig

    United States
    1 day ago
  •  ...Are you a talented and self-motivated Senior Software Engineer? Are you passionate about open source technologies? At Web Teks, it’s all about speed and scalability...  ...environment. You may be asked to complete one or more code exercises during the interview process as well as... 
    Full time
    Casual work
    Immediate start
    Flexible hours

    Web Teks

    Remote
    14 hours ago
  • $320k

     ...group of committed researchers, engineers, policy experts, and business...  ...(Model Quality), Claude Code San Francisco, CA or New...  ...tooling, infrastructure, and evaluations. You'll build systems that help...  ...directly for confirmed position openings. How we're different... 
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    Remote
    14 hours ago
  • $106.7k - $130.5k

     ...skilled Security Automation Engineer to serve as a technical leader...  ...resilience. Lead evaluations, Proofs of Concept (POCs), and...  ...reusable automation frameworks, coding standards, configuration management...  ...automation technologies, open-source solutions, and industry best... 
    Full time
    Work experience placement
    Local area
    Remote work

    Zayo Group

    Colorado
    1 day ago
  • $100k - $150k

     ...Autonomous Systems Engineer - Remote    Bright Vision Technologies...  ...to raise the bar through code review, design review, and...  ...over time.  ~ Continuously evaluate emerging robotics technologies...  ...perception pipelines.  ~ Open-source contributions in robotics.... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    United States
    1 day ago
  • $260k - $325k

    Role Description Temporal is looking for a Senior Staff Engineer to join the Open Source Server team as a technical lead. This team works on the core...  ...alerts, runbooks, and documentation. ~Review designs and code, mentor engineers, and help the team make good technical... 
    Full time
    Work from home
    Home office

    Temporal Technologies

    Remote
    5 days ago
  • Role Description The open-source ML leader serves as a bridge between Ideogram’s internal research...  ...open model weights, methodologies, and code. ~Community Leadership: Oversee...  ...Partner with model providers, internal engineers, and external contributors to push AI accessibility... 
    Full time
    Work at office

    Ideogram

    Remote
    3 days ago
  • $120k - $160k

     ...Agentic Security Automation Engineer who thrives on technical challenges...  ...tooling ~Develop evaluation systems ~Create infrastructure...  ...way. Qualifications ~Coding experience in Python,...  ...tools ~Contributions to open-source security or AI projects ~... 
    Full time
    Remote work
    Home office
    Flexible hours

    NowSecure

    Remote
    14 hours ago
  •  ...Solutions Group is seeking a  Test Engineer to support our client’s...  ...Define technical standards, coding guidelines, and best practices.   Evaluate performance results and recommend...  ...systems (GIS) and working with open-source and proprietary geospatial formats... 
    Full time
    For contractors
    Work at office
    Remote work
    Flexible hours
    Night shift

    Freedom Technology Solutions Group, LLC

    Remote
    14 hours ago
  • $50 - $150 per hour

     ...Reinforcement Learning environments that evaluate AI models on complex software engineering workflows. You will design environments that...  .... Contribute production quality code, code reviews, and documentation to open source repositories related to the project. Design... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    14 hours ago
  •  ...AI and Automation, no code-configuration and a connected...  ...data from multiple sources through a single...  ...will redefine how our engineers build in the age of AI...  ...automation tooling, rapidly evaluating and incorporating forward...  ...equal opportunity employer open to all qualified... 
    Full time
    Remote work

    Kustomer

    New York, NY
    14 hours ago
  • $153k - $214k

     ...We are seeking a Senior Developer on our Open Source Team, focused on strengthening 1Password...  ...reading, writing, and reviewing others' code. ~Experience designing extensible,...  ...project's impact and progress visible to engineering, product, and design stakeholders. ~A... 
    Full time
    Work at office
    Immediate start
    Remote work

    1Password

    Remote
    5 days ago
  • $85 per hour

     ...Systems Engineer (Coding Agent Experience) is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against...  ...should have produced. Nice to have Open-source contributions or a public portfolio that demonstrates... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    8 days ago
  • $176k - $237.6k

    Role Description Temporal is looking for a Senior Software Engineer to join the Open Source Server team. This team builds and maintains the core...  ...documentation. ~Participate in design discussions and code reviews to help maintain a high-quality codebase. ~Contribute... 
    Full time
    Work from home
    Home office

    Temporal Technologies

    Remote
    5 days ago
  • $143k - $160k

     ...Instructional Design and Training, Software Engineering and IT Support Services to...  ..., and enhance optimization code, web-based interfaces, Excel/VBA...  ...Python, Pyomo, GAMS, and related open-source or optimization environments. Evaluate and support integration of advanced... 
    Full time
    For contractors
    Work at office
    Local area
    Remote work

    Mks2 Technologies

    Remote
    14 hours ago
  • $62k - $75k

     ...Associate Distribution Engineer Orbital Engineering, Inc. is currently...  ...with the role. This role is open to recent graduates who have...  ...with equipment specifications Evaluate loading of various equipment...  ...National Electric Safety Code (NESC) Standards, Client Standards... 
    Temporary work
    Work at office
    Local area
    Remote work
    Work from home
    Night shift

    Orbital Engineering

    United States
    2 days ago
  • $100k - $150k

     ...We are seeking a GPU Systems Engineer with deep expertise in CUDA programming...  ...to raise the bar through code review, design review, and...  ...performance over time. ~Evaluate new GPU architectures and...  ...infrastructure such as LLVM or MLIR. ~Open-source contributions to GPU or ML... 
    Full time
    Local area
    Immediate start

    Bright Vision Technologies

    Remote
    7 hours ago
  • $100k - $150k

     ...AI Pipeline Engineer - Remote    Bright Vision Technologies is...  ...power modern AI training and evaluation pipelines. The role combines...  ...infrastructure research and emerging open-source tools. Required...  ...including testing, CI/CD, and code review. Excellent communication... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    United States
    1 day ago
  • $195.72k - $234.86k

     ...Come join us. Posting Open Date: Reposted July 29...  ...Staff Hardware Design Engineer As a member of the...  ...assist in performance evaluation to meet platform requirements...  ...Knowledge in open source operating systems,...  ...initiatives. Outside of code, employees are encouraged... 
    Work at office
    Local area
    Remote work
    Flexible hours

    Fastly

    Denver, CO
    2 days ago
  •  ...looking for an experienced Staff Engineer to join our early-stage team...  ...patterns for how we build, evaluate, and scale autonomous...  ...integrate various commercial and open-source large language models, selecting...  ...extensively leveraging advanced AI coding tools to maximize velocity,... 
    Full time
    Immediate start
    Home office

    Mozilla

    Remote
    3 days ago
  • $140k - $180k

     ...proprietary microbial strains , sourced from natural foods and...  ...ingredient for humans later this year, opening up an entirely new market. And...  ...data into action Continuously evaluate which tools in the stack earn...  ...via APIs, webhooks, and no-code orchestration . High agency and... 
    Full time
    Remote work
    Work from home
    Monday to Friday
    Flexible hours

    Rockstar

    New York, NY
    4 days ago
  • $92.1k - $193.6k

     ...high-performing AI Automation Engineer to join our CS Operations –...  ...Use AI to process data, apply evaluation and decision logic, generate...  ...what should be engineered in code (e.g., Python). ~Assess which...  ...Quick Automate, UnifyApps, open source, and others). ~Stay ahead... 
    Full time
    Flexible hours

    Proofpoint

    Remote
    3 days ago
  • $172.36k - $258.55k

     ...Description The Senior AI & Automation Engineer is a senior individual...  ...process automation. ~Evaluate and architect enterprise-wide...  ...junior engineers through hands-on code reviews, design critiques,...  ...communities, conferences, or open-source contributions demonstrating technical... 
    Full time
    Work experience placement

    Alignment Health

    Remote
    7 days ago
  • $80k - $130k

     ...Job Title: Project Engineer - Infrastructure Job Description...  ...applicable design codes and establish overall...  ...with managers to evaluate cost and schedule impacts...  ...This role is based in an open office environment with...  ...hiring process, including sourcing, screening, and... 
    Permanent employment
    Temporary work
    Work at office
    Work from home
    Monday to Friday
    Flexible hours

    Actalent

    Columbus, OH
    3 days ago
  • $40 - $90 per hour

     ...Mechanical Engineer | 100% Remote (ET/CT) We're looking...  ...solving through design and evaluation-while working on...  ...knowledge of relevant codes, standards, and regulations...  ...values quality work and open communication. There's...  ...hiring process, including sourcing, screening, and... 
    Contract work
    Temporary work
    Remote work

    Actalent

    Chicago, IL
    4 days ago
  • $60 - $100 per hour

     ...Position: Software Engineering, Data Science, and Systems...  ...Responsibilities Evaluate LLM-generated responses to coding and software engineering...  ...checking using trusted public sources and authoritative...  ...contributing to well-known open-source projects, including... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    14 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Open Source Code Evaluation Engineer. Be the first to apply!