Open Source Code Evaluation Engineer
$90 per hour24-MAG
Role Description
We are sharing a specialised part-time consulting opportunity for experienced open-source software engineers with strong public contribution histories and deep expertise in Python, Java, C, JavaScript, TypeScript, or comparable programming languages. This role supports current and upcoming remote consulting opportunities focused on software engineering evaluation, coding task design, test case development, code quality review, and technical assessment across real-world programming scenarios. Selected professionals may apply their open-source experience to evaluate code behaviour, assess engineering approaches, review software architecture, and contribute high-quality technical judgment across multiple programming languages.
Key Responsibilities
- Coding Evaluation & Task Design
- Design and review evaluations for a wide range of coding tasks across JavaScript, TypeScript, Python, Java, C, or comparable languages.
- Assess coding problems for clarity, correctness, practical relevance, and engineering difficulty.
- Develop test cases that accurately evaluate system behaviour across diverse software engineering scenarios.
- Review task structure, expected outputs, edge cases, and implementation quality standards.
- Open-Source Engineering Review
- Apply open-source engineering experience to assess code quality, maintainability, architecture, performance, and scalability.
- Review software contributions, libraries, frameworks, and implementation patterns based on real-world development practices.
- Evaluate whether proposed solutions align with established programming fundamentals and open-source project standards.
- Identify areas where code, tests, documentation, or evaluation logic can be improved.
- Software Architecture & Performance Assessment
- Analyze system behaviour across real-world user scenarios and software workflows.
- Evaluate architecture choices, code patterns, dependency usage, performance trade-offs, and scalability considerations.
- Review technical outputs for correctness, efficiency, reliability, and long-term maintainability.
- Provide structured feedback on strengths, weaknesses, and improvement areas in engineering deliverables.
- Technical Communication & Collaboration
- Communicate evaluation results clearly to technical project teams.
- Document technical reasoning, review decisions, test case logic, and code assessment outcomes.
- Collaborate within distributed, asynchronous teams using Git-based workflows and engineering review practices.
- Contribute independent technical judgment while maintaining clear standards for quality and consistency.
Qualifications
- A strong GitHub or comparable public engineering presence with frequent, high-quality contributions to respected open-source projects within the last 12 months.
- Expertise in one or more of the following languages: Python, Java, C, JavaScript, or TypeScript.
- Deep familiarity with widely used libraries, frameworks, developer tools, and ecosystem standards in their language areas.
- Excellent understanding of programming fundamentals, software architecture, performance tuning, scalable code patterns, and testing practices.
- Experience using Git, CI/CD systems, code review workflows, and open-source governance practices.
- Ability to independently identify contribution areas, execute technical improvements, and explain engineering decisions clearly.
- Strong written communication skills and comfort working independently in a remote, project-based environment.
Requirements
- A degree in Computer Science, Software Engineering, Computer Engineering, Information Systems, or a related technical field is helpful.
- Equivalent professional experience and a strong open-source contribution record are also highly relevant.
- Demonstrated public software engineering work may be especially valuable for this opportunity.
Nice to Have
- Experience maintaining or contributing regularly to widely used open-source libraries, frameworks, tools, or developer platforms.
- Familiarity with benchmarking, coding assessments, test harnesses, automated evaluation workflows, or technical review systems.
- Experience with multiple programming languages across backend, frontend, systems, or tooling environments.
- Background in distributed engineering teams, asynchronous collaboration, technical documentation, or community-driven software development.
- Experience reviewing pull requests, triaging issues, writing tests, improving documentation, or participating in release workflows.
Why This Opportunity
- Flexible, remote consulting work aligned with your open-source engineering expertise.
- Opportunity to contribute to high-impact software evaluation projects across multiple programming languages and engineering domains.
- Suitable for experienced open-source contributors who enjoy code review, technical assessment, test case design, and practical engineering problem-solving.
- Project-based work that can align with part-time availability and remote schedules.
Contract Details
- Independent contractor engagement.
- Fully remote and flexible scheduling.
- Part-time, project-based availability.
- Expected commitment may vary depending on project scope and matching needs.
- Compensation may reach up to $90/hour, depending on project scope, experience, and fit.
- Payments are made weekly via Stripe or Wise based on services rendered.
- Projects may be extended, shortened, adjusted, or concluded based on project needs and performance.
- Candidates requiring H1-B or STEM OPT sponsorship support are not eligible at this time.
- Work must not involve sharing confidential or proprietary information from any employer, client, or institution.
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: .
$100 - $150 per hour
...Role Overview Design, build, and evaluate coding assessments and test suites that measure real-world software behavior across multiple languages, helping shape high-impact open source engineering projects used globally. Key Responsibilities Design and lead creation...SuggestedHourly payRemote work$180k - $240k
...Deepgram is looking for a Senior Software Engineer - Model Evaluation & AI Systems to join the team... ...continuously. ~Help raise the bar through code reviews, technical design discussions... ...systems. ~Prior involvement in open-source projects, through contributions,...SuggestedFull time- ...Canonical is a leading provider of open source software and operating... ...cloud, data science, AI, engineering innovation and IoT. Our customers... ..., harnesses, dashboards and code. Our performance and... ...NodeJS Database performance evaluation - plans, indexing, data modelling...SuggestedFull timeWork at officeLocal areaRemote workWork from homeWorldwide
- ...detecting changes in cloud security risk with runtime insights and open source Falco. We are looking for driven team members who want to join... .... Requirements ~5 years of experience as Software Engineer in cloud native or security domains. ~Excellent analytical...SuggestedFull time
$60 - $90 per hour
...integrity of complex, multi-step evaluation tasks used to benchmark... ...task logic and verification code, actively using Python to investigate... ...in a research-heavy or engineering-heavy domain. At least 1 year... ...independently on ambiguous, open-ended problems....SuggestedHourly payFull timeFreelanceRemote work- ...Are you a talented and self-motivated Senior Software Engineer? Are you passionate about open source technologies? At Web Teks, it’s all about speed and scalability... ...environment. You may be asked to complete one or more code exercises during the interview process as well as...Full timeCasual workImmediate startFlexible hours
$320k
...group of committed researchers, engineers, policy experts, and business... ...(Model Quality), Claude Code San Francisco, CA or New... ...tooling, infrastructure, and evaluations. You'll build systems that help... ...directly for confirmed position openings. How we're different...Full timeWork experience placementWork at officeVisa sponsorshipFlexible hours$106.7k - $130.5k
...skilled Security Automation Engineer to serve as a technical leader... ...resilience. Lead evaluations, Proofs of Concept (POCs), and... ...reusable automation frameworks, coding standards, configuration management... ...automation technologies, open-source solutions, and industry best...Full timeWork experience placementLocal areaRemote work$100k - $150k
...Autonomous Systems Engineer - Remote Bright Vision Technologies... ...to raise the bar through code review, design review, and... ...over time. ~ Continuously evaluate emerging robotics technologies... ...perception pipelines. ~ Open-source contributions in robotics....Full timeH1bLocal areaImmediate startRemote workVisa sponsorship$260k - $325k
Role Description Temporal is looking for a Senior Staff Engineer to join the Open Source Server team as a technical lead. This team works on the core... ...alerts, runbooks, and documentation. ~Review designs and code, mentor engineers, and help the team make good technical...Full timeWork from homeHome office- Role Description The open-source ML leader serves as a bridge between Ideogram’s internal research... ...open model weights, methodologies, and code. ~Community Leadership: Oversee... ...Partner with model providers, internal engineers, and external contributors to push AI accessibility...Full timeWork at office
$120k - $160k
...Agentic Security Automation Engineer who thrives on technical challenges... ...tooling ~Develop evaluation systems ~Create infrastructure... ...way. Qualifications ~Coding experience in Python,... ...tools ~Contributions to open-source security or AI projects ~...Full timeRemote workHome officeFlexible hours- ...Solutions Group is seeking a Test Engineer to support our client’s... ...Define technical standards, coding guidelines, and best practices. Evaluate performance results and recommend... ...systems (GIS) and working with open-source and proprietary geospatial formats...Full timeFor contractorsWork at officeRemote workFlexible hoursNight shift
$50 - $150 per hour
...Reinforcement Learning environments that evaluate AI models on complex software engineering workflows. You will design environments that... .... Contribute production quality code, code reviews, and documentation to open source repositories related to the project. Design...Hourly payFor contractorsRemote work- ...AI and Automation, no code-configuration and a connected... ...data from multiple sources through a single... ...will redefine how our engineers build in the age of AI... ...automation tooling, rapidly evaluating and incorporating forward... ...equal opportunity employer open to all qualified...Full timeRemote work
$153k - $214k
...We are seeking a Senior Developer on our Open Source Team, focused on strengthening 1Password... ...reading, writing, and reviewing others' code. ~Experience designing extensible,... ...project's impact and progress visible to engineering, product, and design stakeholders. ~A...Full timeWork at officeImmediate startRemote work$85 per hour
...Systems Engineer (Coding Agent Experience) is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against... ...should have produced. Nice to have Open-source contributions or a public portfolio that demonstrates...Remote jobFor contractors10 hours per week$176k - $237.6k
Role Description Temporal is looking for a Senior Software Engineer to join the Open Source Server team. This team builds and maintains the core... ...documentation. ~Participate in design discussions and code reviews to help maintain a high-quality codebase. ~Contribute...Full timeWork from homeHome office$143k - $160k
...Instructional Design and Training, Software Engineering and IT Support Services to... ..., and enhance optimization code, web-based interfaces, Excel/VBA... ...Python, Pyomo, GAMS, and related open-source or optimization environments. Evaluate and support integration of advanced...Full timeFor contractorsWork at officeLocal areaRemote work$62k - $75k
...Associate Distribution Engineer Orbital Engineering, Inc. is currently... ...with the role. This role is open to recent graduates who have... ...with equipment specifications Evaluate loading of various equipment... ...National Electric Safety Code (NESC) Standards, Client Standards...Temporary workWork at officeLocal areaRemote workWork from homeNight shift$100k - $150k
...We are seeking a GPU Systems Engineer with deep expertise in CUDA programming... ...to raise the bar through code review, design review, and... ...performance over time. ~Evaluate new GPU architectures and... ...infrastructure such as LLVM or MLIR. ~Open-source contributions to GPU or ML...Full timeLocal areaImmediate start$100k - $150k
...AI Pipeline Engineer - Remote Bright Vision Technologies is... ...power modern AI training and evaluation pipelines. The role combines... ...infrastructure research and emerging open-source tools. Required... ...including testing, CI/CD, and code review. Excellent communication...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship$195.72k - $234.86k
...Come join us. Posting Open Date: Reposted July 29... ...Staff Hardware Design Engineer As a member of the... ...assist in performance evaluation to meet platform requirements... ...Knowledge in open source operating systems,... ...initiatives. Outside of code, employees are encouraged...Work at officeLocal areaRemote workFlexible hours- ...looking for an experienced Staff Engineer to join our early-stage team... ...patterns for how we build, evaluate, and scale autonomous... ...integrate various commercial and open-source large language models, selecting... ...extensively leveraging advanced AI coding tools to maximize velocity,...Full timeImmediate startHome office
$140k - $180k
...proprietary microbial strains , sourced from natural foods and... ...ingredient for humans later this year, opening up an entirely new market. And... ...data into action Continuously evaluate which tools in the stack earn... ...via APIs, webhooks, and no-code orchestration . High agency and...Full timeRemote workWork from homeMonday to FridayFlexible hours$92.1k - $193.6k
...high-performing AI Automation Engineer to join our CS Operations –... ...Use AI to process data, apply evaluation and decision logic, generate... ...what should be engineered in code (e.g., Python). ~Assess which... ...Quick Automate, UnifyApps, open source, and others). ~Stay ahead...Full timeFlexible hours$172.36k - $258.55k
...Description The Senior AI & Automation Engineer is a senior individual... ...process automation. ~Evaluate and architect enterprise-wide... ...junior engineers through hands-on code reviews, design critiques,... ...communities, conferences, or open-source contributions demonstrating technical...Full timeWork experience placement$80k - $130k
...Job Title: Project Engineer - Infrastructure Job Description... ...applicable design codes and establish overall... ...with managers to evaluate cost and schedule impacts... ...This role is based in an open office environment with... ...hiring process, including sourcing, screening, and...Permanent employmentTemporary workWork at officeWork from homeMonday to FridayFlexible hours$40 - $90 per hour
...Mechanical Engineer | 100% Remote (ET/CT) We're looking... ...solving through design and evaluation-while working on... ...knowledge of relevant codes, standards, and regulations... ...values quality work and open communication. There's... ...hiring process, including sourcing, screening, and...Contract workTemporary workRemote work$60 - $100 per hour
...Position: Software Engineering, Data Science, and Systems... ...Responsibilities Evaluate LLM-generated responses to coding and software engineering... ...checking using trusted public sources and authoritative... ...contributing to well-known open-source projects, including...Full timeContract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Open Source Code Evaluation Engineer. Be the first to apply!













