Software Engineer (Python/C++) - Code Evaluation | Remote
Crossing Hurdles
New York, NY
- Remote job
Commitment: Part-time availability with flexibility for increased hours Role Responsibilities Review and refine AI-generated prompts, responses, and code Validate algorithms and software concepts for technical accuracy Provide structured, actionable feedback on solution quality and clarity Tag and organize content by topic, difficulty, or language Support benchmarking efforts to evaluate and compare model capabilities Requirements Strong experience in software engineering, technical research, or educational content development Strong experience with debugging, testing, and validating code Ability to assess technical accuracy and communicate improvements clearly High attention to detail and comfort with technical documentation #J-18808-Ljbffr Crossing Hurdles
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Software Engineer (Python/C++) - Code Evaluation | Remote in New York, NY vacancy
- ...generated prompts, responses, and code Validate algorithms and software concepts for technical accuracy... ...Support benchmarking efforts to evaluate and compare model capabilities... ...Strong experience in software engineering, technical research, or educational...Remote workPart time
Crossing Hurdles
United States4 days ago - ...Role Overview Evaluate and benchmark the coding abilities of frontier AI models... ...them against real-world software engineering tasks, and shaping high... ...following languages: Python, Java, C/C++, Go, Swift, Objective-C... ...week. Work location: Remote, United States only....Remote workContract workFor contractors
SaidGig
United Statesa month ago $50 - $100 per hour
...Apply your software engineering expertise to help train and evaluate next-generation AI systems through real-world coding tasks, technical feedback, and... ...quality analysis. This remote contract role focuses... ...in codebases using Python 3, Java, Rust, C++, Go, or TypeScript....Remote workHourly payContract workFor contractorsSaidGig
United States3 days ago- ...quality human feedback, evaluation, and training data.... ...for experienced Software Engineers to help evaluate, benchmark... ..., and improve the coding capabilities of... ...following languages: Python, Java, C/C++, Go, Swift,... ...Work in a fully remote environment. Opportunity...Remote workContract workTemporary workFor contractorsFreelance
Turing
Remote7 days ago $80 - $100 per hour
...experienced Senior Python Developers to... ...human feedback, AI evaluation, and model alignment... ...AI-generated code, and helping improve... ...opportunity for experienced software engineers who enjoy solving... ...JavaScript, Go, C++, or similar. ~... ...Fully remote contract opportunity...Remote workHourly payWeekly payContract work10 hours per weekLifted, an Upwork Company™
Texas City, TX20 days ago- ...we are building LLM evaluation and training datasets... ...to work on realistic software engineering problems. One of our approaches... ...interact with real code, influencing the... ...following languages: C++ Proficiency with Git... ...Work in a fully remote environment. Opportunity...Remote workContract workFor contractorsFreelance
- ...feedback, and rigorous evaluation frameworks. Our... ...projects spanning coding, reasoning, agentic workflows, software engineering, and multimodal AI... ...experience in Python (mandatory) along... ...such as Java, Go, C++ Demonstrated... ...Work in a fully remote environment....Remote workContract workTemporary workFor contractorsFreelanceWorldwide
Turing
Remote7 days ago - ...quality training data, evaluations, and engineering talent. We are... ...looking for experienced Python Engineers to work with... ...improving next-generation AI coding agents. You will... ...and execute software engineering tasks.... ...systems. Fully remote opportunity. Collaborate...Remote workFull timeContract workTemporary workFlexible hours
Turing
Remote7 days ago $50 per hour
...Role Overview Evaluate, benchmark, and help improve the coding capabilities of advanced AI... ...solutions against real software engineering problems. You will... ...following languages: Python, Java, C/C++, Go, Swift, Objective... ...week. Work location, remote, candidates must be...Remote workContract workFor contractorsSaidGig
United States3 days ago- Turing is seeking a Software Engineering evaluator to help curate datasets for training... ...models. You will focus on Python across backend services,... ...in JavaScript (ReactJS), C/C++, Java, Rust, and Go to evaluate... ...and refine AI-generated code. The engagement is a flexible...For contractors10 hours per weekFlexible hours
$50 - $150 per hour
...Dorsey . Position: Software Engineering Expert Type:... ...Location: Remote Role Responsibilities... ...Responsibilities Write and evaluate code across diverse... ...in one or more of: Python , TypeScript/... ...Java , Go , C#/C++ . ~ Strong ability...Remote workFull timeContract workSummer workMercor
Remote14 hours ago- ...researchers who specialize in software engineering, logical reasoning, STEM,... ...a Software Engineering evaluator, you will create cutting-... .... This includes curating code examples, providing... ...corrections primarily in C/C++ , as well as in Python, JavaScript (including ReactJS...Contract workFor contractorsFlexible hours
$175k - $215k
...Driver. The Simulator Evaluation team faces the... ...We are looking for a Software Engineer to build the metrics... ...and AI, writing the code that processes petabytes... ...robust, efficient code (C++/Python). You will implement... ...role can be performed remote, the specific salary...Remote workFull timeWaymo
San Francisco, CA14 hours ago$204k - $259k
...Driver. The Simulator Evaluation team faces the... ...looking for a Senior Software Engineer to build the metrics... ...throughput pipelines (C++/Python) capable of processing... ...write clean, testable code that is built to last... ...role can be performed remote, the specific salary...Remote workFull timeWaymo
San Francisco, CA14 hours ago$170k - $216k
...states. Waymo's Release Evaluation org ensures that each... ...with other engineers, data scientists, statisticians... .... Champion code health and best practices... ...of languages, such as C++, Python and SQL ~ Performing... ...role can be performed remote, the specific salary range...Remote workFull timeWaymo
San Francisco, CA14 hours ago$170k - $216k
...The Planner Evaluation team works on one... ...the quality of the software that drives the car... ...data-minded software engineers and data scientists... ...outcomes. Champion code health and best... ...languages, such as C++, Python and SQL ~... ...can be performed remote, the specific salary...Remote workFull timeWaymo
San Francisco, CA14 hours ago$170k - $216k
...states. The Perception Evaluation team at Waymo is at... .... We are seeking a Software Engineer play a pivotal role... ...Evaluation Tools: Design, code, test, and maintain... ..., primarily using C++ and Python. Execute Evaluation... ...role can be performed remote, the specific salary...Remote workFull timeWaymo
Remote14 hours ago$85 per hour
...and Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type: Contract... ...: $85/hour Location: Remote Role Responsibilities Use... ...frontier AI coding agents to complete and evaluate complex machine learning and AI engineering...Remote workFull timeContract workSummer workMercor
Remote14 hours ago$60 - $100 per hour
...Dorsey . Position: Software Engineering, Data Science, and... ...hour Location: Remote Role Responsibilities Evaluate LLM-generated responses to coding and software engineering... ...programming languages (e.g., Python, Java, C++, C, JavaScript, Go, Rust...Remote workFull timeContract workSummer workMercor
Remote14 hours ago- ...Overview Advance the evaluation and development of frontier coding agents by designing the... ...combines AI research, software engineering, and model evaluation to... ...background with expertise in Python, C++, or comparable... ...Work Terms ~ Full-time, remote role. Compensation...Remote workFull time
SaidGig
United Statesmore than 2 months ago $100 per hour
...SENIOR AI INTERACTION EVALUATOR (CODEX / CLAUDE CODE) Contract | $100–$200/hour | 10–20 hrs/week | Start ASAP (through early May) Check out... ...8b95dca84b9db60e5 We’re looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with...Full timeContract workImmediate start- ...Performance Engineer Join a cutting-edge AI research initiative... ...with deep knowledge of C++, Python, Rust, and low-level systems... ...high-quality AI training and evaluation data. In this role, you'll... ...full-time, 40-hour-per-week remote engagement requiring full weekday...Remote workFull timeWeekday work
Weekday
United States14 hours ago - ...brilliance. Surge was founded by engineers and researchers who dreamed of building... ...environments to conducting rigorous evaluations that go beyond benchmarks. We've run... ...venture funding. The Role As a Software Engineer, Coding Evaluation & Training Data at Surge,...Full time
Surge AI
United States14 hours ago - ...be comfortable evaluating the execution of... ...about remote care and helping... ...linux user space C++ application, ensuring... ...multithreaded software components (synchronization... ...instrumenting code, and delivering... ...tooling using Python and/or Bash.... ...in Electrical Engineering, Computer...Remote workFull timePart time3 days per week
Empo Health
San Bruno, CA23 days ago $55 - $65 per hour
...PyCharm on macOS Code Review Specialist - Python Engineers is a remote review track for evaluating AI outputs across application users pycharm on macos code specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag...Remote jobFor contractorsWork experience placement10 hours per week- ...including XCOM RAN, its software-defined private... ...throughput. The solution is engineered for mission-critical... ...software using Modern C/C++ and Python software for high... ...designing, developing, coding, testing, and verifying... ...control plane for 5g Remote Radio Units (RRU) and...Remote workFull timeTemporary workWork at office
Globalstarupdated
Remote14 hours ago $120k - $150k
...Overview: We are seeking a Software Engineer to help bridge the gap... ...: translating validated Python prototypes into high-performance C++ implementations,... ...maintainable production code, cares about correctness... ...available for training and evaluation. Reduce engineering toil...Full timeWork experience placementLocal areaVelo3d
Remote14 hours ago- ...validate verifiable software engineering tasks and evaluation datasets derived from... ...models interact with real code. This role combines... ...of these languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.... ...tooling. Perks Fully remote work. Opportunity...Remote workFor contractorsLocal area
SaidGig
United Statesmore than 2 months ago $281k - $356k
...that we can continue to evaluate safety and service... ...technically hands‑on engineering manager with strong quantitative... ...experience with: C++, SQL, and Python experience... ...and modifying a large code base containing C++,... ...role can be performed remote, the specific salary...Remote workFull timeWork experience placement$35 - $45 per hour
...Performance Engineer (C++, Python, Rust) — IN is a remote engineering review track for evaluating C++ code, debugging traces, and developer-facing AI outputs against real-world... ...Code review Debugging Unit testing Software engineering judgment Python...Remote jobFor contractors10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer (Python/C++) - Code Evaluation | Remote. Be the first to apply!
Related searches
- python developer New York, NY
- entry level python developer New York, NY
- senior python developer New York, NY
- python developer data analytics New York, NY
- python developer internship New York, NY
- python developer part time New York, NY
- full stack / python developer (remote) New York, NY
- python developer with big data New York, NY
- python programmer New York, NY
- backend python developer New York, NY