Software Engineer (Python/C++) - Code Evaluation | Remote

Crossing Hurdles

Remote job

Commitment: Part-time availability with flexibility for increased hours Role Responsibilities Review and refine AI-generated prompts, responses, and code Validate algorithms and software concepts for technical accuracy Provide structured, actionable feedback on solution quality and clarity Tag and organize content by topic, difficulty, or language Support benchmarking efforts to evaluate and compare model capabilities Requirements Strong experience in software engineering, technical research, or educational content development Strong experience with debugging, testing, and validating code Ability to assess technical accuracy and communicate improvements clearly High attention to detail and comfort with technical documentation #J-18808-Ljbffr Crossing Hurdles

Apply

Vacancy posted 15 hours ago

Similar jobs that could be interesting for youBased on the Software Engineer (Python/C++) - Code Evaluation | Remote in New York, NY vacancy

Software Engineer for AI Code Evaluation and Benchmarking
...Role Overview Evaluate and benchmark the coding abilities of frontier AI models... ...them against real-world software engineering tasks, and shaping high... ...following languages: Python, Java, C/C++, Go, Swift, Objective-C... ...week. Work location: Remote, United States only....
Remote work
Contract work
For contractors
SaidGig
United States
12 days ago
Software Engineer for AI Code Evaluation
$90 per hour
...Role Overview Software Engineers evaluate AI-generated code and technical content, providing structured, experience... ...least one major language such as Python, Java, C++, JavaScript, or Go. ~... ...time, hourly contract engagement, remote and asynchronous. Flexible hours...
Remote work
Hourly pay
Ongoing contract
Contract work
Part time
Internship
Flexible hours
SaidGig
United States
more than 2 months ago
Software Engineer for AI Code Evaluation
$25 per hour
...Role Overview Software Engineers apply production software development experience to evaluate AI-generated code and technical content, provide structured... ...language, for example Python, Java, C++, JavaScript, or Go.... ...type: Part-time, remote, hourly contract. Work...
Remote work
Hourly pay
Contract work
Part time
Internship
Flexible hours
SaidGig
United States
a month ago
Senior Python Engineer - AI Code Evaluation (Codex / Claude Code, up to $200/hr)
$100 per hour
...Our partner is looking for a Senior Python Engineer - AI Code Evaluation based in the United States. This... ...Rather than building production software, you’ll apply your engineering judgment... ...Claude Code, and Cursor in a flexible, remote environment. The engagement...
Remote job
Hourly pay
Contract work
Temporary work
Immediate start
10 hours per week
Flexible hours
jobgether
United States
15 hours ago
Senior Software Engineer AI Evaluation & Benchmarks (Python)
$80 - $100 per hour
...Design and build the coding benchmarks and evaluation pipelines used to... ...AI models on real software engineering work: Design coding... ...) ~ Expert Python — clean, performant... ...languages: JavaScript, Go, C++, or others CI/CD... ...Location: Fully remote — work from anywhere...
Remote job
Full time
Contract work
For contractors
G2i
Miami, FL
1 day ago
Senior Python Developer (AI Evaluation & Benchmarking)
$80 - $100 per hour
...experienced Senior Python Developers to... ...human feedback, AI evaluation, and model alignment... ...AI-generated code, and helping improve... ...opportunity for experienced software engineers who enjoy solving... ...JavaScript, Go, C++, or similar. ~... ...Fully remote contract opportunity...
Remote work
Hourly pay
Weekly pay
Contract work
10 hours per week
Lifted, an Upwork Company™
Texas City, TX
a month ago
Senior Python Engineer - AI Code Evaluation
$100 per hour
...Description We’re looking for a highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code... ...the below: ~TypeScript / JavaScript ~Python ~Hands-on experience using: ~OpenAI...
Contract work
Immediate start
G2i Inc.
Remote
20 hours ago
Senior Python Engineer - AI Code Evaluator
United States Digital Space LLC seeks a Software Engineering evaluator to create cutting-edge datasets for training AI models, focusing on Python across backend services, data pipelines... .... You will evaluate AI-generated code, ensuring efficiency, scalability, and...
United States Digital Space LLC
New York, NY
2 days ago
Sr. Software Engineer (C++, Python) - US
...Eventus Software is looking to hire a highly... ...Senior Software Engineer to join our dynamic... ..., with focus in C++ and Python You will help... ...architectural direction by evaluating potential... ...excellent code in several languages... ...work effectively remotely You are able to...
Remote work
Full time
Eventus Systems, Inc.
United States
4 days ago
Open Source Code Evaluation Engineer
$90 per hour
...for experienced open-source software engineers with strong public... ...histories and deep expertise in Python, Java, C, JavaScript, TypeScript... ...current and upcoming remote consulting opportunities focused... ...on software engineering evaluation, coding task design, test case development...
Remote work
Contract work
Part time
For contractors
Flexible hours
24-MAG
Remote
a month ago
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)
...companies, focused on testing, evaluating, and improving AI... ...dataset to evaluate AI coding agents - how well a model... ...data labeling Not prompt engineering Not writing code from... ...look for: 8+ years in software development Core stack: Python (FastAPI), JavaScript/TypeScript...
Permanent employment
Temporary work
Freelance
Mindrift
Brooklyn, NY
15 hours ago
Remote Senior Python Engineer - LLM Evaluation (US-based)
...pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality,... ...Project Overview What Does a Typical Day Look Like? Evaluate and refine AI-generated code across backend and frontend contexts to ensure that...
Remote job
For contractors
Flexible hours
Turing
Chicago, IL
1 day ago
Software Engineer for AI Code Evaluation and Benchmarking
$50 per hour
...Role Overview Evaluate, benchmark, and help improve the coding capabilities of advanced AI... ...solutions against real software engineering problems. You will... ...following languages: Python, Java, C/C++, Go, Swift, Objective... ...week. Work location, remote, candidates must be...
Remote work
Contract work
For contractors
SaidGig
United States
9 days ago
Software Engineer for AI Code Evaluation
$25 per hour
...Role Overview Software Engineers based in India will evaluate AI-generated code and technical content, provide structured... ...major language, for example Python, Java, C++, JavaScript, or Go. ~ Experience... ..., hourly contractor work. Remote, asynchronous engagement you...
Remote work
Hourly pay
Part time
For contractors
Internship
Immediate start
Flexible hours
SaidGig
United States
3 days ago
Software Engineer - Code Specialist - AI Trainer
$50 - $150 per hour
...Dorsey . Position: Software Engineering Expert Type:... ...Location: Remote Role Responsibilities... ...Responsibilities Write and evaluate code across diverse... ...in one or more of: Python , TypeScript/... ...Java , Go , C#/C++ . ~ Strong ability...
Remote work
Full time
Contract work
Summer work
Mercor
Remote
1 day ago
Staff Software Engineer/Data Scientist, Large Model Evaluation
$238k - $302k
...The Large Model Evaluation team is at the nexus... ...-minded engineers to research and propose... ...heavily quantitative software engineering area... ...programming in Python or C++ ~ Experience with... ...principles, coding best practices, testing... ...can be performed remote, the specific...
Remote work
Full time
Waymo
San Francisco, CA
1 day ago
Software Engineer for AI Code Evaluation
$90 per hour
...Software Engineers evaluate AI-generated code and technical content, provide structured feedback, and help improve... ...engineering practices. Work is remote and asynchronous, and can be performed... ...one major language, for example Python, Java, C++, JavaScript, or Go. ~ Proven...
Remote work
Hourly pay
Ongoing contract
Full time
Contract work
Part time
Internship
Flexible hours
SaidGig
United States
2 days ago
Software Engineer, Simulator Evaluation
$175k - $215k
...Driver. The Simulator Evaluation team faces the... ...We are looking for a Software Engineer to build the metrics... ...and AI, writing the code that processes petabytes... ...robust, efficient code (C++/Python). You will implement... ...role can be performed remote, the specific salary...
Remote work
Full time
Waymo
San Francisco, CA
1 day ago
Software Engineer, Statistical Evaluation and Sampling
$170k - $216k
...states. Waymo's Release Evaluation org ensures that each... ...with other engineers, data scientists, statisticians... .... Champion code health and best practices... ...of languages, such as C++, Python and SQL ~ Performing... ...role can be performed remote, the specific salary range...
Remote work
Full time
Waymo
San Francisco, CA
1 day ago
Software Engineer, Quantitative Evaluations
$170k - $216k
...The Planner Evaluation team works on one... ...the quality of the software that drives the car... ...data-minded software engineers and data scientists... ...outcomes. Champion code health and best... ...languages, such as C++, Python and SQL ~... ...can be performed remote, the specific salary...
Remote work
Full time
Waymo
San Francisco, CA
1 day ago
Software Engineer, Quantitative Evaluations
$170k - $216k
...create metrics and evaluation methodologies to... ...report to an Engineering Manager. You... ...industry experience in software development. ~... ...programming in Python or C++, including... ...design principles, coding best practices, testing... ...can be performed remote, the specific...
Remote work
Full time
Waymo
Remote
1 day ago
Software Engineer, Perception Evaluation
$170k - $216k
...states. The Perception Evaluation team at Waymo is at... .... We are seeking a Software Engineer play a pivotal role... ...Evaluation Tools: Design, code, test, and maintain... ..., primarily using C++ and Python. Execute Evaluation... ...role can be performed remote, the specific salary...
Remote work
Full time
Waymo
Remote
1 day ago
Software Engineer for AI Model Evaluation
...Lead the design and evaluation of next-generation coding agents by creating benchmarks... ...across diverse software engineering tasks. Develop high-quality... ...background with expertise in Python, C++, or comparable... ...Full-time. Location: Remote. Compensation ~ Salary...
Remote work
Full time
SaidGig
United States
more than 2 months ago
ML Engineer - AI Coding Expert
$85 per hour
...and Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type: Contract... ...: $85/hour Location: Remote Role Responsibilities Use... ...frontier AI coding agents to complete and evaluate complex machine learning and AI engineering...
Remote work
Full time
Contract work
Summer work
Mercor
Remote
1 day ago
Software Engineer - AI Evaluation
$60 - $100 per hour
...Dorsey . Position: Software Engineering, Data Science, and... ...hour Location: Remote Role Responsibilities Evaluate LLM-generated responses to coding and software engineering... ...programming languages (e.g., Python, Java, C++, C, JavaScript, Go, Rust...
Remote work
Full time
Contract work
Summer work
Mercor
Remote
1 day ago
Software Engineer (C++ or Python) - 2027 Grads
$300k
...(HRT) is seeking talented Software Engineers to join our teams in New York... ...Engineer at HRT, the code you write is our business.... ...skillsWorking experience with C/C++ or Python is required, as are good CS... ...employ various methods to evaluate the authenticity of candidate...
Full time
Work at office
Immediate start
Hudson River Trading
Austin, TX
2 days ago
Staff ML Engineer - Embodied AI Evaluation Foundations
$189.4k - $300.6k
...design, intelligent software, and next-... ...world scenarios.The Evaluation Foundations team—part... ...vehicle development. We engineer high-performance... ...design and code reviews, establish... ...NotebooksBackend: Python, Node.js, high-throughput... ...Driving. Remote/Hybrid: This role...
Remote work
Full time
Local area
Work from home
Relocation
Relocation package
Flexible hours
General Motors
Sunnyvale, TX
4 days ago
Engineering Manager - Autonomy Evaluation
$185.1k - $284.1k
...Organization The Evaluation team builds and... ...feedback for engineering and leadership,... ...team building the software, metrics, and... ...system design, code review, testing... ...developing Python in production team... ...Comfort working with C++ codebases,... ...of America; Remote - United StatesType...
Remote work
Full time
Local area
Work from home
Flexible hours
General Motors
Sunnyvale, TX
5 days ago
Software Engineer (C++, Python, and JavaScript)
$160k - $190k
...DescriptionEverforth ECS is seeking a Software Engineer to work in an onsite... ...operational feasibility by evaluating problem definition and... ...years of experience designing, coding, deploying, and supporting... ...languages such as C++, Python, and JavaScriptStrong analytical...
Flexible hours
ECS Federal
Springfield, VA
2 days ago
Evaluation and ML Systems Engineer, AI Safety and Security Engineering
$152k - $241.5k
...AI Safety & Security Engineering team builds and evaluates AI-powered tooling... ...validate, and patch software vulnerabilities. In... ...benchmarks, runs, and code you helped make reproducible... ...skills: Solid Python engineering for... ...Santa Clara; US, NC, Remote; US, NY, Remote; US,...
Remote work
Full time
Nvidia
Santa Clara, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer (Python/C++) - Code Evaluation | Remote. Be the first to apply!