Remote Java Engineer: AI Prompts & Code Evaluation

Crossing Hurdles

Netherlands

Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
Collaborate asynchronously with research teams to refine task quality and consistency.

Requirements

Strong experience in software engineering, technical research, or educational content development.
Bachelor’s degree in Software Engineering, Computer Science, or a related field.
Hands-on experience with debugging, testing, and validating code.
Strong technical writing skills with high attention to detail.
Ability to work independently in a fully remote, project-based environment.

#J-18808-Ljbffr

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Remote Java Engineer: AI Prompts & Code Evaluation in Netherlands vacancy

Software Engineer, AI Code Evaluation and Benchmarking
...Role Overview Evaluate and benchmark the coding abilities of frontier AI models by reviewing... ...real-world software engineering tasks, and shaping... ...languages: Python, Java, C/C++, Go, Swift,... ...annotation, NLP, prompt engineering, model... ...Work location: Remote, United States only...
Remote work
Contract work
For contractors
SaidGig
United States
more than 2 months ago
Software Engineer (Python/C++) - Code Evaluation | Remote
...Responsibilities Review and refine AI-generated prompts, responses, and code Validate algorithms and... ...Support benchmarking efforts to evaluate and compare model capabilities... ...Strong experience in software engineering, technical research, or educational...
Remote work
Part time
Crossing Hurdles
United States
3 days ago
Research Engineer - Code Generation & Model Evaluation
...Role Title: Research Engineer - Code Generation & Model Evaluation Role Type: Contractor Location: Remote micro1 is engaging Research Engineers... ...help train next-generation AI systems. Your work will... ...codebases written in Python3, Java, Rust, C++, Go, or...
Remote work
Temporary work
For contractors
micro1
Remote
13 days ago
Java Softwareentwickler (m/w/d) remote
...AI Training Content Developer... ...Science, Software Engineering, or a closely related... ...-on work in Java on production... ...conducting thorough code reviews and... ...annotation, or evaluating AI-generated... ...Create detailed prompts in various topics... ...Code Review Remote Contractor Performance...
Remote work
For contractors
SME Careers
United States
2 days ago
Software Engineer, AI Code Evaluation and Benchmarking
$50 per hour
...Role Overview Evaluate, benchmark, and... ...help improve the coding capabilities of advanced AI models by assessing... ...real software engineering problems. You will... ...: Python, Java, C/C++, Go, Swift... ...annotation, NLP, prompt engineering, or... ...Work location, remote, candidates must...
Remote work
Contract work
For contractors
SaidGig
United States
2 days ago
Senior Software Engineer, Python (LLM Evaluation & Repository Validation)
...fastest-growing AI companies,... ..., and rigorous evaluation frameworks.... ...projects spanning coding, reasoning, agentic... ...workflows, software engineering, and multimodal... ...tasks with prompts, metadata, runnable... ...such as Java, Go, C++ Demonstrated... ...in a fully remote environment....
Remote work
Contract work
Temporary work
For contractors
Freelance
Worldwide
Turing
Remote
21 days ago
Sr Java Developer - Hybrid - Jacksonville, FL
SR JAVA DEVELOPER – HYBRID – JACKSONVILLE... ...Java Developer with AI development... ...couple of days/week, remote the rest of the time... ...release procedures, coding design and... ...retrieval systems, prompt engineering Production deployment... ...best practices Evaluate and integrate...
Remote work
Permanent employment
Contract work
Part time
Work experience placement
Immediate start
Flexible hours
ARC Group
Jacksonville, FL
22 days ago
Senior Software Engineer (Java) in Test
$110.4k - $165.6k
...Senior Software Engineer in Test Team... ...proficient skills in Java engineering. It... ...also leverage AI-augmented... ...practices using Claude Code, GitHub Copilot... ...triage. • Apply prompt engineering and... ...analysis. • Evaluate and integrate functional... ...stacks and remote device labs....
Remote work
Contract work
Local area
Shift work
Burbank, CA
more than 2 months ago
Senior Lua Developer (Roblox) - AI Code Evaluation
$60 per hour
...seeking experienced Lua Developers to support AI model training through technical evaluations, scripting tasks, and code quality reviews. This opportunity is ideal for... ...projects. Additional Information Fully remote, project-based opportunity. Up to $60/hour...
Remote work
Weekly pay
Contract work
Freelance
10 hours per week
Lifted, an Upwork Company™
Chicago, IL
28 days ago
Frontend Code Evaluation Specialist - AI Trainer
$90 per hour
...technical talent with leading AI research labs.... .... Position: Frontend Engineer Type: Contract Compensation... ...$90/hour Location: Remote Role Responsibilities... ...preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect...
Remote work
Contract work
Summer work
Local area
Mercor
San Francisco, CA
2 days ago
Senior Software Engineer - AI Evaluation / Coding Agents
...Freelance · Remote · North America, LATAM, or India About Turing... ..., working with frontier AI labs to accelerate model development... ...high-quality training data, evaluations, and engineering talent. About the Role... ...evaluate and improve AI coding models . Rather than primarily...
Remote work
Hourly pay
Temporary work
For contractors
Freelance
Immediate start
Turing
Remote
21 days ago
Frontend Code Evaluator - Expert - AI Trainer
$90 per hour
...technical talent with leading AI research labs.... ...Position: Frontend Engineer — Web Replication Preference... ...0/hour Location: Remote Role Responsibilities... ...look correct. Evaluate responsive behavior and... ...model evaluation work. Code review or technical assessment...
Remote work
Contract work
Summer work
Local area
Mercor
San Francisco, CA
2 days ago
Secure Code Review AI Evaluator
...Secure Code Review AI Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can...
Remote job
Hourly pay
For contractors
10 hours per week
AuraOne Human Data
Remote
5 days ago
Dialect Code-Switching AI Evaluator
...Dialect Code-Switching AI Evaluator is a remote evaluation track for reviewing dialect code switching ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the...
Remote job
Hourly pay
For contractors
10 hours per week
AuraOne Human Data
Remote
8 days ago
Infrastructure as Code Evaluation Specialist
...Infrastructure as Code Evaluation Specialist is a remote review track for evaluating AI outputs across infrastructure as code evaluation specialist operations workflows... ...to detail and the ability to flag when a prompt itself is the problem. Reliable async availability...
Remote job
Hourly pay
For contractors
Work experience placement
10 hours per week
AuraOne Human Data
Remote
8 days ago
Research Lead - AI Cyber Testing & Evaluation
$146.2k - $261.4k
...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security... ...policy researchers, engineers, and scientists. Your... ...in Python, Java, C/C++, or other popular... ...Development Program (CNODP), Remote Interactive Operator... .... Writing or Code Sample Either a writing...
Remote work
Work experience placement
Work from home
Employment Opportunities Inc
Washington DC
2 days ago
Senior Software Engineer, LLM Evaluation (US/Canada/WEU)
...Overview Design and evaluate high-quality... ...language models for code. You will work with... ...languages, assess AI-generated implementations... ...the software engineering lifecycle. Key Responsibilities... ..., C and C++, Java, Rust, and Go for... ...fit. Location: Remote, candidates must be...
Remote work
For contractors
10 hours per week
Flexible hours
SaidGig
Canada
more than 2 months ago
Senior Java Engineer - Agentic AI Driven Development
$107.12k - $160.68k
...CitiResponsibilities (Leveraging AI):Lead the design,... ...applications using Java and Spring Boot: Utilize AI-powered code generation tools (e... ...mid-level software engineers, fostering a... .../issues, provide evaluation of business process... ...of AI/ML concepts, prompt engineering, and...
Full time
Citigroup
Irving, TX
1 day ago
Senior Software Engineer, LLM Evaluation
...quality datasets and evaluation pipelines that... ...language models for code generation and software engineering tasks. You will curate... ...evaluate and refine AI-generated solutions... ...ReactJS, C and C++, Java, Rust, and Go for model... ...Terms Location: Remote. Engagement type:...
Remote work
Full time
For contractors
10 hours per week
Flexible hours
SaidGig
United States
more than 2 months ago
Software Engineer - IAM (Java)
$114k - $142k
...companies to thrive in an AI-first world by... ...tooling other engineering teams use to adopt... ...What you'll doUse AI coding assistants daily,... ...span Ruby, Java, and others, with... ...office-based, fully remote, or hybrid.Our hiring... ...process.Candidates are evaluated based on...
Remote work
Work at office
Flexible hours
New Relic
Portland, OR
3 days ago
Java Software Engineer
...development initiatives, the full-time Java Software Engineer will develop scalable web applications... ...in the Agile Scrum process and ensuring code quality and maintainability. Key responsibilities... ...for applications and APIs Implement AI integration pipelines and stay updated...
Remote work
Full time
Virtual Vocations Inc
United States
3 days ago
Java Developer
$86.8k - $198k
Java DeveloperThe Opportunity:Every day, millions of Americans... ...This role goes beyond writing code. You'll evaluate emerging tools and techniques... ...development Experience using an AI-IDE like Claude Code or... ...their cameras on during meetings.Remote: If this position is listed...
Remote work
Full time
Contract work
Part time
Local area
Booz Allen Hamilton
Bethesda, MD
3 days ago
Software Engineer for AI Training and Evaluation
$70 - $150 per hour
...Help shape how frontier AI systems are trained and evaluated by applying production software engineering judgment to real-world code, designs, requirements,... ...engineering, including Java, Go, and Node.js, as well... ...engineering. Work Terms Remote, hourly engagement....
Remote work
Hourly pay
Immediate start
SaidGig
United States
16 days ago
Senior Software Engineer, Full Stack (Python, Java, Rust, C#, C++)
$90 - $110 per hour
Gridnaut Recruiting is hiring a remote Senior Software Engineer, Full Stack (Python, Java, Rust, C#, C++) contractor (... ...0/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: 6+ years... ...or C++; Delivered production code in a second major language;...
Remote work
Temporary work
For contractors
Gridnaut Recruiting
Remote
18 days ago
Java/AI Developer
Java/AI Developer Length: 6-10 months Location: While this role is primarily remote, the client prefers candidates near satellite offices... ..., Co-Pilot, GenAI and Prompt Engineering Java Developer:... ...Candidate will be writing code to build new features on...
Remote work
Temporary work
Work at office
Local area
Scadea
Remote
28 days ago
Senior Java Softwareentwickler (m/w/d)
$114k - $152k
...Description Job Description Senior Java Software Engineer Remote — US-Based Only Must be a US... ...Microservices, Event-Driven Architecture, and AI-powered development tools to create... ...solutions. Participate in code reviews, technical design discussions...
Remote work
Visa sponsorship
DSC Resources
Denver, CO
a month ago
Remote Sr. Java Developer
$92k - $118k
...including technical design and coding in the IT industry Strong Java development background... ...thinking skills to evaluate options and present solutions... ...Web XML NodeJS AI More: We are SGA, a... ...engagements each year. This is a remote contract opportunity with...
Remote work
Full time
Contract work
Work experience placement
Flexible hours
Software Guidance & Assistance
Jacksonville, FL
2 days ago
Remote Senior Java Engineer
$164.8k - $226.6k
...subscriptions and usage-based pricing to AI-driven and outcome-based... .... This is not a fully remote position . About the... ...looking for an experienced Senior Java Engineer to join our backend... ...architectural design discussions and code reviews. Mentor junior...
Remote work
Full time
Work at office
Local area
Flexible hours
3 days per week
Zuora
Remote
28 days ago
Senior Software Engineer, LLM Evaluation & Repository Validation
...Title: Senior Software Engineer , LLM Evaluation & Repository... ...world’s fastest-growing AI companies accelerating... ...LLMs interact with real code, influencing the future... ...: Python, JavaScript, Java, Go, Rust, C/C++, C#,... ...Work in a fully remote environment. Opportunity...
Remote work
Contract work
Temporary work
For contractors
Freelance
Turing
Remote
21 days ago
Lead Java Practice Architect (AWS)
$160k - $225k
...stay close to the code and runtime by validating... ..., establishing engineering guardrails, and... ...estimation Continuously evaluate and adopt new... ...hands-on experience in Java. 5+ years of experience... ...for responsible AI tool usage across... ...TypeThis is a fully remote position.Application...
Remote work
Permanent employment
Full time
Temporary work
Work experience placement
TEKsystems
Atlanta, GA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Java Engineer: AI Prompts & Code Evaluation. Be the first to apply!