Remote Java Engineer: AI Prompts & Code Evaluation
Crossing Hurdles
- Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
- Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
- Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
- Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
- Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
- Collaborate asynchronously with research teams to refine task quality and consistency.
- Strong experience in software engineering, technical research, or educational content development.
- Bachelor’s degree in Software Engineering, Computer Science, or a related field.
- Hands-on experience with debugging, testing, and validating code.
- Strong technical writing skills with high attention to detail.
- Ability to work independently in a fully remote, project-based environment.
Requirements
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Java Engineer: AI Prompts & Code Evaluation in Netherlands vacancy
$90 per hour
...Role Overview Software Engineers evaluate AI-generated code and technical content, providing... ...problems and engineering prompts for correctness,... ...language such as Python, Java, C++, JavaScript, or Go.... ...hourly contract engagement, remote and asynchronous. Flexible...Remote workHourly payOngoing contractContract workPart timeInternshipFlexible hoursSaidGig
United Statesmore than 2 months ago- ...Role Overview Evaluate and benchmark the coding abilities of frontier AI models by reviewing... ...real-world software engineering tasks, and shaping... ...languages: Python, Java, C/C++, Go, Swift,... ...annotation, NLP, prompt engineering, model... ...Work location: Remote, United States only...Remote workContract workFor contractors
SaidGig
United States15 days ago $25 per hour
...Role Overview Software Engineers apply production... ...development experience to evaluate AI-generated code and technical content... ...questions and test prompts that reflect... ...for example Python, Java, C++, JavaScript, or... ...Engagement type: Part-time, remote, hourly contract....Remote workHourly payContract workPart timeInternshipFlexible hoursSaidGig
United Statesa month ago$25 - $30 per hour
...analytical, detail-oriented professionals to help train AI chatbots. This independent contractor role allows you to... ...home and choose your own projects. Candidates will develop prompts, write responses, and evaluate AI models. Ideal for those experienced in business communication...Remote workHourly payFor contractorsWork from homeDataAnnotation
Louisiana, MO1 day ago- ...AI Training Content Developer... ...Science, Software Engineering, or a closely related... ...-on work in Java on production... ...conducting thorough code reviews and... ...annotation, or evaluating AI-generated... ...Create detailed prompts in various topics... ...Code Review Remote Contractor Performance...Remote workFor contractors
SME Careers
United States2 days ago - ...Responsibilities Review and refine AI-generated prompts, responses, and code Validate algorithms and software... ...Support benchmarking efforts to evaluate and compare model capabilities Requirements... ...Strong experience in software engineering, technical research, or...Remote jobPart time
$50 per hour
...Role Overview Evaluate, benchmark, and... ...help improve the coding capabilities of advanced AI models by assessing... ...real software engineering problems. You will... ...: Python, Java, C/C++, Go, Swift... ...annotation, NLP, prompt engineering, or... ...Work location, remote, candidates must...Remote workContract workFor contractorsSaidGig
United States1 day ago$25 per hour
...Role Overview Software Engineers based in India will evaluate AI-generated code and technical content, provide... ...coding questions and prompts that reflect real... ...language, for example Python, Java, C++, JavaScript, or Go.... ...contractor work. Remote, asynchronous engagement...Remote workHourly payPart timeFor contractorsInternshipImmediate startFlexible hoursSaidGig
United States2 days ago$112.9k - $188.1k
...Work Location Type: Remote Req Number 333263 About Grainger... ...a new team that uses AI coding agents as co-workers to accelerate... ...data. As a Senior Software Engineer (Software Engineer III) you will... ...Direct and review AI agent output-prompt engineering, code review,...Remote workFull timeH1bWork at officeLocal areaWorldwide2 days per weekGrainger Businesses
Chicago, IL13 days ago$90 per hour
...Software Engineers evaluate AI-generated code and technical content, provide structured... ...design job-related coding prompts, and assess submissions for... ...engineering practices. Work is remote and asynchronous, and can... ..., for example Python, Java, C++, JavaScript, or Go....Remote workHourly payOngoing contractFull timeContract workPart timeInternshipFlexible hoursSaidGig
United States1 day ago$100 per hour
...partner is looking for a Senior Python Engineer - AI Code Evaluation based in the United States. This... ...Claude Code, and Cursor in a flexible, remote environment. The engagement offers... ...: Exposure to AI-first IDEs, prompt design, model evaluation, evaluation...Remote workHourly payContract workTemporary workImmediate start10 hours per weekFlexible hoursJobgether
Remote3 days ago- ...A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates...Remote workHourly payTemporary workFlexible hours
CloudDevs
New York, NY4 days ago - ...Management (WFM) Engineering Team... ...the Future of AI-Driven Software... ...solutions using Java and modern web... ...decisions, and code reviews. Drive... ...Create and maintain prompts, instructions,... ...solutions. Evaluate emerging AI technologies... ...and 3 days of remote work, each week...Remote workFull timeWork at officeWorldwideFlexible hours
Nice Inc.
Remote9 hours ago $25 - $30 per hour
...contractors in the Town of Vermont, Wisconsin to help train AI chatbots. Ideal candidates are proactive individuals who... ...scheduling. Responsibilities include creating complex prompts, writing responses, and evaluating AI models. Candidates are required to have strong...Remote workHourly payFor contractorsFlexible hoursDataAnnotation
Wisconsin1 day ago$60 per hour
...shape the future of AI. What we do... ...as an AI Tutor in Coding, you’ll have the opportunity... ...code review Prompt evaluation and complex data... ...leads, solution engineers, and supply... ...professional experience in Java 17+, including... ...freelance role is fully remote so, you just need...Remote jobFull timePart timeFreelanceMindrift
Minnesota9 hours ago$20 per hour
A leading AI training company is seeking analytical, detail-oriented individuals to remotely teach AI chatbots. Responsibilities include developing prompts, writing high-quality responses, and evaluating different AI models. The role is ideal for those with experience in...Remote workHourly payFull timePart timeFlexible hoursDataAnnotation
Providence, RI1 day ago- AuraOne is seeking a Prompt Injection Security Evaluator for a remote contractor role. You will design adversarial prompts, document failures with reproducible steps, and score defenses across single-turn and multi-turn conversations. The role emphasizes rigorous reporting...Remote jobFor contractors
$20 per hour
A tech firm specializing in AI seeks analytical and detail-oriented individuals for remote work in training AI chatbots. The role involves developing diverse conversation prompts, writing high-quality answers, and evaluating different AI models. Ideal candidates should...Remote workFor contractorsFreelanceFlexible hoursDataAnnotation
Lansing, MI1 day ago- ...Lead Software Engineer to join our Workforce... ...drive our AI-first engineering... ...using Java technologies.Define... ...practices, including coding agents,... ...successful delivery.Evaluate emerging technologies... ...AI concepts, prompt engineering,... ...and 3 days of remote work, each week...Remote workTemporary workWork at officeFlexible hours2 days per week
$25 - $30 per hour
...looking for analytical and detail-oriented independent contractors in New York to help train AI chatbots. You will manage various tasks, write high-quality responses, and evaluate AI models based on guidelines. This role offers flexibility as you can choose projects and...Remote workHourly payContract workFor contractorsWork from homeDataAnnotation
Florida, NY5 days ago$130k - $160k
...opportunity today. AI / Java Developer El... ...DescriptionSenior AI Software Engineer - AI Applications... ...Location: Remote within the United... ...only, advisory, or prompt-engineering role.... ...design, production coding, testing,... ...systems Experience evaluating and applying AI capabilities...Remote workPermanent employment$35 - $40 per hour
A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and... ...skills, familiarity with AI tools like ChatGPT, and a BS or...Remote jobContract workFlexible hours- ...technology, data-driven insights, AI, and human expertise to help... ...and develop test automation code Perform comprehensive analysis... ...~5+ years of hands-on Java development experience ~ Experience... ...are treated fairly and evaluated based on their qualifications,...Remote workWork experience placementLocal areaFlexible hours
Paychex
United States5 days ago - ...of the Product and Engineering team at PitchBook,... ..., write code that others learn... ...incident response Apply AI tooling to improve... ...systems5+ years of Java development experience... ...space — able to evaluate tools, run experiments... ...’t be replicated remotely. This role is...Remote workWork at officeVisa sponsorship
- ...Role Overview Lead the evaluation and improvement of AI tools that assign HCC codes and recommend risk adjustment actions, ensuring clinical accuracy and regulatory... ...stakeholders. Work Terms Location: Remote. Engagement type: Hourly. Compensation ~ Pay...Remote workHourly pay
SaidGig
United Statesa month ago - United States Digital Space LLC is seeking experienced Software Engineers based in Canada to assist with AI research through flexible, hourly contract work. You will evaluate AI-generated code, provide feedback, and enhance AI understanding of programming tasks and engineering...Remote jobHourly payContract workPart timeFlexible hours
$98.4k - $147.6k
...Title : Software Engineer (Java) in Test Team... ...will also leverage AI-augmented development... ...using Claude Code, GitHub Copilot (in... ...triage. • Apply prompt engineering and retrieval... ...analysis. • Evaluate and integrate... ...automation stacks and remote device labs....Remote workContract workLocal areaShift workNew York, NYmore than 2 months ago- ...Java Backend Developer Working at Citi is far more than... ...and analyzing/interpreting code Consult with users, clients... ...information, and make evaluative judgements to recommend and... ...expectations or requirements ~ AI and Prompt Engineering: Wide exposure to and...Remote work
Citigroup Inc
United States3 days ago $90 per hour
...technical talent with leading AI research labs.... ...Position: Frontend Engineer — Web Replication Preference... ...0/hour Location: Remote Role Responsibilities... ...look correct. Evaluate responsive behavior and... ...model evaluation work. Code review or technical assessment...Remote workContract workSummer workLocal areaMercor
San Francisco, CA2 days ago$50 - $150 per hour
...technical talent with leading AI research labs.... ...Position: Software Engineering Expert Type:... ...hour Location: Remote Role Responsibilities... ...Write and evaluate code across diverse programming... ...TypeScript/JavaScript , Java , Go , C#/C++ ....Remote workFull timeContract workSummer workMercor
Remote9 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Java Engineer: AI Prompts & Code Evaluation. Be the first to apply!
Related searches
- immediate hire remote Netherlands
- remote senior business analyst Netherlands
- remote customer service chat Netherlands
- remote hotel sales manager Netherlands
- tableau developer remote Netherlands
- remote no experience Netherlands
- remote customer support Netherlands
- on-site clinical research associate (traveling/remote) Netherlands
- companies hiring remote Netherlands
- remote contract Netherlands