Remote Java Engineer: AI Prompts & Code Evaluation
Crossing Hurdles
Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios. Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks. Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality. Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness. Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows. Contribute to structured evaluation datasets used to assess AI reasoning and communication quality. Collaborate asynchronously with research teams to refine task quality and consistency. Requirements Strong experience in software engineering, technical research, or educational content development. Bachelor’s degree in Software Engineering, Computer Science, or a related field. Hands-on experience with debugging, testing, and validating code. Strong technical writing skills with high attention to detail. Ability to work independently in a fully remote, project-based environment. #J-18808-Ljbffr
Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Remote Java Engineer: AI Prompts & Code Evaluation in Staten Island, NY vacancy
$30 - $70 per hour
A leading technology company is seeking a Software Engineer, AI to assist in training large-language models by evaluating and improving code snippets. This fully remote position demands 3+ years of Java experience and strong attention to detail in code review. The ideal...Remote workFlexible hoursChatGPT Jobs
Richmond, VA3 days ago- ...experienced software engineers to contribute to... ...advanced AI systems through... ...debugging, and code quality. This... ...shaping how AI models evaluate performance,... ...JavaScript, Go, Java) ~ Experience... ...privacy leaks, prompt injection, access... ...Information Fully remote and flexible...Remote workFreelanceFlexible hours
Lifted, an Upwork Company™
United States1 day ago - ...A leading AI development company is seeking proficient programmers to develop cutting-edge AI systems. This fully remote position allows you to choose projects and set your own schedule. You'll design coding problems, evaluate AI code, and contribute to evolving intelligent...Remote work
DataAnnotation
Hartford, CT3 days ago $60 per hour
...A leading AI development firm is looking for proficient programmers to join their team. This fully remote opportunity offers flexibility in scheduling and the... ...Responsibilities include designing coding solutions for AI systems and evaluating AI-generated code. This role...Remote workDataAnnotation
United States2 days ago$60 per hour
...A tech-forward AI development firm is seeking proficient programmers to... ...This role offers the flexibility of remote work and the ability to choose projects... ...Responsibilities include designing coding problems for AI training and evaluating code for accuracy. Candidates...Remote workHourly payDataAnnotation
New York, NY23 hours ago$60 per hour
A cutting-edge AI development company is seeking proficient programmers to join their remote coding team. The role involves designing and solving... ...in Android development, and evaluating AI-generated code. Ideal... ...programming languages like Java or Python. Enjoy flexible hours...Remote workFlexible hoursDataAnnotation
Providence, RI4 days ago- ...Offering a fully remote freelance opportunity, the Software Engineer AI Code Evaluation will review, rank, and refine AI-generated code solutions, applying expert judgment... ...languages (e.g., Python, JavaScript/TypeScript, Java, C++, Go, Rust) Strong grasp of data structures...Remote workFreelance
Virtual Vocations Inc
United States4 days ago - ...To support the evolution of AI coding assistants, the freelance Software Engineer for AI Code Evaluation will remotely evaluate, rank, and refine AI-generated code solutions, ensuring... ...(e.g., Python, JavaScript/TypeScript, Java, C++, Go, Rust) Strong understanding of...Remote workFreelanceFlexible hours
Virtual Vocations Inc
United States4 days ago - ...Evaluating and refining AI-generated code, the freelance Software Engineer AI Code Evaluator will work remotely to review, rank, and provide feedback on code solutions across various programming... ...(e.g., Python, JavaScript/TypeScript, Java, C++, Go, Rust) Strong understanding...Remote workFreelanceFlexible hours
Virtual Vocations Inc
United States4 days ago $60 per hour
...A leading AI development firm is seeking proficient programmers to contribute to advancing AI development while enjoying the flexibility of remote work. Candidates will engage in designing coding solutions for AI systems and can choose their projects. Candidates must have...Remote workDataAnnotation
El Paso, TX23 hours ago$60 per hour
...A leading AI development firm is seeking proficient programmers to advance AI technologies. This role is fully remote, allowing you to set your own schedule while working on diverse coding problems. Candidates should be fluent in English with preferred experience in Kotlin...Remote workDataAnnotation
Honolulu, HI1 day ago$60 per hour
...company is seeking proficient programmers to contribute to AI development. This remote role offers flexibility to choose projects and schedules,... ...to $60 USD/hour for competitive pay. Tasks include solving coding problems and writing high-quality code. Candidates should...Remote workDataAnnotation
Denver, CO4 days ago- ...Responsibilities Review and refine AI-generated prompts, responses, and code Validate algorithms and software... ...language Support benchmarking efforts to evaluate and compare model capabilities... ...Strong experience in software engineering, technical research, or educational...Remote workPart time
Crossing Hurdles
New York, NY3 days ago - ...Expert Prompt Curators for Advanced AI Evaluation Dataset This description is a summary of our understanding of... ...tool use (e.g., search, browse, or code execution). Ensure prompts are objective... ...is a plus. Requirements Remote and asynchronous — set your own hours...Remote workHourly payContract workTemporary workFor contractors
CloudDevs
New York, NY3 days ago $60 per hour
A leading AI development firm is looking for proficient programmers to join their remote team. This position allows flexibility in choosing... ...advanced AI models to create coding solutions, focusing on... ...Kotlin, JavaScript, Python, or Java, with a degree preferred. Competitive...Remote workHourly payDataAnnotation
Providence, RI23 hours ago- ...AI Prompt Engineer We are looking for a creative and technically-minded... ...blend of linguistic skill and coding knowledge to unlock the full... ...& Optimize: Continuously evaluate prompt performance through rigorous... ...skills in JavaScript or Java to build testing harnesses,...Remote work
Hiveway
United States2 days ago $150 per hour
...TryApplyNow is seeking a Research Scientist for a fully remote position. The role involves evaluating AI-generated technical content, writing domain-specific prompts, and auditing AI reasoning in machine learning contexts. Candidates should have professional experience...Remote workTryApplyNow
California, MO3 days ago$150k - $180k
...AI Evaluations Engineer – HealthcareLocation: Remote, located in the USType: Full-timeDepartment: EngineeringReports... ...infrastructure with code, including APIs, services... ..., Typescript/Javascript, Java, or similar).Experience... ...tools (e.g., Langfuse, prompt eval frameworks)....Remote workFlexible hoursEllipsis Health
San Francisco, CA23 hours ago$20 per hour
...A technology company focused on AI is seeking individuals for a remote position teaching AI chatbots. This role allows you to work flexibly, developing prompts and evaluating AI responses while managing your own schedule. Candidates should possess strong writing and research...Remote workHourly payDataAnnotation
Santa Fe, NM1 day ago- ...fund transparency, trading engine speed, deep liquidity,... .... Leverage AI-powered development tools... ...CodeMax) to accelerate coding, code review, and smart... ...Approximately 5 years of Java development experience with... ...workflows; experience with prompt engineering, AI-driven code...Remote workContract workWork from home
binance
United States2 days ago $20 per hour
...A leading AI company in the United States is seeking analytical and detail-oriented... ...trainer. This position allows for remote work and flexible scheduling. Responsibilities... ..., writing high-quality responses to prompts, and evaluating AI model performance. Ideal candidates...Remote workHourly payFlexible hoursDataAnnotation
Sioux Falls, SD23 hours ago$20 per hour
...leading technology company is seeking analytical, detail-oriented individuals to join their remote team. The role involves developing prompts to train AI chatbots, evaluating AI model outputs, and writing high-quality responses. Ideal candidates will have excellent writing...Remote workHourly payFlexible hoursDataAnnotation
New York, NY23 hours ago$8 - $65 per hour
...Java Coding Specialist - Freelance AI Trainer Project United States of America Are... ...chatbots into powerful engines of scientific... ...suggest improvements to our prompt engineering and evaluation metrics. A bachelor’s,... ...Contract Workplace type: Remote Seniority level: Mid‑...Remote workHourly payContract workFor contractorsFreelanceImmediate startInvisible Agency
New York, NY3 days ago$20 per hour
...A leading AI training company is seeking analytical and detail-oriented professionals to help train AI chatbots. This... ...business owners and freelancers, involves developing prompts, writing responses, and evaluating AI model outputs. Flexibility in choosing projects and schedules...Remote workFreelanceDataAnnotation
Lincoln, NE23 hours ago- A leading AI training company seeks analytical individuals in the United... ...role involves creating complex prompts, writing high-quality responses, and evaluating AI outputs. Ideal candidates will... ...AI capabilities while enjoying the benefits of remote work. #J-18808-LjbffrRemote workHourly pay
DataAnnotation
New York, NY1 day ago $20 per hour
...A leading AI quality assurance company is seeking individuals to develop prompts and test AI chatbots. This role allows for remote work and flexible scheduling, making it ideal for small business... ...high-quality responses, and evaluating AI model outputs. A bachelor's degree...Remote workHourly payFreelanceFlexible hoursDataAnnotation
Wisconsin23 hours ago$60 per hour
...A cutting-edge AI development company is seeking proficient programmers to join their team. Work remotely and set your own schedule while contributing to... ...Responsibilities include designing coding problems, writing quality code, and evaluating AI-generated code. Successful...Remote workDataAnnotation
Madison, WI23 hours ago$20 per hour
...A leading AI training company is seeking analytical, detail-oriented individuals to remotely teach AI chatbots. Responsibilities include developing prompts, writing high-quality responses, and evaluating different AI models. The role is ideal for those with experience...Remote workHourly payFull timePart timeFlexible hoursDataAnnotation
Providence, RI23 hours ago- ...A leading AI development company is seeking proficient programmers to join their remote team. In this role, you'll design coding problems for AI, evaluate AI-generated code, and contribute to innovative AI systems. Candidates should be fluent in English, preferably with...Remote workHourly pay
DataAnnotation
Brooklyn, NY1 day ago $20 per hour
...A leading AI training company is seeking analytical freelancers and contractors... ...This role offers the flexibility of remote work and the ability to create your... ...Responsibilities include developing prompts, writing responses, and evaluating AI outputs. Ideal for candidates...Remote workHourly payFor contractorsFreelanceDataAnnotation
Juneau, AK23 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Java Engineer: AI Prompts & Code Evaluation. Be the first to apply!
Related searches
- entry level java developer remote Staten Island, NY
- java developer remote part time Staten Island, NY
- remote sales consultant Staten Island, NY
- remote lvn Staten Island, NY
- customer service associate remote Staten Island, NY
- remote sales jobs Staten Island, NY
- remote video game Staten Island, NY
- remote legal writer Staten Island, NY
- remote insurance Staten Island, NY
- remote outreach specialist Staten Island, NY