Civil / Survey Engineer — AI Output Reviewer [Remote]
$45 - $60 per hourAuraOne Human Data
- Remote job
Civil / Survey Engineer — AI Output Reviewer is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.
Why this role matters
Engineering model quality lives or dies on whether the generated code actually compiles, passes tests, and handles edge cases. AuraOne pairs experienced engineers with the modeling team to grade outputs the way a code reviewer would.
Responsibilities
- Run and reproduce candidate code outputs in a sandboxed environment for Civil / Survey Engineer — AI Output Reviewer assignments.
- Grade civil / survey engineer vulcan engineering review solutions for correctness, style, and edge-case handling.
- Write minimal failing tests that demonstrate the bug a model output missed.
- Compare paired solutions and rank them with a written rationale tied to the rubric.
- Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
- Document recurring code-generation failures so the modeling team can target them.
- Calibrate against gold-standard reviews to keep inter-rater agreement above target.
Qualifications
- Strong day-job engineering experience — you can read, run, and debug unfamiliar code for Civil / Survey Engineer — AI Output Reviewer work.
- Comfort writing concise unit tests that capture a single failure mode.
- Familiarity with a testing framework. pytest, Jest, or JUnit. Go test, RSpec, or whatever you use.
- Clear written reasoning — your review note has to convince another senior engineer.
- Reliable async availability for at least 10 hours per week.
- Prior code-review or technical-interview-grading experience is a plus.
Example tasks
- Reproduce a generated engineering solution to a coding task, run the test suite, and grade it.
- Write the smallest failing test that demonstrates a model's edge-case bug.
- Compare two paired solutions and rank them with a written rationale tied to the rubric.
- Triage a security issue surfaced by a model and document the patch the model should have produced.
Nice to have
- Open-source contributions or a public portfolio that demonstrates production-quality code.
- Experience with the target language's standard tooling, linters, and idiomatic style guides.
- Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns.
Skills
- Code review
- Debugging
- Unit testing
- Software engineering judgment
- Civil / Survey Engineer Vulcan engineering review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$45–$60 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- Obsidian is hiring expert Evaluators in Special education/IEP to review AI-generated work products for accuracy and rigor. This is a... ...where you will apply your deep subject-matter expertise to grade outputs. Candidates must possess at least 5 years of relevant experience...SuggestedHourly payWork at officeRemote work
$45 - $60 per hour
...Code Plan Reviewer (Plans Examiner) — AI Output Review is a remote review track for evaluating AI outputs across code plan vulcan specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document...SuggestedRemote jobFor contractorsWork experience placement10 hours per week- Mercor, a leading talent connector for AI research labs, seeks a Real Estate Practice Reviewer on a contract basis. Work remotely evaluating AI-generated real... ...and providing structured feedback to improve model outputs. The role requires licensed real estate professionals...SuggestedRemote jobContract workFlexible hours
- ...We are seeking detail-oriented human reviewers with a strong understanding of their local cultural context to support a range of AI training and evaluation projects. In this role... ...evaluating prompts and AI-generated outputs, reviewing and correcting text, analyzing...SuggestedTemporary workFor contractorsLocal area
$30 - $65 per hour
...Help improve Turkish-language AI systems by evaluating spoken audio... ...assess the speaker or model output for native-level fluency and... ...Turkish. Complete assigned audio-review work accurately, on time, and... ..., phonetics, music or audio engineering, or a related field is...SuggestedHourly payContract workRemote work$30 - $65 per hour
...Help improve Vietnamese-language AI by reviewing audio and providing precise, evidence-based... ...audio clips and assess speaker or model-output nativeness and fluency. Evaluate pronunciation... ...linguistics, phonetics, music or audio engineering, or a related field is preferred....Hourly payContract workFor contractorsRemote work- Job Description Job Title: Document Reviewer Job Type: Contract Location: Remote Job Summary... ...expertise to help train next-generation AI systems. Your work will shape how models... ...to verify data integrity and validate outputs. Maintain detailed records of reviewed documents...Remote jobContract work
- ...focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and... ...Office and Google Workspace, particularly Slides. Evaluation of AI outputs, identification of errors, and structured feedback are key...Remote jobHourly payWork at office
- ...Opportunity We are seeking detail-oriented human reviewers with a strong understanding of their... ...cultural context to support a range of AI training and evaluation projects . In... ...evaluating prompts and AI-generated outputs, reviewing and correcting text, analyzing...Extra incomeFull timeFor contractorsLocal area10 hours per week
- Mercor is seeking expert Evaluators in Special education / IEP to review AI-generated documents, spreadsheets, and slides for accuracy and quality. You will apply deep domain expertise to grade outputs and provide structured feedback. This is a remote, hourly engagement...Remote jobHourly payWork at office
- ...expert Evaluators in Media, journalism, and communications to review and assess AI-generated work products, ensuring accuracy and rigor. This... ...professional English fluency and a keen eye for detail to evaluate outputs and provide structured feedback. #J-18808-Ljbffr ObsidianRemote jobWork at office
- ...SME Careers is hiring a Copywriting & Content Subject Matter Expert (SME) for a remote contractor role. You will review AI-generated outputs and create expert copy, ensuring quality, tone, and accuracy. Your expertise will aid in enhancing AI models' writing. This role...For contractorsRemote work
$20 - $30 per hour
...ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real... ...yet and judge it step by step. • Review — Take an existing annotation, written... ...it, then rebuild it to match its output, exit codes, and file effects. • Bug...Hourly payFull timeContract workImmediate startRemote work$60 - $100 per hour
...Finance Expert — AI Model Reviewer (Python & Financial Modeling) $60-100/hr Remote Freelance STEM About the Role What if your deep knowledge... ...errors, ambiguity, or clarity gaps Evaluate whether AI outputs reflect correct application of concepts like DCF analysis, P&...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours- ...Matter Expert (SME) for a remote contractor position. You will review AI-generated public health content and provide high-quality feedback... ...-health reasoning. The role demands expertise in evaluating AI outputs, ensuring scientific accuracy and clarity. Ideal candidates...For contractorsRemote work
$45 - $60 per hour
Gridnaut Recruiting is hiring a remote Civil / Survey Engineer — Vulcan contractor (pay $45-$60/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Remote contractor engagement supporting a leading AI lab..Temporary workFor contractorsRemote work- An AI research accelerator is seeking a candidate skilled in internal or emergency medicine to enhance AI systems. This remote position demands collaboration on clinical scenarios and evaluation of AI responses, requiring strong communication and diagnostic skills. An...Contract workRemote workFlexible hours
- AuraOne seeks an experienced reviewer to evaluate AI outputs in education review workflows for Elementary School Teachers, Except Special Education. The contractor will assess tone, escalation logic, and stakeholder fit using a structured rubric. Responsibilities include...Remote jobPart timeFor contractors
$45 - $60 per hour
...realistic evaluation tasks based on real civil, site, and survey documentation. You will create both... ...imagery, and site records, then a second reviewer in your discipline will review the... ...Current or recent experience as a civil engineer, land development engineer, land...Hourly payLocal areaRemote work- ...management process in the development and delivery of program output Review materials and communications for compliance with established quality... ...our people are at the center of everything we do. Growth: AI-powered career tool that identifies career steps and learning...Work at officeWork from homeFlexible hours
- Welocalize is seeking a Content Reviewer to evaluate and refine AI-generated summaries for local language accuracy and cultural relevance. This freelance... ...guidelines, rephrase texts when needed, and edit AI outputs to enhance clarity and effectiveness while maintaining...Remote jobFreelanceLocal areaFlexible hours
$50 - $100 per hour
...Role Overview Apply civil engineering expertise to create realistic evaluation... ...and assess next-generation AI systems. This remote... ...solutions. Ability to create or review complex engineering artifacts... ...engagement. Compensation is output-based and paid for each task...Hourly payFor contractorsRemote work- ...Teachers, Postsecondary to develop and deliver content through AI training initiatives. Responsibilities include creating lectures... ...materials, and facilitating online discussions to enhance educational outputs. Candidates should have an advanced degree in Sociology and...Remote jobFlexible hours
- Mercor is seeking practicing Primary Care Physicians (MD) to review, annotate, and evaluate clinical documentation for an AI-enabled healthcare partner. You will ensure accuracy and safety of AI-generated notes within outpatient practice. Role requires current practice...Remote jobPart time10 hours per week
$50 - $70 per hour
...Help improve frontier AI systems by evaluating the everyday professional materials they... ...with feedback that helps shape real-world AI outputs. Role Overview This role is designed for... ...to the work. Key Responsibilities Review documents, slides, spreadsheets, and...Hourly payRemote work$24 - $28 per hour
...in delivering client‑centric engineering design services that prioritize... ..., mechanical, structural, and civil engineering, commissioning, acceptance... ...annual motor vehicle record reviews per company and client... ...characteristic protected by law. AI Disclosure & Accommodations...InternshipRemote workFlexible hours$23 per hour
A leading AI project platform is seeking a Freelance Annotation Quality Reviewer with advanced proficiency in Korean and English. This remote, part-time role involves reviewing and analyzing data, performing quality assurance, and contributing to process improvements in...Remote jobPart timeFreelance- ...Intelligence is transforming how the world communicates, learns, and solves problems—and skilled reviewers play an important role in improving the quality of these systems. As an AI Evaluation & Annotation Reviewer, you will evaluate AI-generated content, identify...Full timeShift work
$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals in Seattle to engage in reviewing and evaluating AI-generated scientific models. Candidates will work with flexible hours and competitive pay of up to $60 per hour. Applicants must have a relevant advanced...Remote jobHourly payFlexible hours- YO AI Labs is seeking PhD and academic experts to support AI research projects in a remote contractor role. You will evaluate AI responses across technical and humanities disciplines, develop expert prompts, reference answers, and critiques, and help set quality benchmarks...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Civil / Survey Engineer — AI Output Reviewer [Remote]. Be the first to apply!



