Remote Systems Engineer Coding Agent Review & QA

$85 per hour

AI Trainer Jobs

Remote job

AI Trainer Jobs is seeking a Systems Engineer (Coding Agent Experience) for a remote, contractor role. You will run and reproduce candidate code outputs, grade solutions for correctness, and write minimal failing tests to demonstrate bugs. You will rank paired solutions with a clear, rubric-based rationale. The position offers $85 per hour, remote work eligibility in the US, and requires strong testing and debugging skills along with concise, convincing written notes for senior engineers. #J-18808-Ljbffr AI Trainer Jobs

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Remote Systems Engineer Coding Agent Review & QA in New York, NY vacancy

Remote Voice Agent Audio QA Reviewer
AuraOne is seeking a Voice Agent Audio QA Reviewer for a remote evaluation track. Reviewers compare paired outputs, label edge cases, and provide structured feedback to retrain the model. This role focuses on audio annotation prompts and responses against AuraOne's quality...
Remote job
For contractors
AI Trainer Jobs
New York, NY
6 days ago
Enterprise AI Agent QA Reviewer (Remote)
Enterprise AI Agent Users is a remote review track for evaluating AI outputs across enterprise ai agent users specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...
Remote job
Work experience placement
AI Trainer Jobs
New York, NY
6 days ago
Systems Engineer (Coding Agent Experience)
$85 per hour
...Systems Engineer (Coding Agent Experience) is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should...
Remote job
For contractors
10 hours per week
AuraOne Human Data
Remote
1 day ago
AI Agent Trajectory Annotator and Reviewer
$20 - $30 per hour
...Type: Contract, hourly Location: Remote Hours: 20–30 per week Pay: $20–... ...We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open... ...yet and judge it step by step. • Review — Take an existing annotation, written...
Remote work
Hourly pay
Full time
Contract work
Immediate start
Bespoke Labs
Parkersburg, WV
3 days ago
Principal, System Engineer 2, Multi-Agent AI, AdTech
...office (2 days/week) and remotely. #LI-Hybrid DIRECTV... ...seeking a Principal, System Engineer 2 to design, build,... ...architecture, production code, platform services,... ...ownership for secure multi‑agent systems and... ...coordinators, specialist agents, reviewers, human approval points...
Remote work
Work at office
Local area
2 days per week
Jobleads-US
New York, NY
2 days ago
Expert Codebase Evaluation Specialist - Coding Agent Review
...Expert Codebase Evaluation Specialist - Coding Agent Review is a remote evaluation track for reviewing codebase evaluation evaluation prompts and... ...-rater calibration Codebase Evaluation evaluation Engineering & Code AI evaluation Rubric writing Expert...
Remote job
Hourly pay
For contractors
10 hours per week
AuraOne Human Data
Remote
13 days ago
Full-Stack Developer - AI Systems & Agent Engineering
...Role Summary Direct Agents is running a growing fleet of AI-powered systems across our client and internal... ...re hiring a full-time, remote Full-Stack Developer to... ...working inside Claude Code as our primary engineering environment — steering and reviewing AI-generated code and...
Remote work
Full time
Contract work
Direct Agents
United States
5 days ago
Ecommerce Systems Engineer
...Hiya is seeking an Ecommerce Systems Engineer to join our internal technology... ...at technology, and uses AI coding tools as a daily practice rather... .... Act as the pull-request review gate for agency and... ...whole company will use. ~100% remote, flexible environment, with room...
Remote work
Permanent employment
Full time
For contractors
Work experience placement
Flexible hours
Hiya -- Reimagining Children's Health
United States
1 day ago
AFSIM Systems Engineer
$86.8k - $198k
AFSIM Systems EngineerThe Opportunity: Are you looking... ...a customer-focused engineering solution.As a systems... ...simulationsExperience coding languages commonly used... ...our Careers site and reviewing Our Employee Benefits... ...cameras on during meetings.Remote: If this position is...
Remote work
Full time
Contract work
Part time
Work at office
Local area
Booz Allen Hamilton
Charlottesville, VA
3 days ago
Distinguished SW Systems Engineer (10343)
$120k - $200k
...Toronto, CanadaProducts - Engineering /Fulltime /HybridOver... ...just advise on them—coding, validating, and... ...computing, distributed systems, and cloud networking... ...travel and significant remote engagement with customers... ...hiring process, such as reviewing applications,...
Remote work
Full time
H1b
Work at office
Worldwide
Work visa
Extreme Networks, Inc.
Raleigh, NC
5 days ago
Sr. Systems Engineer, Sales & Marketing
$132.42k - $272.62k
...join the IT Enterprise Systems team at Pinterest... ...analysts, and other engineers to translate ambiguous... ...risk, and speed.Use AI coding tools and agents to accelerate development... ...testing, code review, and observability to... ...anywhere in the country.#LI-REMOTE#LI-JD3At Pinterest we...
Remote work
Work at office
Local area
Relocation
Relocation package
Pinterest
San Francisco, CA
4 days ago
Systems Engineer III
...NSS’ leading software systems; data and analytics offerings... ...is eligible for remote work. Summary The... ...Develop high quality code/work products from User... ...experience employing sound engineering principles and problem-... ...source control, and code reviews. Experience with...
Remote work
For contractors
IDEMIA National Security Solutions
Remote
3 days ago
Product Manager, Agent Harness & Modelling
$205k - $320k
...who are building AI systems. We believe that... ...team of researchers, engineers, designers, and... ...securely deploy AI agents and automations... ...delegation, sandbox code execution, and failure... ...: comfortable reviewing and shaping design... ...offices if you are remote, plus an annual...
Remote work
Full time
Work at office
Local area
Home office
Flexible hours
Cohere
New York, NY
5 days ago
Remote DevOps/SRE Coding Review Engineer
AI Trainer Jobs seeks a Remote DevOps / SRE / Cloud Engineer (Coding Agent Experience) reviewer to evaluate production code, run tests, and critique AI outputs for correctness. You will reproduce failures, write minimal tests, and provide rationale to guide model improvements...
Remote job
AI Trainer Jobs
New York, NY
5 days ago
Senior Systems Engineer
...Senior Systems EngineerLocation: San Jose, California (REMOTE)Hire Type: ContractClient: County of Santa Clara CASkills... ...agencies.2. Recommend configuration/coding improvements for the iCAD System... ...of the system and perform quality review of interfaces to ensure they are...
Remote work
Argyle Infotech
San Jose, CA
3 days ago
Senior Security Systems Engineer
Job Description Senior Security Systems Engineer Preceptor Security Group Remote (15-20% Travel) Salary DOE About... ..., cameras, infrastructure) · Review drawings, specifications, and... ...System Integration · Programming/coding (Prefferred) · Experience with system...
Remote work
For subcontractor
Work at office
Preceptor
United States
2 days ago
Senior System Engineer
$30 - $60 per hour
...Senior System Engineer is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness... ...can target the gap. Category: Coding, SWE & Agent Evaluation · Pay: $30–$60 / hr · Location: Remote...
Remote work
For contractors
10 hours per week
AI Trainer Jobs
New York, NY
1 day ago
Senior Systems Engineer
$180k - $210k
...company delivering advanced systems, from sensors to... ...three business units: Remote Sensing (the data), Space... ...spacecraft operations to engineer platforms purpose-built... ...at key customer-facing reviews, acceptance events, and... ..., or other relevant coding experience. ~ Previous...
Remote work
Permanent employment
Work at office
Local area
Worldwide
Flexible hours
Umbra Lab LLC
Eastern, KY
2 days ago
Senior Systems Engineer
...Solutions is seeking a Senior Systems Engineer with an active Top Secret/... ...performed on-site, with limited remote work based on client... ...retrospectives, grooming, and reviews or demonstrations. Experience... ...Software development or coding experience with programming...
Remote work
RPMGlobal
Bethesda, MD
1 day ago
Senior Systems Engineer
$160k - $235k
...Senior Systems EngineerABSC has an exciting opening for... ...TS/SCI Senior Systems Engineer supporting DIA's National... ...tasks may be performed remotely. Percentage of remote... ...Retrospective, Grooming & Review/Demo)Experience with... ...Skills:Software development/coding experience with...
Remote work
Contract work
Flexible hours
Absolute Business Solutions Corp
Bethesda, MD
3 days ago
Senior Systems Engineer
...Solutions is seeking a Senior Systems Engineer to support the Defense... ...Bethesda, MD, with occasional remote work based on client requirements... ..., grooming, and reviews or demos. Experience with... ...Software development or coding experience with programming...
Remote work
Contract work
Casual work
Talentify.io
Bethesda, MD
2 days ago
Senior Systems Engineer
...Senior Systems Engineer Hybrid About the Role This is a hands-on... ...tests, support bundles, and remote operations that help customers... ...proposals, conduct rigorous reviews, and mentor other engineers.... ...assisted engineering tools, coding agents, harnesses, or automation...
Remote work
Local area
Cloudflare Inc
Washington DC
1 day ago
Senior Systems Engineer
$131.3k - $237.35k
...as our next TS/SCI Senior Systems Engineer supporting DIA’s National Digital... ...some tasks may be performed remotely. Percentage of remote work... ..., Retrospective, Grooming & Review/Demo) Experience with... ...Software development/coding experience with programming...
Remote work
Contract work
Flexible hours
Careerwebsite
Bethesda, MD
2 days ago
Technical Curriculum Developer - AI Agents - Remote
$100k - $175k
...RaleighState: NC Veeva Systems is a mission-... ...dabbled with AI agents. In this unique role... ...The AI Solutions Engineer turned Mentor/Coach... ...to learn and vibe code agentic solutions/... ..., our team will review your full application... ...stock bonus.#LI-Remote#LI-AssociateVeeva’s headquarters...
Remote work
Work at office
Local area
Work from home
3 days per week
Veeva Systems
Raleigh, NC
1 day ago
LLM Systems Engineer - Fully Remote | Upto $500/task Task based
$500 per month
...Jack Dorsey . Position: Agent Engineer Type: Contract Compensation... ...500 per task Location: Remote Role Responsibilities... ...AI interview ; no coding or take-home tasks. Live 3... ...****@*****.*** PS: Our team reviews applications daily. Please complete...
Remote job
Contract work
Summer work
Mercor
New York, NY
27 days ago
CDI QA Reviewer and Educator
$140k - $210k
...Division: Revenue Cycle Job Title: CDI QA Reviewer & Educator Job Code: Position Summary The CDI QA Reviewer... .... 5. Work Environment This is a remote position. On‑site presence may be required... ...requested by hospital leadership or system‑wide initiatives. Education &...
Remote work
Work experience placement
washingtonhospital
Fremont, CA
3 days ago
Senior Business Systems Engineer
$126.1k - $189.2k
...motivated Senior IT Business Systems Engineer to join our team. In this... ...prepare flowcharting, perform coding and tests/debugs programs, and... ...migrations and architecture reviews Adapt to shifting... ...Competitive benefits. Support for remote work or a desk with a view....
Remote work
Work experience placement
Shift work
Impinj
Seattle, WA
1 day ago
Search Systems Engineer - Fully Remote | Upto $150/hr
$150 per hour
.... Position: Software Engineer — Agentic Search Systems Type: Contract Compensation... ...$150/hour Location: Remote Role Responsibilities... ...interview. No coding, no take-home. ~ Follow-... ...mercor.com PS: Our team reviews applications daily. Please...
Remote job
Contract work
Summer work
Mercor
New York, NY
25 days ago
Remote AI Agent Evaluation Specialist
$60 per hour
...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help...
Remote job
Part time
Flexible hours
Mindrift
Kansas City, MO
2 days ago
Sr Staff Software Engineer ( AI Agents, Observability)
$190.9k - $334.1k
...DescriptionIt all started when engineer Fred Luddy wrote code that automated a... ...expanding AI agents for Observability group... ...and remediation systems, enabling enterprises... ...standards.Lead architecture reviews and technical... ...personas (flexible, remote, or required in...
Remote work
Work at office
Immediate start
Flexible hours
ServiceNow
Santa Clara, CA
17 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Systems Engineer Coding Agent Review & QA. Be the first to apply!