Test Engineer - Fully Remote

$60 - $90 per hour

Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: QA/Test Engineer

Type: Contract

Compensation: $60–$90/hour

Location: Remote

Commitment: 35 hours/week

Role Responsibilities

Design test cases to confirm task functionality, including edge cases.
Review tasks and reference solutions to catch ambiguities and gaps early.
Debug using Python when tasks or checks misbehave.
Build quality checklists and provide actionable feedback to authors.
Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.

Qualifications

Must-Have

MSc or PhD in a STEM field or equivalent practical experience.
1+ years in test engineering, quality assurance, or a related role.
Experience designing test cases and debugging complex systems.
Proficiency in Python and Git .
Exceptional attention to detail and clear documentation habits.

Preferred

Experience in AI training , model evaluation, or quality review of AI-generated work.
A perfectionist mindset and ability to work independently through ambiguous problems.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on jobs.jobcopilot.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 9 hours ago

Similar jobs that could be interesting for youBased on the Test Engineer - Fully Remote in New York, NY vacancy

QA Test Engineer
...QA Test Engineer We are seeking a QA Test Engineer to join our team. This role involves working within an Agile/Kanban hybrid model... ...scripting using TypeScript. Work Environment This is a fully remote position with optional office access. The team culture is...
Remote work
Work at office
Apex Systems
United States
3 days ago
Senior Test Automation Engineer
...Senior Test Automation EngineerTrillium Professional is now seeking a Senior Test Automation Engineer for a fully remote position out Richmond, VA!The client is seeking to fill an open position for a Senior Quality Assurance Test Automation Engineer. In this role the candidate...
Remote work
Work at office
Immediate start
Trillium Staffing
Richmond, VA
1 day ago
Test Automation Engineering As...
$55 - $56 per hour
...Senior-Level Test Automation Engineer A senior-level Test Automation Engineer responsible for designing, developing, and maintaining automated... ...Publishing Pay Range: $55.00 – $56.00 hourly This is a fully remote role and can be performed from an approved location....
Remote work
Hourly pay
Contract work
Local area
GDH
United States
2 days ago
QA Test Engineer
QA Test EngineerJob#: 3037125Job Description:QA Test EngineerLocation: 100% RemoteRole OverviewWe are seeking a QA Test Engineer to join our team. This role involves working within an Agile/... ...TypeScript.Work EnvironmentThis is a fully remote position with optional office...
Remote work
Work at office
Apex Systems
Denver, CO
3 days ago
Test Engineer (Clearance Required)
$98.61k - $167.64k
...The Work: We are seeking a detail-oriented Test Engineer to support User Acceptance Testing (UAT), automated and regression testing efforts... ...requirements and are release-ready.Job Location: This is a fully remote role which may require occasional travel to the DC Metro...
Remote work
Full time
Contract work
Work experience placement
Work at office
ICF
Reston, VA
a month ago
Test Engineer, Features
...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Test Engineer, Features based in the United States. This fully remote role owns end-to-end quality for new product features as they move from requirements to release....
Remote work
Full time
Contract work
Home office
Flexible hours
jobgether
United States
5 days ago
Test Engineer I
Test Engineer ILocation: 633 17th Street, Suite 201 Denver, Colorado 80202 (REMOTE)Duration: 12 Months ContractRequired Qualifications To Be Successful In This Role:• Knowledge... ....• Ability to function in a fast-paced, dynamic environment in a fully remote position. My3Tech
Remote work
Work at office
My3Tech
Denver, CO
1 day ago
Senior Manufacturing Test Engineer
...growing, forward-thinking team of architects, engineers, and business professionals with a... ...exceptional talent in onsite, hybrid, and fully remote roles.Cornelis Networks designs and... ...professional with experience in Manufacturing Test Engineering that includes both hardware...
Remote work
Full time
Contract work
Work experience placement
Flexible hours
Cornelis Networks
Wayne, PA
3 days ago
Testing Systems Engineering
Test EngineerLyntris is a defense technology company that connects sensing to action... ...by operators who understand the mission, engineered for the conditions that degrade or defeat... ...is hybrid located in St. Paul, MN.Fully remote candidates may be considered with increased...
Remote work
For subcontractor
Internship
Work at office
Accelint
Saint Paul, MN
3 days ago
Test Automation Engineer - Cucumber
...of a partner company, who manages all applications and next steps. Our partner is looking for a Test Automation Engineer – Cucumber based in Austria. This is a fully remote opportunity for an experienced automation testing professional to strengthen software quality...
Remote work
Full time
Relocation
jobgether
United States
4 days ago
Quality Test Engineer, II
$108.9k - $130.7k
...directly with a truck manufacturer. Meet the Team The Test Engineer supports the testing of our autonomous vehicles in addition to... ...implement systems responsible for data acquisition and analysis from remote vehicles in the field. Ensure software updates do not...
Remote work
Full time
Work experience placement
Immediate start
Shift work
Torc Robotics
Fort Worth, TX
9 hours ago
Senior ADAS Test Engineer I
$84.5k - $105.6k
...Coordinating and executing a wide range of testing and development tasks essential for... ...closely with teams in Japan, international engineering teams, and external partners, this role... ...Workstyle This is an onsite job. One remote workday per week may be possible with prior...
Remote work
Full time
Temporary work
Work experience placement
Relocation package
Honda Dev. and Mfg. of Am.,LLC
Raymond, OH
14 days ago
Senior ADAS Test Engineer II
$95.6k - $119.5k
...our team to Bring the Future! Job Purpose The Senior ADAS Test Engineer will play a crucial role in coordinating and executing a wide... ...presentation skills Workstyle ~ This is an onsite job. One remote workday per week may be possible with prior departmental...
Remote work
Full time
Temporary work
Work experience placement
Relocation package
Honda Dev. and Mfg. of Am.,LLC
Raymond, OH
2 days ago
ADAS Test Engineer
$73.9k - $110.8k
...and advanced safety in Honda and Acura products. VCAP ADAS test engineers take ownership of developing a function or feature on the vehicle... ...travel may be requested) This is an onsite job. One remote workday per week may be possible with prior department approval...
Remote work
Full time
Temporary work
Work experience placement
Internship
Relocation package
Honda Dev. and Mfg. of Am.,LLC
Raymond, OH
3 days ago
Test Engineer
$1,500 per month
...Test Engineer Clearance Level: Must have an active clearance (secret/top secret, etc.) in... ...then .50 cents / $1 for 4th and 5th %s ~ Fully vested from day one ~ Company match... ...Employees eligible for this benefit must work remote 2 days a week or more to qualify. Buy...
Remote work
Full time
Work from home
2 days per week
Aquila Technology
Lexington, KY
9 hours ago
EW Test Engineer
...Warfare (EW) systems. This individual will be tasked to support test and analysis of electronic warfare systems, will participate and... ...execution. • Possess the ability and willingness to work in a remote environment with a highly motivated team. Required Skills:...
Remote work
Full time
Modern Technology Solutions Inc
Paradise, CA
9 hours ago
WLAN Test Engineer
Hybrid position. 3 days onsite, 2 days remote. \7 months contract, extendable to a year. \ \ Required knowledge: \ Testing Requirements: WLAN/WiFi Engineer with standards experience \ Omni Peek, Wireshark \ Create and execute test plans for automation cases \...
Remote work
Full time
Contract work
For contractors
Nextrow Digital
Holtsville, NY
9 hours ago
PIC Test Engineer- Tempe
...Position Description This is a fully onsite opportunity based in Tempe, Arizona. The PIC Test Engineer will support the characterization and evaluation of photonic... ...Support efforts related to automated measurement, remote instrument control, and data-driven test...
Remote work
Full time
Qci Inc
Tempe, AZ
9 hours ago
Remote Ubuntu Linux Kernel Test Engineer
...dedicated, systematic approach to testing at scale. The Canonical... ...Kernel Team is looking for a Test Engineer to take ownership of our... ...Location: This role will be based remotely in the APAC region, except... ...recruitment process. Fully remote working environment –...
Remote work
Full time
Work at office
Canonical
Remote
7 days ago
Testing Engineering M/F
...are looking for a self directed, critically minded engineer/scientist/statistician to develop and maintain test suites for a line of machine vision and biometrics... ..., databases. SQL, XML, JSON, HTML, etc. GIS, remote sensing. Additional Information Position Details...
Remote work
Full time
Contract work
Mavrx
San Francisco, CA
9 hours ago
Testing Systems Engineering
...Location: Annapolis Jct, MD Category: Software Engineer Travel Required: No Remote Type: No Clearance: TS/SCI w/ Polygraph Position Requirement... ..., and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data...
Remote work
Full time
Contract work
Sunayu
Annapolis Junction, MD
9 hours ago
Test Engineer
...advancing technologies for human space exploration. We are seeking a Test Engineer to join our team at the NASA Johnson Space Center (JSC) in... ...include flexible work schedules and opportunities to work remotely, educational reimbursement, retirement benefits (401K, Roth),...
Remote work
Full time
Contract work
Work at office
Flexible hours
Geocontrol Systems
Houston, TX
9 hours ago
Test Engineer
$85k - $125k
...wireless internet access in urban settings and remote locations. Elve delivers a transformative... ...We are looking for associate production engineers to play key roles in bringing our... ...wait to meet you! Job Description A Test engineer at Elve is responsible for the characterization...
Remote work
Full time
Work experience placement
Work at office
Worldwide
Elve, Inc.
Davis, CA
9 hours ago
Testing Engineering M/F
$120k - $155k
...HYBRID POSITION. APPROXIMATELY 60% ONSITE/40% REMOTE. AUSGAR Technologies, Inc., an equal... ...Assurance, Cybersecurity and Systems Engineering. With offices on both the East and West... ...opportunity abounds for the right individual! Test Engineer – CONTINGENT - 26-032 – Hybrid...
Remote work
Full time
Contract work
For contractors
Work at office
AUSGAR Technologies Inc.
San Diego, CA
9 hours ago
Test Engineer
$125k - $225k
...design and development, and ground and flight testing. Our Aerospace Systems Group provides... ...their agencies. We are seeking a Test Engineer to join our team. This position requires... ...and conduct test campaigns at in-house or remote facilities Author test reports communicating...
Remote work
Full time
Work experience placement
Toyon Research Corporation
Goleta, CA
9 hours ago
Test Engineer III - (E3)
$96k - $132k
...Materials is a global leader in materials engineering solutions used to produce virtually every... .... Learn more about our benefits . Test Engineer Level/Grade: E3 General... ...underlying system implications. Provide remote and onsite support to field support...
Remote work
Full time
Relocation
Applied Materials
Gloucester, MA
9 hours ago
Specialty Test Engineer (level 3 or 4)
$98.9k - $148.3k
...n\nNorthrop Grumman Defense Systems is seeking an experienced Test Engineer to support our Armament Systems site in Plymouth, MN.\n\nThis... ...skills and ability to clearly establish verbal communication with remote audience.\n * Ability to manage multiple concurrent tasks.\n *...
Remote work
Full time
Relocation package
Flexible hours
Shift work
Northrop Grumman
Plymouth, MN
9 hours ago
Systems Test Engineering, Senior
$60k - $180k
...Infrastructure, Software Development, and Finance & Accounting. M9 Solutions is seeking a Senior Test Engineer to support a government contract hybrid remote/onsite for a client located in San Diego, CA . An active Top Secret clearance is required. Responsibilities...
Remote work
Full time
Contract work
For subcontractor
M9 Solutions
San Diego, CA
9 hours ago
Systems Test Engineering, Senior
...Partners, and Embedded Ventures. Role Summary As a Senior Test Engineer, HITL, you will work across our full product line, from... ...communication protocols and telemetry systems used in distributed or remote systems. Experience with CI/CD pipelines and automated test...
Remote work
Full time
Work at office
Local area
Flexible hours
3 days per week
Observable Space
Los Angeles, CA
9 hours ago
Test Engineer - Level 2 or Level 3
$83.4k - $125.2k
...impossible. Our employees are not only part of history, they're making history. Northrop Grumman’s Space Sector is seeking a Test Engineer - Level 2 or Level 3 to join our MEP Team in Oxnard, CA. This position is 100% onsite and cannot accommodate telecommute...
Remote work
Full time
Relocation
Shift work
Night shift
Day shift
Afternoon shift
Northrop Grumman
Oxnard, CA
9 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Test Engineer - Fully Remote. Be the first to apply!