Test Engineer - Fully Remote | Upto $90/hr
$90 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: QA/Test Engineer
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
- Design test cases to confirm task functionality, including edge cases.
- Review tasks and reference solutions to catch ambiguities and gaps early.
- Debug using Python when tasks or checks misbehave.
- Build quality checklists and provide actionable feedback to authors.
- Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.
Qualifications
Must-Have
- MSc or PhD in a STEM field or equivalent practical experience.
- 1+ years in test engineering, quality assurance, or a related role.
- Experience designing test cases and debugging complex systems.
- Proficiency in Python and Git .
- Exceptional attention to detail and clear documentation habits.
Preferred
- Experience in AI training , model evaluation, or quality review of AI-generated work.
- A perfectionist mindset and ability to work independently through ambiguous problems.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Test Engineer - Fully Remote | Upto $90/hr in New York, NY vacancy
$90 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: QA/Test Engineer Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design test cases to confirm task...Remote workContract workSummer workMercor
New York, NY6 days ago$90 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: QA/Test Engineer Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design test cases to confirm each...Remote jobContract workSummer work$90 per hour
..., and Jack Dorsey . Position: Finance & Insurance Practice Reviewer Type: Contract Compensation: $75–$90/hour Location: Remote Role Responsibilities Evaluate AI-generated work in finance and insurance to ensure task realism and domain accuracy...Remote workContract workSummer workFlexible hoursMercor
New York, NY6 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering Simulation Specialist Type: Contract Compensation: $60–$90/hour Location: Remote Role Responsibilities Develop simulations and specification sheets for AI...Remote workContract workSummer workMercor
New York, NY6 days ago$90 per hour
...Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text errors in chess commentary transcripts. Ensure accuracy...Remote workContract workSummer workFlexible hoursMercor
San Francisco, CA6 days ago$90 per hour
...Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise product scenarios for multi-quarter roadmap planning and cross-...Remote workContract workSummer workMercor
New York, NY6 days ago$90 per hour
...Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct... ...threat detection , vulnerability testing , and security architecture . Develop... ...Must-Have ~5+ years as a security engineer or CISO at a major company or security...Remote workContract workSummer workMercor
San Francisco, CA6 days ago$90 per hour
...Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and... ...architecture correctness. ~ Familiarity with local emulation/testing fidelity (e.g., LocalStack ). Preferred AWS...Remote jobContract workSummer workLocal areaMercor
San Francisco, CA6 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design realistic, multi-step...Remote workContract workSummer workMercor
San Francisco, CA6 days ago$90 per hour
...Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and... ...HPA , Prometheus/Grafana ). Prior SRE / platform-engineering or task-grading experience. Application Process (Takes...Remote workContract workSummer workMercor
San Francisco, CA6 days ago$90 per hour
...Animation Consultant Type: Contract Compensation: $60–$90/hour Location: Remote Role Responsibilities Establish evaluation standards... ...easy and hard to capture. Ensure the model has meaningful tests. Shape the evaluation pool. Define the profile,...Remote workContract workSummer workMercor
San Francisco, CA6 days ago$90 per hour
...Summers , and Jack Dorsey . Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation: $50–$90/hour Location: Bay Area, California Commitment: 40 hours/week Role Responsibilities Evaluate the quality of finance...Remote workContract workSummer workMercor
San Francisco, CA6 days ago$90 per hour
...Domain Expert Type: Contract Compensation: $60–$90/hour Location: Remote Role Responsibilities Review multi-step enterprise... ...what separates great selling from average. Operate in test environments mirroring a real sales tech stack. Simulate workflows...Remote workContract workSummer workWork at officeMercor
New York, NY6 days ago$90 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Civil Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written...Remote workContract workPart timeSummer work10 hours per weekMercor
San Francisco, CA6 days ago$90 per hour
..., Larry Summers , and Jack Dorsey . Position: Architecture Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content and AI-generated responses...Remote workContract workPart timeSummer work10 hours per weekMercor
San Francisco, CA6 days ago$90 - $170 per hour
...\n Type: Contractor \n \n Compensation: $90–$170/hour \n \n Location: Remote \n \n About the Opportunity \n We are seeking experienced... ...0/hour. \n Independent contractor engagement. \n Fully remote and flexible project-based work. \n...Remote jobFor contractorsFlexible hoursSynthires
West Virginia5 days ago$90 per hour
...Kernel Expert Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and... ...custom-accelerator ecosystems. Background in compiler engineering, MLIR , or intermediate-representation lowering. Understanding...Remote jobContract workSummer work$90 - $140 per hour
...\n Type: Contractor \n \n Compensation: $90–$140/hour \n \n Location: Remote \n \n About the Opportunity \n We are seeking experienced... ...hour. \n ~ Independent contractor engagement. \n ~ Fully remote with a flexible schedule. \n ~ Approximately...Remote jobFor contractorsFlexible hoursSynthires
West Virginia8 days ago$90 per hour
...Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text errors in chess commentary transcripts to ensure...Remote jobContract workSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: FP&A Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct FP&A scenarios spanning budgeting, forecasting cycles, variance analysis, and strategic...Remote jobContract workSummer work$90 per hour
...Computational Fields Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...research skills like experimental design , hypothesis testing , and evaluation . Author solutions in Python and...Remote jobContract workSummer work$90 per hour
...Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise product scenarios for multi-quarter roadmap planning and cross-...Remote jobContract workSummer work$90 per hour
...Edge Cases Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...experience. ~1+ years of experience in research, research-engineering, security, or AI-evaluation roles. ~ Ability to...Remote jobContract workSummer work$90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate... ...in application security, penetration testing, or vulnerability research. ~ Strong... ...design, or QA for security-focused engineering tasks. Application Process (Takes...Remote jobContract workSummer work$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design realistic, multi-step...Remote jobContract workSummer work$90 per hour
...Jack Dorsey . Position: Finance Specialist Type: Contract Compensation: $65–$90/hour Location: Remote Role Responsibilities Guide research and engineering teams to close knowledge gaps in financial reasoning , analysis, and decision-making....Remote jobContract workPart timeSummer workWeekday work$90 per hour
...Jack Dorsey . Position: Clinical & Health Care Operations Reviewer Type: Contract Compensation: $75–$90/hour Location: Remote Role Responsibilities Evaluate AI work product in health care to ensure realistic task representation and accuracy...Remote jobHourly payContract workFor contractorsSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content and AI-generated...Remote jobContract workPart timeSummer work10 hours per week$90 per hour
...Jack Dorsey . Position: Study Domain Expert — Judge Calibration — Sales Type: Contract Compensation: $90/hour Location: Remote Duration: September 12–15, 2026 Commitment: 13 hours Role Responsibilities Sign an NDA before receiving...Remote jobHourly payContract workFor contractorsSummer work$90 per hour
...Larry Summers , and Jack Dorsey . Position: Drug Discovery Scientist Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design realistic research problems for AI models in...Remote jobHourly payContract workFor contractorsSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Engineer - Fully Remote | Upto $90/hr. Be the first to apply!
Related searches
- test engineer New York, NY
- lead performance test engineer New York, NY
- remote reviewer New York, NY
- remote veterinarian New York, NY
- remote property manager New York, NY
- marketing assistant remote New York, NY
- remote sales consultant New York, NY
- contract specialist remote New York, NY
- backend internship remote New York, NY
- medicare sales agent remote New York, NY