Test Engineer - Fully Remote | Upto $90/hr
$90 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: QA/Test Engineer
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
- Design test cases to confirm task functionality, including edge cases.
- Review tasks and reference solutions to catch ambiguities and gaps early.
- Debug using Python when tasks or checks misbehave.
- Build quality checklists and provide actionable feedback to authors.
- Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.
Qualifications
Must-Have
- MSc or PhD in a STEM field or equivalent practical experience.
- 1+ years in test engineering, quality assurance, or a related role.
- Experience designing test cases and debugging complex systems.
- Proficiency in Python and Git .
- Exceptional attention to detail and clear documentation habits.
Preferred
- Experience in AI training , model evaluation, or quality review of AI-generated work.
- A perfectionist mindset and ability to work independently through ambiguous problems.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Test Engineer - Fully Remote | Upto $90/hr in New York, NY vacancy
$90 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: QA/Test Engineer Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design test cases to confirm each...Remote workContract workSummer workMercor
New York, NY6 days ago$90 per hour
...Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text errors in chess commentary transcripts. Ensure accuracy...Remote workContract workSummer workFlexible hoursMercor
San Francisco, CA2 days ago$90 per hour
...Edge Cases Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...experience. ~1+ years of experience in research, research-engineering, security, or AI-evaluation roles. ~ Ability to...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design realistic, multi-step...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering Expert Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design realistic, multi-step...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$90 per hour
...Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role... ...of experience in research, research-engineering, or data-analysis roles. ~ Proficiency... ...statistical correlation, hypothesis testing. ~ Ability to communicate...Remote workContract workSummer workMercor
New York, NY6 days ago$90 per hour
...Animation Consultant Type: Contract Compensation: $60–$90/hour Location: Remote Role Responsibilities Establish evaluation standards... ...easy and hard to capture. Ensure the model has meaningful tests. Shape the evaluation pool. Define the profile,...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$90 per hour
...Jack Dorsey . Position: Finance Specialist Type: Contract Compensation: $65–$90/hour Location: Remote Role Responsibilities Guide research and engineering teams to close knowledge gaps in financial reasoning , analysis, and decision-making....Remote workContract workPart timeSummer workWeekday workMercor
New York, NY2 days ago$90 per hour
...Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct... ...digital forensics , vulnerability and penetration testing , security architecture and engineering , and governance/risk/compliance . Develop...Remote workContract workSummer workMercor
San Francisco, CA7 days ago$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: CAD Engineer — ScreenSpot Plus (Screenshot Capture & UI Annotation) Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Capture high-quality screenshots of...Remote workContract workSummer workMercor
New York, NY2 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mechanical Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written...Remote workContract workPart timeSummer workMercor
New York, NY2 days ago$90 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Civil Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written...Remote workContract workPart timeSummer work10 hours per weekMercor
San Francisco, CA2 days ago$90 per hour
..., Larry Summers , and Jack Dorsey . Position: Architecture Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content and AI-generated responses...Remote workContract workPart timeSummer work10 hours per weekMercor
San Francisco, CA2 days ago$90 per hour
...Larry Summers , and Jack Dorsey . Position: Sales & Marketing Experts Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct enterprise sales scenarios for $1M+ ACV deals at...Remote workHourly payWeekly payContract workPart timeFor contractorsSummer workMercor
San Francisco, CA2 days ago$90 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: STEM QA Reviewer — Electrical Engineering Type: Contract Compensation: $90/hour Location: Remote Duration: 3-week engagement (6/5–6/25) Role Responsibilities Evaluate the quality of...Remote workHourly payWeekly payContract workPart timeFor contractorsSummer workMercor
New York, NY2 days ago$90 per hour
..., Larry Summers , and Jack Dorsey . Position: Architecture Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content and AI-generated responses...Remote jobContract workPart timeSummer work10 hours per weekMercor
New York, NY3 days ago$90 per hour
...Animation Performance Consultant Type: Contract Compensation: $60–$90/hour Location: Remote Responsibilities Establish evaluation standards to define... ...strong examples of performances for meaningful model tests. Shape the evaluation pool by defining profiles and rubrics...Remote workHourly payContract workFor contractorsSummer workMercor Inc
New York, NY11 hours ago$90 per hour
...Kernel Expert Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and... ...custom-accelerator ecosystems. Background in compiler engineering, MLIR , or intermediate-representation lowering. Understanding...Remote jobContract workSummer work$90 per hour
...Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text errors in chess commentary transcripts to ensure...Remote jobContract workSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: FP&A Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct FP&A scenarios spanning budgeting, forecasting cycles, variance analysis, and strategic...Remote jobContract workSummer work$90 per hour
...Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise product scenarios for multi-quarter roadmap planning and cross-...Remote jobContract workSummer work$90 per hour
...Computational Fields Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...research skills like experimental design , hypothesis testing , and evaluation . Author solutions in Python and...Remote jobContract workSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design tasks by...Remote jobContract workSummer work$90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate... ...in application security, penetration testing, or vulnerability research. ~ Strong... ...design, or QA for security-focused engineering tasks. Application Process (Takes...Remote jobContract workSummer work- Quality Test Engineer (QTE) Contractor. $55 to 85/hr w2 or 1099 This is a hybrid work environment opportunity located in Boston, Massachusetts with a weekly... ...schedule of Tuesdays, Wednesdays and Thursdays and remote work availability on Mondays and Fridays.Our client is...Remote workFor contractorsWork experience placementWork at officeMonday to Friday
$90 per hour
...Position: Physics PhD Experts (General Relativity, Astrophysics & Cosmology) Type: Contract Compensation: $70–$90/hour Location: Remote Commitment: 4–6 tasks/week Role Responsibilities Develop high-quality data sets by creating challenging...Remote jobContract workSummer work$90 per hour
...Computational Fields Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...~ Strong grounding in experimental design and hypothesis testing. ~ Familiarity with Git , IDEs , and notebook...Remote jobContract workSummer workImmediate start$90 per hour
...Dorsey . Position: Human Baseliner for Open-Ended ML Research Tasks Type: Contract Compensation: $75–$90/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Attempt open-ended machine learning research tasks under...Remote jobContract workFor contractorsSummer work$90 per hour
...Contract Compensation: $60–$90/hour Location: Remote Commitment: 15–40 hours/week... ...5+ years of professional software engineering experience. Strong understanding... ...in offensive security, penetration testing, vulnerability research, or related...Remote jobContract workPart timeSummer workImmediate start$90 per hour
...Summers , and Jack Dorsey . Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation: $50–$90/hour Location: Bay Area, California Commitment: 40 hours/week Role Responsibilities Evaluate the quality of finance...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Engineer - Fully Remote | Upto $90/hr. Be the first to apply!
Related searches
- test engineer remote New York, NY
- performance test engineer New York, NY
- api test engineer New York, NY
- test engineer New York, NY
- lead performance test engineer New York, NY
- test automation engineer New York, NY
- senior test engineer New York, NY
- software engineering manager remote New York, NY
- system engineer remote New York, NY
- remote technical project manager New York, NY