Test Engineer - Fully Remote | Upto $90/hr
$90 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: QA/Test Engineer
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
- Design test cases to confirm task functionality, including edge cases.
- Review tasks and reference solutions to catch ambiguities and gaps early.
- Debug using Python when tasks or checks misbehave.
- Build quality checklists and provide actionable feedback to authors.
- Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.
Qualifications
Must-Have
- MSc or PhD in a STEM field or equivalent practical experience.
- 1+ years in test engineering, quality assurance, or a related role.
- Experience designing test cases and debugging complex systems.
- Proficiency in Python and Git .
- Exceptional attention to detail and clear documentation habits.
Preferred
- Experience in AI training , model evaluation, or quality review of AI-generated work.
- A perfectionist mindset and ability to work independently through ambiguous problems.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Test Engineer - Fully Remote | Upto $90/hr in New York, NY vacancy
$90 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: QA/Test Engineer Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design test cases to confirm each...Remote jobContract workSummer workMercor
New York, NY15 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Electrical Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written...Remote jobContract workPart timeSummer workMercor
San Francisco, CA13 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Electrical Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written...Remote jobContract workPart timeSummer workMercor
San Francisco, CA5 days ago$90 per hour
...Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct... ...threat detection , vulnerability testing , and security architecture . Develop... ...Must-Have ~5+ years as a security engineer or CISO at a major company or security...Remote jobContract workSummer workMercor
San Francisco, CA5 days ago$90 per hour
...Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text errors in chess commentary transcripts. Ensure accuracy...Remote jobContract workSummer workFlexible hoursMercor
San Francisco, CA13 days ago$90 per hour
...Computational Fields Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...~ Strong grounding in experimental design and hypothesis testing. ~ Familiarity with Git , IDEs , and notebook...Remote jobContract workSummer workImmediate startMercor
San Francisco, CA13 days ago$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design tasks by...Remote jobContract workSummer workMercor
New York, NY5 days ago$90 per hour
...Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role... ...of experience in research, research-engineering, or data-analysis roles. ~ Proficiency... ...statistical correlation, hypothesis testing. ~ Ability to communicate...Remote jobContract workSummer workMercor
New York, NY3 days ago$90 per hour
...Dorsey . Position: Human Baseliner for Open-Ended ML Research Tasks Type: Contract Compensation: $75–$90/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Attempt open-ended machine learning research tasks under...Remote jobContract workFor contractorsSummer workMercor
San Francisco, CA23 days ago$90 per hour
...Jack Dorsey . Position: Legal Domain Expert — AI Training & Evaluation Type: Contract Compensation: $50–$90/hour Location: Remote Commitment: 40 hours/week Role Responsibilities Evaluate the quality of legal knowledge work tasks and AI...Remote jobWeekly payContract workSummer workMercor
San Francisco, CA11 days ago$90 per hour
...Physics PhD Experts (String theory, QFT, Particle physics & Nuclear physics) Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Develop challenging problems in String theory , Quantum Field theory , particle...Remote jobContract workSummer workMercor
New York, NY5 days ago$90 per hour
...Contract Compensation: $60–$90/hour Location: Remote Commitment: 15–40 hours/week... ...5+ years of professional software engineering experience. Strong understanding... ...in offensive security, penetration testing, vulnerability research, or related...Remote jobContract workPart timeSummer workImmediate startMercor
New York, NY16 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Chemical Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written...Remote jobContract workPart timeSummer work10 hours per weekMercor
San Francisco, CA11 days ago$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design tasks by...Remote jobHourly payWeekly payContract workFor contractorsSummer workMercor
New York, NY14 days ago$90 per hour
...Animation Performance Consultant Type: Contract Compensation: $60–$90/hour Location: Remote Responsibilities Establish evaluation standards to define... ...strong examples of performances for meaningful model tests. Shape the evaluation pool by defining profiles and rubrics...Remote workHourly payContract workFor contractorsSummer workMercor Inc
New York, NY5 days ago- Quality Test Engineer (QTE) Contractor. $55 to 85/hr w2 or 1099 This is a hybrid work environment opportunity located in Boston, Massachusetts with a weekly... ...schedule of Tuesdays, Wednesdays and Thursdays and remote work availability on Mondays and Fridays.Our client is...Remote workFor contractorsWork experience placementWork at officeMonday to Friday
$90 per hour
...level review. AI proficiency: familiarity with AI tools and workflows, including the ability to generate your own visual samples for testing and comparison. The ability to translate complex visual details into clear, precise language that can be captured in data captions...Remote jobPart time$90 per hour
...Overview We''re building a select group of experienced chemical engineers to help evaluate and improve how AI systems understand and... ...flexible, part-time engagement — approximately 10 hours per week , fully remote, with the opportunity to continue and grow over time. What...Remote jobContract workPart time10 hours per weekFlexible hours$90 per hour
...benchmarks: Identify strong examples of performances that are easy to capture and ones that are genuinely hard, so the model has meaningful tests to measure against. Shape the evaluation pool: Help define the right profile, expertise mix, and rubric for the human reviewers who...Remote jobFull timeContract workPart timeFreelance$60 - $90 per hour
...design and execute rigorous test cases, probe edge cases, and... ...experience in a research-heavy or engineering-heavy domain. At least 1... ...workflows. Location: Fully remote within the United States, candidates... ...~ Pay rate: $60.00 to $90.00 per hour, paid on an hourly...Remote workHourly payFull timeFreelanceSaidGig
United States21 days ago$90 - $120 per hour
...Equity Research Associate (Remote | Part-Time | $90 –$120/hr) Apply for the Equity Research Associate role at Call For Referral . This position... ...to work independently More About the Opportunity Fully remote and asynchronous – work around your existing schedule...Remote workHourly payFull timeContract workPart timeFlexible hoursCall For Referral
San Francisco, CA1 day ago$110 per hour
...Position: Security Expert Type: Contract Compensation: $90–$110/hour Location: Remote Role Responsibilities Review simulated vendor SOC 2 reports , security questionnaires, and pen-test evidence against a buyer's security standard. Catch scope...Remote jobContract workSummer workMercor
San Francisco, CA11 days ago$100 per hour
...Larry Summers , and Jack Dorsey . Position: Intellectual Property Expert Type: Contract Compensation: $90–$100/hour Location: Remote Role Responsibilities Construct IP scenarios spanning patent prosecution, portfolio strategy, trademark,...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA5 days ago$110 per hour
..., Larry Summers , and Jack Dorsey . Position: Real Estate Brokers Type: Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks Commitment: 30–40 hours/week Role Responsibilities Create deliverables addressing...Remote jobContract workSummer workImmediate startMercor
New York, NY24 days ago$80 - $90 per hour
Cybersecurity Engineer(Remote | $80-$90/hr) Position: Cybersecurity Expert Type: Hourly Contract Compensation: $80-$90/hour Location: Remote About... ..., and technical rigor across deliverables. Schedule: Fully remote and flexible Engagement: Independent contractor Duration...Remote jobHourly payContract workFor contractorsFlexible hours- ...QA/Accessibility Test Engineer About Focus Focus is a digital services firm dedicated... ...maintaining a good work-life balance. We are a fully remote team and all employees must be located... ...screen (30 mins) Technical Interview (1.5 hr) Behavioral Interview (1 hr)...Remote jobFull time
Focus
Remote8 hours ago $110 per hour
...Position: Finance & Banking Expert Type: Contract Compensation: $90–$110/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Author tasks that test an AI's ability to reason over financial documents and produce accurate...Remote jobContract workSummer workMercor
San Francisco, CA23 days ago$150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Medical Writer Type: Contract Compensation: $90–$150/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities Generate and validate high-quality, synthetic clinical...Remote jobContract workSummer workMercor
New York, NY3 days ago$90 - $150 per hour
Investment Banking & Investment Analyst (Remote | $90-$150/hr) Contract, hourly, fully remote and asynchronous. Expect 20+ hours per week, duration until end of January (possible extension). Role Overview Mercor is recruiting Investment Banking and Private Equity experts...Remote jobHourly payFull timeContract work$130 per hour
...Dorsey . Position: Domain Expert – Diagnostic Imaging (Visage 7 Research) Type: Contract Compensation: $90–$130/hour Location: Remote Role Responsibilities Confirm the patient's imaging record reflects actual acquisitions and conclusions,...Remote jobContract workSummer workMercor
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test Engineer - Fully Remote | Upto $90/hr. Be the first to apply!
Related searches
- test automation engineer New York, NY
- lead performance test engineer New York, NY
- drive test engineer New York, NY
- senior test engineer New York, NY
- test engineer New York, NY
- performance test engineer New York, NY
- senior devops engineer remote New York, NY
- medical coding remote New York, NY
- remote medical coding supervisor New York, NY
- remote virtual New York, NY