Systems Engineer - AI Model Evaluator
$85 per hourPart-time
Mercor
Role Description
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Systems Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex engineering tasks.
- Review model-generated code, architecture decisions, and systems implementations.
- Identify bugs, edge cases, performance bottlenecks, and failure modes.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic systems engineering scenarios.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
Qualifications
- Must-Have: 2+ years of professional systems engineering experience.
- Experience with distributed systems, networking, operating systems, storage systems, infrastructure software, or database internals.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated systems designs and implementations.
- Preferred: Experience building highly scalable and performance-critical systems.
Requirements
- Compensation: $400 per accepted task.
- Compensation is tied to accepted work.
Application Process
- Upload resume.
- AI interview based on your resume.
- Submit form.
Resources & Support
- For details about the interview process and platform information, please check: Interview Process .
- For any help or support, reach out to: View email address on remotive.com .
- PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Systems Engineer - AI Model Evaluator in Remote vacancy
$40 per hour
A leading AI training company is seeking a Postdoctoral Physics Associate to evaluate AI chatbot outputs and enhance model quality. This remote position requires an expert level of understanding in physics concepts, along with a PhD. Candidates will assess the performance...SuggestedHourly payRemote workFlexible hoursDataAnnotation
Lansing, MI5 days ago$40 per hour
A cybersecurity technology company is seeking experienced professionals to evaluate AI-generated security content and design technical solutions. This remote role offers flexibility with project selection and scheduling. Ideal candidates should possess over 2 years of hands...SuggestedRemote jobHourly pay$40 per hour
A leading AI development firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical cybersecurity problems. The role allows for flexible hours and the option to work from various countries, including the US. Ideal...SuggestedRemote jobHourly payFlexible hours$40 per hour
A leading cybersecurity firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This remote role allows flexibility in project selection and working hours. Candidates should have at least 2 years of...SuggestedRemote jobHourly pay$40 per hour
A leading cybersecurity firm is looking for experienced professionals to train AI models by evaluating AI-generated security content and solving technical cybersecurity problems. This remote position allows you to work from anywhere in the US and choose your projects. Ideal...SuggestedRemote jobHourly pay$40 per hour
A technology firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical challenges in a remote capacity. Candidates should have over 2 years of hands-on experience in various cybersecurity fields, strong writing...Remote jobHourly pay- A leading AI training company is seeking medical experts to evaluate AI chatbots by solving diverse healthcare-related problems and ensuring their accuracy. The role offers flexibility, allowing you to choose projects and work at your own schedule. Ideal candidates will...Hourly payContract workRemote work
DataAnnotation
Sioux Falls, SD5 days ago $40 per hour
A cybersecurity company is seeking experienced professionals for a remote role focused on evaluating AI-generated security content and solving technical cybersecurity issues. Candidates should have over 2 years of hands-on experience in areas like penetration testing and...Remote jobHourly payFlexible hours$40 per hour
A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated analysis and shape future AI systems. The role offers fully remote work with a flexible schedule and competitive pay starting at $40+ per hour. Candidates should...Remote jobHourly payFlexible hours$40 per hour
A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This role is flexible, allowing you to choose your projects and work from anywhere. Ideal candidates should have at least...Remote jobHourly payFlexible hours$40 per hour
...tech firm is seeking experienced quantitative professionals to evaluate AI-generated analyses and enhance AI development. The role offers... ...skills. This opportunity impacts the evolution of AI systems focused on reasoning and data analytics. Applicants can work alongside...Remote jobHourly pay$40 per hour
A dynamic AI development company is seeking experienced quantitative professionals in Georgia to evaluate AI-generated work and provide vital feedback. This role is fully remote, allowing candidates from various countries to contribute flexibly. Ideal applicants will have...Remote jobHourly pay$40 per hour
A tech-focused company is seeking experienced quantitative professionals to evaluate AI-generated analysis and provide technical feedback. This remote role allows you to choose your schedule and work from various countries including the US. Ideal candidates will have a...Remote jobHourly pay$40 per hour
A cybersecurity technology firm is seeking experienced cybersecurity professionals for a remote role to evaluate AI-generated security content and solve technical problems. Candidates should have over 2 years of experience in various cybersecurity roles, coding skills,...Remote jobHourly payFlexible hours$40 per hour
A cutting-edge AI technology firm is looking for experienced quantitative professionals to evaluate AI-generated quantitative analyses and provide critical feedback that shapes future AI systems. This fully remote role allows for a flexible schedule and offers competitive...Remote jobHourly payFlexible hours$40 per hour
...cybersecurity firm is looking for experienced professionals to evaluate AI-generated security content. In this role, you will solve... ...technical cybersecurity problems and provide feedback to improve AI systems. Candidates should have over 2 years of experience in...Remote jobHourly pay$40 per hour
A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated quantitative analysis and solve technical problems. This fully remote... ...while contributing to cutting-edge AI systems. The ideal candidate will have hands-on experience...Remote jobHourly pay$40 per hour
A legal technology company in California is seeking a legal expert to train and evaluate AI models. The position requires a completed or in-progress law degree and offers flexibility with project selection and hourly pay starting at $40+. Candidates must have a high level...Remote jobHourly payContract work$40 per hour
A cybersecurity-focused technology company is looking for experienced professionals to evaluate AI-generated security content and solve technical problems. The role allows for flexible hours and remote work, offering competitive pay starting at $40 per hour. Ideal candidates...Remote jobHourly payFlexible hours$40 per hour
...cybersecurity sector is seeking experienced professionals to evaluate AI-generated security content. In this remote role, you will work... ...schedule, solve technical cybersecurity problems, and help train AI models. Preferred candidates will have at least 2 years of experience...Remote jobHourly payFlexible hours$40 per hour
A leading cybersecurity company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This remote role offers flexibility in project selection and is ideal for candidates with at least 2...Remote jobHourly pay$40 per hour
A leading AI training company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This role allows you... ...choice of projects, fostering contributions to AI system improvements. Candidates must have at least 2...Remote jobHourly pay$40 per hour
...experienced cybersecurity professionals for a remote position. Responsibilities include evaluating AI-generated security content and solving technical challenges to train AI models. Candidates should have at least 2 years of hands-on cybersecurity experience, some coding...Remote jobHourly payFlexible hours$40 per hour
A cybersecurity firm is seeking experienced cybersecurity professionals to evaluate AI-generated content, solve technical problems, and provide feedback. The role allows for remote work with flexible hours. Candidates need at least 2 years of experience in cybersecurity...Remote jobHourly payFlexible hours$40 per hour
A leading AI development company is seeking experienced quantitative professionals to join their remote team. The role involves evaluating AI-generated work, designing quantitative problems, and providing impactful feedback. Candidates with at least 2 years of quantitative...Remote jobHourly pay- ...cybersecurity services company is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity... ...coding skills. Responsibilities include assessing AI security models and providing critical feedback. A preferred bachelor's degree...Remote job
$40 per hour
A cutting-edge AI company is seeking experienced quantitative professionals to evaluate AI-generated work and help advance AI development... ...to the development of AI systems while influencing their ability... ...to help shape the future of AI models! #J-18808-Ljbffr...Remote jobHourly pay- A leading AI development company is seeking experienced quantitative professionals for remote work evaluating AI-generated quantitative analysis. Ideal candidates will have a robust... ...technical feedback to enhance AI systems. Join us to shape the future of analytics...Remote job
$40 per hour
A leading AI development company is seeking experienced quantitative... ...for a remote role focused on evaluating AI-generated analytics. You'... ...in statistics, predictive modeling, and data analysis while... ...to shaping the future of AI systems. #J-18808-Ljbffr DataAnnotationRemote jobHourly payFlexible hours$40 per hour
A cybersecurity technology company seeks experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. Candidates should have over 2 years of practical cybersecurity experience in areas like penetration testing and incident...Remote jobHourly payFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Systems Engineer - AI Model Evaluator. Be the first to apply!
Related searches
- application system engineer Remote
- system engineer remote Remote
- senior staff systems engineer Remote
- data systems engineer Remote
- microsoft systems engineer Remote
- active directory systems engineer Remote
- mission system engineer Remote
- lead system engineer Remote
- director systems engineering Remote
- senior windows systems engineer Remote