Systems Engineer - AI Model Evaluator - AI Trainer [Remote]
$85 per hourMercor
Miami, FL
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Systems Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex engineering tasks.
- Review model-generated code, architecture decisions, and systems implementations.
- Identify bugs, edge cases, performance bottlenecks, and failure modes.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic systems engineering scenarios.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 2+ years of professional systems engineering experience.
- Experience with distributed systems , networking , operating systems , storage systems , infrastructure software , or database internals .
- Regular use of AI coding agents such as Cursor , Claude Code , Codex , Windsurf , Gemini CLI , or similar tools.
- Ability to evaluate model-generated systems designs and implementations.
Preferred
- Experience building highly scalable and performance-critical systems.
Compensation & Legal
- $400 per accepted task
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Systems Engineer - AI Model Evaluator - AI Trainer [Remote] in Miami, FL vacancy
$50 - $60 per hour
...DataAnnotation is committed to creating high-quality AI. Join our team to help train the next... ...new area – teaching AI Assistant models to be a more useful tool for finance professionals... ...diverse and complex problems and evaluate their outputs Evaluate the quality...SuggestedHourly payContract workWork experience placementRemote workFlexible hoursData Annotation
Miami Beach, FLmore than 2 months ago$50 - $60 per hour
...DataAnnotation is committed to creating high-quality AI. Enjoy the flexibility of remote work and... ...new area – teaching AI Assistant models to be a more useful tool for finance... ...chatbots diverse and complex problems and evaluate their outputs Evaluate the quality produced...SuggestedHourly payContract workFor contractorsWork experience placementRemote workData Annotation
Richmond Heights, FLmore than 2 months ago$50 - $60 per hour
...DataAnnotation is committed to creating high-quality AI. Enjoy the flexibility of remote work and... ...new area – teaching AI Assistant models to be a more useful tool for finance... ...chatbots diverse and complex problems and evaluate their outputs Evaluate the quality produced...SuggestedHourly payContract workFor contractorsWork experience placementRemote workData Annotation
Crossings, FLmore than 2 months ago$40 per hour
...Job Description Job Description AI Trainer - Physics Specialist (Remote Advisory) About... ...scientific paper. Improving cutting-edge AI models Why Prolific is a great platform to... ...more accurate, nuanced, and aligned AI systems. We believe that the next leap in AI...SuggestedRemote jobWork from homeFlexible hoursProlific Academic Ltd
Miami, FL26 days ago$124k - $280k
...Competency: Data, Analytics & AI Industry/Sector: Health... ...in data and analytics engineering focus on leveraging advanced... ...and optimising algorithms, models, and systems to enable intelligent decision... ...closely with team members. We evaluate these factors thoughtfully to...SuggestedFull timeH1bPwC
Miami, FL2 days ago- YO IT Consulting is seeking an Italian Data Trainer for a remote position focused on evaluating AI-generated content. The role involves ensuring safety and quality in AI systems through detailed analysis and structured feedback. Candidates should possess a bachelor's degree...Remote jobFor contractors
- ...Environmental Engineering - AI Data Trainer About the Role We're partnering... ...technically rigorous AI models - and we need environmental... ...shape the reliability of AI systems used by engineers, researchers... ...AI Outputs - Critically evaluate AI-generated remediation plans...Hourly payOngoing contractContract workFreelanceRemote workWorldwideFlexible hours
Alignerr
Miami, FL2 days ago - Alignerr is seeking a Business Administration (MBA) — AI Data Trainer to impact how AI advises corporate leaders. This fully remote and flexible position allows you to work independently on significant tasks. The ideal candidate will hold an MBA and have expertise in core...Remote jobContract workFreelanceFlexible hours
$142.6k - $261.5k
...Using our product-driven, AI-centric approach, we... ...designers, and software engineers enable our clients to... ...methods, techniques, and evaluation criteria for obtaining... ...practices. Knowledgeable in system development lifecycle... ...leader-enabled hybrid model. Our expectation is for...Summer holidayFlexible hoursEY
Miami, FL1 day ago$40 per hour
AI Trainer - Materials Science Specialists (Remote Advisory) We are seeking AI Trainers - Materials Science Specialists to join our expert... ...graphical abstract doesn't accurately represent the scientific paper. Improving cutting‑edge AI models. #J-18808-Ljbffr ProlificRemote job$100 - $130 per hour
...technical talent with leading AI research labs.... ...Dorsey.Position: Performance Engineer ExpertType: ContractCompensation... ...engineering teams to improve AI model performance in systems-level optimization,... ...performance engineering problems.Evaluate performance engineering tasks...Summer workWeekday work$40 per hour
A leading AI research organization is seeking AI Trainers specializing in Materials Science for remote advisory roles. Candidates should possess a Masters... ...reviewing scientific papers for accuracy and enhancing AI models. Participants can earn $40+/hr for tasks requiring...Remote job$124k - $280k
...Competency: Data, Analytics & AI Industry/Sector: Not... ...people in data and analytics engineering focus on leveraging advanced... ...and optimising algorithms, models, and systems to enable intelligent decision... ...with team members. We evaluate these factors thoughtfully to...Full timeH1bPwC
Miami, FL5 days ago$99k - $232k
...Competency: Data, Analytics & AI Industry/Sector: Not... ...people in data and analytics engineering focus on leveraging advanced... ...and optimising algorithms, models, and systems to enable intelligent decision... ...with team members. We evaluate these factors thoughtfully to...Full timeH1bPwC
Miami, FL4 days ago- A global consulting firm is seeking a Manager in Application Design and Development to lead delivery processes for software projects. This role requires a blend of technical and business skills, including experience with Java or C#. The candidate should possess strong problem...
$35 - $120 per hour
...technical talent with leading AI research labs.... ...Eval Author — Software Engineer Type: Contract... ...agent trajectories and model outputs. Improve task... ...structured review. Evaluate the accuracy and depth... ...~ Strong code quality, systems design, debugging, and...Contract workSummer workRemote workMercor
Miami, FL5 days ago- ...grow ourAI Enablement team, andwe'rehiring AI Coaches to serve as the firm's front-... ...career growth. This is not a software engineering role.It'salso not a pure consulting role... ...on AI topics Background in vendor evaluation, tool selection, or pilot program design...Remote workWork from homeWork visa
EisnerAmper
Miami, FL4 days ago - Alignerr is seeking a Chemistry Masters — AI Data Trainer to work on advanced chemistry problems influencing AI models. This fully remote role allows flexible scheduling, aiming to enhance AI’s understanding through expert-designed challenges. The ideal candidate will...Remote jobFlexible hours
- ...analytics, machine learning models, and data products that deliver... ...-functionally with product, engineering, marketing, and business leaders... ..., and revenue outcomes Evaluate new data sources and data collection... ..., Analytics, Information Systems, or a related quantitative...Full timeRemote work
Trax USA Corp
Miami, FL14 days ago - ...Qualification: Master’s Degree in Computer Science, Information Systems, Electrical Engineering, Mathematics, or a related quantitative field. What... ...What This Role Requires: ~1-4 years of data analyst/ML/AI engineering work experience after your degree. ~ Must...Full timeTemporary workWork experience placementWork at officeRelocationRelocation package
Tech Consulting
Miami, FL25 days ago - ...machine learning or statistical modeling techniques (e.g., regression,... ...data preprocessing, feature engineering, and preparing structured/... ...advanced analysis. Ability to evaluate model performance, conduct... .... Ability to identify system enhancements, capability gaps...Immediate start
GRVTY
Doral, FL26 days ago - ...time off (PTO), and a 401K with employer matching to secure your financial future. As we push forward in the rapidly evolving field of AI, XTS is committed to providing employees with tools and opportunities to stay ahead. We are proud to offer a GeoAI scholarship to...Immediate startShift work
Xcellent Technology Solutions
Doral, FL16 days ago $90 per hour
...outcomes, combining advanced modeling, experimentation, optimization... ...production models, decision engines, experiments, or GenAI workflows... ...production model health from AI Engineering ownership of... ...embeddings, prompt libraries, evaluation harnesses, and safety tests,...Contract workVisa sponsorshipInfonet Consulting Group, Inc.
Miami, FLa month ago- Job Description Job Description Join the Nalley Consulting team at Southcom HQ. Position: Data Governance & Metadata Scientist LCAT: Mid Location: SOUTHCOM HQ, Doral, FL / Off-site Office: U.S. SOUTHERN COMMAND J2 Required clearance: No Required...Temporary workWork at officeFlexible hours
Nalley Consulting
Miami, FL19 days ago - A leading global consulting firm in Miami is seeking a Senior AI Native Engineer to research and implement scalable AI systems that meet business requirements. You will enhance data pipelines, monitor learning processes, and collaborate with clients. The ideal candidate...
- ...fast feedback loops, close proximity to trading, and a strong emphasis on measurable impact rather than theoretical modelling. The Role: Evaluate and analyse a wide range of alternative datasets (transactional, behavioural, geospatial, web-derived, etc.) to identify...Contract workRemote work
Thurn Partners
Miami, FL2 days ago - ...will support the development of AI, machine learning, and... ...refine predictive and analytical models for internal stakeholders using... ...using sound analytical and engineering practices. Collaborate with... ..., statistics, and model evaluation techniques. ~ Experience contributing...Live inWork at officeLocal area
Lennar
Miami, FL1 day ago - ...is seeking a Data Scientist / Engineer to support the design,... ...operational deployment of scalable, AI-enabled data solutions within... ...a hybrid of statistical modeling fluency and hands-on software... ...model testing, and performance evaluation techniques. Experience with...
Agile Defense
Doral, FL3 days ago $150k - $224k
...data science, statistics, AI and machine learning to... ...You will work closely with engineering and product or marketing... ...identify opportunities, evaluate initiatives, and develop models and analyses that inform... ...with the criminal legal system. We are committed to providing...Work experience placementLocal areaIndeed
Miami, FL2 days ago$102.7k - $128.4k
...scalability and maintainability. Collaborate with data and software engineers to support data science solutions through the entire product... ...data wrangling, exploratory analysis, hypothesis testing, modeling, rapid prototyping, business validation and testing, and...Franchise World Headquarters, LLC
Miami, FL3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Systems Engineer - AI Model Evaluator - AI Trainer [Remote]. Be the first to apply!
Related searches
- systems engineer Miami, FL
- senior linux systems engineer Miami, FL
- healthcare systems engineer Miami, FL
- senior staff systems engineer Miami, FL
- advanced systems engineer Miami, FL
- senior windows systems engineer Miami, FL
- computer system validation engineer Miami, FL
- application system engineer Miami, FL
- system performance engineer Miami, FL
- operations support system engineer Miami, FL