iOS Engineer - AI Model Evaluator
$85 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: iOS Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex engineering tasks.
- Review model-generated mobile application code for correctness, quality, maintainability, and performance.
- Identify bugs, edge cases, and failure modes in model outputs.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic mobile engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional iOS engineering experience.
- Experience building and maintaining production iOS applications using Swift and modern iOS frameworks .
- Regular use of AI coding agents such as Cursor , Claude Code , Codex , Windsurf , Gemini CLI , or similar tools.
- Ability to evaluate model-generated mobile implementations and architectural decisions.
Preferred
- Experience shipping production mobile applications.
Compensation & Legal
- $400 per accepted task
- Typical tasks take approximately 2–3 hours after ramp-up.
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the iOS Engineer - AI Model Evaluator in San Francisco, CA vacancy
$50 - $75 per hour
A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in...SuggestedHourly payContract work$85 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations...SuggestedContract workSummer workRemote work$218.5k - $288k
...Scientist specializing in Small Language Models and AI Training, you will lead research and... .... You will work closely with research, engineering, and product teams to advance model training... ...language models.Design, implement, and evaluate model training experiments to improve...SuggestedWork at officeFlexible hours3 days per week$176.6k - $239k
...Solutions Architect, you will partner some of the world’s leading AI model providers companies, AWS Sales, and several other AWS teams to... ...areas (e.g. software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics)...SuggestedLocal areaWorldwideFlexible hours- ...critical inference for the world's most dynamic AI companies, like Cursor, Notion,... ...the frontier of AI to bring cutting-edge models into production. We're growing quickly and... ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE...SuggestedFull timeFlexible hours
Baseten
San Francisco, CA1 day ago - ...We are rebuilding biotech for the AI era. When a breakthrough is delayed, the world... ...structured data, and run AI agents and models directly in their workflows. Over 200,000... ...-saving therapeutics. As a full-stack engineer on the team, you’ll focus on building the...Full timeWork at officeLocal areaMonday to FridayShift work
Benchling
San Francisco, CA1 day ago - ...About the Team We’re hiring software engineers to make OpenAI’s Model Performance teams more productive. These teams work on the systems, tooling,... ...with forward progress About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that...Full time
OpenAI
San Francisco, CA1 day ago - ...enterprise and developers alike to use and access our start-of-the-art AI models, allowing them to do things that they’ve never been able to... ...via model inference. About the Role We are looking for an engineer who wants to take the world's largest and most capable AI...Full time
OpenAI
San Francisco, CA1 day ago $85 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Commitment: 40 hours/week Role Responsibilities Evaluate the quality of legal knowledge work tasks and AI model outputs . Identify missing behaviors and thin...Hourly payWeekly payContract workFor contractorsSummer workMercor
San Francisco, CA3 days ago$139k - $257.55k
The OpportunityWe’re looking for an iOS Engineer with strong programming fundamentals and keen attention to detail to help shape our flagship... ...people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.Our 30,000+ employees worldwide are...Full timeTemporary workLocal areaWorldwide- ...Member of Technical Staff, Model Efficiency Who are we? Our mission is to scale intelligence... ...and enterprises who are building AI systems to power magical experiences like... .... Cohere is a team of researchers, engineers, designers, and more, who are passionate...Full timeWork at officeRemote workFlexible hours
Cohere
San Francisco, CA1 day ago $168.1k - $227.4k
...develops frameworks and tools that empower engineering teams across Twitch to build compelling... ...leverages React in WebViews alongside native iOS capabilities. You'll work on high-impact... ...bar across teamsExperience leveraging AI-powered development tools (such as Claude...Flexible hours- Cincinnatus LLC is placing finance SMEs at a leading AI lab to critically evaluate AI model outputs for financial tasks. The role focuses on rigorous, rubric-based assessment of model performance and constructing finance-focused evaluation frameworks. Candidates should...Weekday work
- Obsidian is looking for expert Evaluators in Finance operations/audit support to review AI-generated work products for accuracy and quality. This remote hourly position requires a minimum of 5 years in finance and fluency in English. Your role will involve evaluating outputs...Remote jobHourly payWork at office
- Synthires is offering a part-time role for PhD-level Chemistry experts to contribute to AI safety and evaluation projects. The work involves applying scientific expertise to understand and improve how AI systems handle specialized chemistry topics, with training provided...Remote jobPart time
- Synthires is seeking a PhD-level expert to contribute to advanced AI research and evaluation projects in San Francisco. The role centers on applying deep domain knowledge to design problems, evaluate AI responses, and craft high-quality reference solutions that push the...Part time
- Obsidian is seeking a Spanish Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project. You will handle transcription, annotation... ...to help train and benchmark advanced language models. The ideal candidate should have strong writing skills...Part time10 hours per week
- Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly position requires deep subject-matter expertise and professional fluency in English to provide structured...Hourly payWork at officeRemote work
- Welo Data is seeking Data Labeling Associates in California to evaluate AI outputs and ensure cultural context and safety in Arabic datasets. This role requires professional-level proficiency in Portuguese (Brazil), a bachelor's degree, and at least 2 years of experience...
$172.43k - $230.95k
...intelligence. As the only vertically integrated AI infrastructure company built from the... ....About This Role:The Senior Software Engineer for the AI Model Lifecycle team will play a crucial... ...management: versioning, lineage, evaluation, and reproducible fine-tuning at scale...Temporary work- Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations. Applicants must...Remote jobWork at office
$166k - $225k
...building and running the world's best data and AI infrastructure platform so our customers... ...to improve their business. Databricks’ Model Serving product provides enterprises with... ...strong SLAs and cost efficiency.As a Senior Engineer, you’ll play a critical role in shaping...Local areaWorldwide$80 - $120 per hour
Mercor is seeking a User/Customer Research and Feedback Synthesis Evaluator to evaluate AI-generated artifacts using specific quality rubrics. The role demands deep subject-matter expertise in user research and involves providing feedback to improve AI performance. The...Remote jobContract workWork at officeFlexible hours- ...artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Model Architectures , you will be a core contributor to Zyphra’s AI Architecture Research Team. This will involve designing and rigorously testing novel model...Work at officeRelocation package
Zyphra
San Francisco, CAmore than 2 months ago $325k
A leading AI research company in San Francisco seeks an engineer to optimize their powerful AI models for high-volume production environments. The ideal candidate has over 5 years of software engineering experience, strong familiarity with ML architectures, and experience...$349k - $431k
...states. The mission of the Waymo AI Foundations team is to develop... ...demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation. In this hybrid role, you... ...help lead a team of research engineers to build the data flywheel to...Full timeRemote workWaymo
San Francisco, CA2 days ago$192k - $260k
...building and running the world's best data and AI infrastructure platform so our customers... ...to improve their business. Foundation Model Serving is the API Product for hosting... ...experience is necessary. We’re looking for engineers who have owned high scale operational...Local areaWorldwide$144k - $164k
...America, Richmond, Virginia Manager, Product Management, Gen AI Model Gateway At Capital One, we’re changing banking for good. We were... ...agile delivery, business analysis, data science, or software engineering. Preferred Qualifications: Bachelor’s Degree in Computer Science...Full timePart timeLocal area- Accenture is looking for a strategy and design professional to lead enterprise operating model initiatives in the United States. You will partner with boards and C-suite leaders to co-create future ways of working and to guide end-to-end transformation programs. The role...
$57.78 - $67.78 per hour
job summary: We are looking to hire a talented Sr iOS Engineer to design, build, and maintain the next generation of iOS applications. Your... ...for the latest Apple mobile devices, while leveraging AI-powered engineering tools such as GitHub Copilot, Prompt Engineering...Hourly payContract workTemporary workWork experience placementLocal areaSan Francisco, CA23 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to iOS Engineer - AI Model Evaluator. Be the first to apply!
Related searches
- ios developer San Francisco, CA
- senior ios developer San Francisco, CA
- remote ios developer San Francisco, CA
- senior ios engineer San Francisco, CA
- work from home web search evaluator San Francisco, CA
- evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- education evaluator San Francisco, CA
- social media evaluator San Francisco, CA