Architect for AI Model Evaluation
$75 per hourSaidGig
Join a project focused on evaluating AI models in the architecture domain, specifically in visual document understanding and instruction-following. This role involves authoring complex, grounded tasks that include a clear ground-truth output and an objective rubric. Key Responsibilities
- Develop and author intricate tasks for AI evaluation.
- Ensure tasks have a clear ground-truth output.
- Create an objective rubric for assessment.
- Expertise in architecture and building design.
- Experience with AI model evaluation is a plus.
- Remote work opportunity.
- Approximately 15, 20 hours per week.
- Available to candidates in the US and Canada.
- Hourly rate of $75.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Architect for AI Model Evaluation in Canada vacancy
$50 - $70 per hour
...Role Overview Help improve frontier AI models by evaluating the quality of real-world professional materials and AI-generated work. You will apply careful judgment across documents, presentations, spreadsheets, and other written content, providing feedback that helps...SuggestedHourly payRemote workSaidGig
Canada5 days ago$80 - $110 per hour
...Role Overview Apply your tax advisory expertise to improve next-generation AI systems through practical, high-quality tax preparation guidance, evaluations, and feedback. This part-time contractor role supports a customer project focused on personal and small-business...SuggestedHourly payPart timeFor contractorsRemote workSaidGig
Canada7 days ago$100 per hour
...Role Overview Apply deep domain knowledge to help train and evaluate next-generation AI systems by reviewing, refining, annotating, and validating... ...focuses on ensuring accuracy, clarity, and relevance of model outputs through rubric-based evaluation, prompt refinement,...SuggestedRemote jobHourly payContract workPart timeFor contractorsSaidGig
Canada4 days ago$100 per hour
...Apply deep finance expertise to improve AI-driven financial applications by reviewing... ...analytical rigor, and you will help shape how models learn and perform in real-world finance... ...standards. Develop, refine, and evaluate prompts related to financial analysis, valuation...SuggestedHourly payPart timeFor contractorsRemote workSaidGig
Canada16 days ago$40 - $100 per hour
...Role Overview Produce, refine, and validate parametric CAD models in FreeCAD to build high-quality datasets that train and evaluate next-generation AI systems. This role focuses on geometric accuracy, engineering best practices, and reproducible documentation to support...SuggestedHourly payFor contractorsRemote workSaidGig
Canada21 days ago$99.1k - $132.1k
...on experience with ServiceNow AI capabilities such as Now Assist... ...: knowledge of AI governance, model oversight, responsible AI... ...teams, engineers, and enterprise architects to turn business needs into technical... ...best practices. We evaluate emerging technologies and identify...Full timeWork at officeRemote workFlexible hours2 days per weekMCKESSON
Canada4 days ago$100 per hour
...Help improve advanced AI systems by applying practical software engineering... ...the technical content, prompts, evaluations, and training materials that shape how models reason and perform. Role... ...Engineering Manager, or Solutions Architect. Experience authoring or reviewing...Hourly payPart timeFor contractorsRemote workSaidGig
Canada16 days ago- ...biochemistry expertise to shape how next-generation AI systems understand and reason about life... ...content. In this contractor role you will evaluate biochemical data, refine use cases and... ...-quality domain feedback that improves model performance. No prior AI experience is...Hourly payFor contractorsRemote work
SaidGig
Canada24 days ago $170 - $190 per hour
...of safe, accurate, and explainable medical AI decision-support tools. This is an in-... ...clinical text, EHR data, and case notes for AI model training, identifying medical entities,... ...definitions to improve clinical coverage. Evaluate AI-generated recommendations and clinical...Hourly paySaidGig
Canadamore than 2 months ago$100 per hour
...Role Overview Help train and evaluate next-generation AI by creating and assessing senior-level marketing deliverables used to teach frontier models how to produce professional business documents. You will design realistic marketing tasks, author gold-standard materials...Remote jobHourly payFor contractorsSaidGig
Canada4 days ago$100 per hour
...Apply deep financial domain expertise to improve AI-driven financial applications by reviewing, annotating, and refining model outputs and prompts. You will shape how next-... ..., and relevance. Develop, refine, and evaluate prompts related to financial analysis, valuation...Remote jobHourly payPart timeFor contractorsSaidGig
Canada3 days ago$40 - $100 per hour
...Create, edit, and validate parametric FreeCAD models that form high-quality training data for next-generation AI systems, ensuring geometric accuracy, manufacturability... ...uses an AI-assisted recruiter to identify and evaluate qualified experts. Selected applicants will be...Remote jobHourly payFor contractorsSaidGig
Canada4 days ago$20 - $60 per hour
...Overview Help improve how large language models create, understand, and modify Office... ...realistic business scenarios, produce and evaluate complex .xlsx, .docx, and .pptx files, and... ...that guide model improvements. No prior AI experience is required. Key Responsibilities...Remote jobHourly payFor contractorsWork at officeSaidGig
Canada4 days ago$40 - $50 per hour
...Role Overview Apply your linguistics expertise to evaluate large language model outputs and help train next-generation AI systems. You will analyze model-human conversations for linguistic precision, assess adherence to instructions, and deliver clear, actionable feedback...Remote jobHourly payFor contractorsImmediate startSaidGig
Canada4 days ago- ...AI Architect II Google Solutions Line Location: You will have the flexibility to work fully remotely. Insight at a Glance... ...Generative AI solutions, including the use of large language models, model fine-tuning, vector embeddings, and AI application frameworks...Work experience placementLocal areaImmediate startRemote work
Insight
Canada14 days ago $100 per hour
...Help train and refine advanced AI systems by applying deep software engineering expertise to evaluate, edit, and produce high‑... ...role focuses on improving how models learn and reason by providing... ...Engineering Manager, or Solutions Architect. Proven track record authoring...Remote jobHourly payContract workPart timeFor contractorsSaidGig
Canada3 days ago$170 - $190 per hour
...supports the development of safe, accurate, and explainable medical AI decision-support tools. This is an on-site, hands-on role based in San Francisco contributing to dataset curation, model evaluation, and annotation guidance. Key Responsibilities Clinical Data...Hourly payShift workSaidGig
Canada4 days ago- Change.org is searching for an AI Architect . You will report to our CTO. As a key member of our Engineering team, you’ll lead through technical authority, hands-on work, and influence — not through a reporting line. You’ll operate as the org-wide technical owner for AI...Full time
Change.org
Canada15 days ago $15 - $80 per hour
...Role Overview Apply your hand anatomy expertise to annotate image and video data that helps train advanced AI systems. This remote contractor role focuses on precise, protocol-driven labeling of hand and finger landmarks across a wide range of poses, orientations, perspectives...Remote jobHourly payFor contractorsSaidGig
Canada4 days ago$30 - $80 per hour
...Role Overview Label and analyze diverse data to produce high-quality training datasets that directly influence how next-generation AI systems learn, reason, and perform. As a generalist annotator, you will apply domain knowledge, critical thinking, and clear communication...Remote jobHourly payFor contractorsFlexible hoursSaidGig
Canada3 days ago$105.09k - $175.16k
...now. We are currently seeking a Saviynt Architect -Remote to join our team in Halifax, Nova... ...Software as a Service (SaaS) delivery models. • Excellent customer service and communication... .... We are one of the world's leading AI and digital infrastructure providers,...Work at officeImmediate startRemote workFlexible hoursNTT DATA, Inc.
Canada14 days ago- ...We are looking for an experienced AWS Architect to design, develop, and optimize scalable... ...intelligence into customer and agent workflows with AI/ML teams Configure and manage IAM,... ...technologies (AWS-native & open-source models) ~ Strong understanding of IAM, cloud...Full timeInternshipRemote workRelocation
Miratech
Canadamore than 2 months ago $114.75k - $160.7k
...organization, apply now. We are currently seeking a SAP SD/LE/TM Lead / Architect to join our team in Burnaby, British Columbia (CA-BC), Canada (... ...responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched...Work at officeRemote workFlexible hours$50 per hour
...high-quality Canadian French voice samples that help train and evaluate advanced text-to-speech systems. This opportunity is suited to experienced... ...French. Your recordings will be used only for an internal CX AI Agent. They will not be sold, licensed, or reused for any other...Hourly payRemote work10 hours per weekSaidGig
Canadamore than 2 months ago- ...assurance are entering a new era. Advances in AI are transforming how firms prepare for engagements, evaluate evidence, and deliver assurance. Many of the workflows... ...the profession requires. As an Agent Architect , you’ll join a small, specialized team working...Full timeImmediate start
Fieldguide
Canada6 days ago $30 - $65 per hour
...Help improve advanced AI language capabilities through authentic, high-quality Egyptian Arabic voice work. You will record and refine spoken material that helps next-generation AI systems learn from natural pronunciation, conversational delivery, and culturally accurate...Hourly payFor contractorsRemote workSaidGig
Canada24 days ago$88.8k - $133.2k
...• Design, develop, and implement scalable backend and full stack solutions using Python and React. • Leverage Generative AI tools, including coding assistants (Copilot, Agent mode, Skills), to accelerate development and improve solution quality. • Translate...Work experience placementWork at officeRemote workFlexible hours$50 per hour
...Role Overview Provide high-quality Canadian French voice recordings to train and evaluate a next-generation text-to-speech system for an internal CX AI Agent. You will deliver natural, expressive, and consistent performances, including a neutral international French...Hourly payRemote work10 hours per weekSaidGig
Canada4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Architect for AI Model Evaluation. Be the first to apply!
