AI UX Evaluation Architect
Obsidian
Mercor is partnering with a leading AI research organization to engage experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design work. You will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications. Role focuses on designing criteria, scoring samples, and providing evidence-based, reproducible judgments #J-18808-Ljbffr Obsidian
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI UX Evaluation Architect in New York, NY vacancy
$160k - $210k
...Vista Equity Partners is seeking a hands-on UI/UX Architect to design and ship the front-end experiences that bring agentic AI products to life across our 90+ portfolio... ...companies and Vista leadership. Identify and evaluate emerging front-end frameworks, design tooling...Suggested$20 per hour
Feedinkoo is looking for a Web Developer/Designer to enhance AI models by evaluating design work, including interfaces and user experiences. This role involves reviewing AI‑generated visuals and providing feedback to improve users' experience with AI tools. Working remotely...SuggestedRemote job$196k - $230k
Who We AreNotion is the collaborative AI workspace where teams and agents think together. We're building one place... ...’s work.About the Role:We’re seeking an experienced UX Researcher to define and scale how we evaluate Notion’s AI-powered experiences—focusing on what “good...SuggestedLocal areaShift work- ...Job Title: UX Professional (Architect/Designer) Work Location: Evansville, IN; Baltimore, MD; Wilmington, DE; Charlotte, NC; Irving, TX (Hybrid... ...criteria. ~ Demonstrated experience leveraging AI-powered tools (e.g., generative AI, research synthesis tools...SuggestedLong term contract
Openkyber
New York, NY4 days ago - Mercor is seeking experienced UI/UX and product designers to lead a project evaluating how AI systems perform real-world digital product design tasks. You will define what excellent work looks like, designing task-specific grading criteria and providing rigorous written...Suggested
- ...Assistant team to shape user experiences across products. You will collaborate with cross-functional teams to design inclusive, accessible AI-driven conversational interfaces and navigate complex problems to align user needs with business goals. You will drive innovation in...
$196k - $230k
Who We Are Notion is the collaborative AI workspace where teams and agents think together. We’re building one place... ...’s work. About The Role We’re seeking an experienced UX Researcher to define and scale how we evaluate Notion’s AI‑powered experiences—focusing on what “good...Local areaShift work$196k - $230k
Who We Are Notion is the collaborative AI workspace where teams and agents think together. We're building one place... ...s work. About the Role: We’re seeking an experienced UX Researcher to define and scale how we evaluate Notion’s AI-powered experiences—focusing on what “good...Local areaShift work- Notion is looking for an experienced UX Researcher in New York City to define and create evaluation frameworks for AI products. The role involves translating user insights into actionable guidelines and collaborating with cross-functional teams to improve product experiences...
$196k - $230k
Notion is seeking an experienced UX Researcher based in either San Francisco or New York City. This role focuses on evaluating AI-powered experiences, ensuring quality through defined evaluation criteria and user insights. The successful candidate will work closely with...- ...prototyping. • Proven ability to collaborate with UX designers, Product Owners, and technical... .... • Experience conducting accessibility evaluations and ensuring service designs meet or... ...(e.g., WCAG, ADA compliance), utilizing AI-assisted tools to automate accessibility audits...
3B Staffing LLC
New York, NY11 hours ago - ...Navan is building the next generation of travel and expense technology. We craft a Swift-first iOS app with AI-driven features and rich conversational UX. You will help define interactions, performance, and privacy while shipping production-grade code on iOS. You’ll...
Navan
New York, NY10 hours ago $107.5k - $188.4k
Information Security Architect - AI Risk ManagementJob OverviewWe are seeking an Information Security Architect specializing in AI risk management... ...- secure deployment and governance practices.AWS Bedrock - evaluation and integration of models such as Anthropic Claude.Google...Full timeWork at office$106.9k - $147k
...our caring communityThe Senior Application Architect designs and develops IT applications... ...situations or data requires an in-depth evaluation of variable factors.The Senior Application... ...least 3years project experience working with AI, cloud platforms and HR platform SaaS...Full timeTemporary workFor contractorsApprenticeshipWork at officeRemote workWork from homeHome office$64 per hour
...0 - $64/hour Location: Remote Commitment: 10-40 hrs/week Role Responsibilities Evaluate, review, and refine design interview content focusing on visual and UX/UI elements Assess AI-generated materials for quality, usability, and adherence to modern design principles...Remote jobContract work$1,000 per month
...company. We are building a focused in-house UX/UI design capability and this is a... ...leveraging their stakeholder research, experience evaluation, and insights infrastructure to answer the... ...to thrive in it. Discovery is the moat. AI makes generation cheap. The bottleneck is...Full timeTemporary workPart timeSeasonal workWork at officeLocal areaRemote workWorldwideFlexible hours$60 - $80 per hour
Graphic & UX/UI Designer Talent Network is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling...Remote jobFor contractors10 hours per week$170k - $270k
...established FinTech client is a global data and AI platform empowering investment... ...OCTO) is seeking a Senior Staff Software Architect who combines deep technical expertise with... ..., security, and business teams. You will evaluate emerging technologies, identify architectural...Work at officeRemote work2 days per week3 days per week- ...SummaryWe are seeking an experienced Software Architect to define and drive the technical... ...and high-availability system architectures.Evaluate business requirements and translate them... ...ELK Stack, Datadog, Splunk).Knowledge of AI/ML integrations and modern software engineering...
Ova Technologies
New York, NY3 days ago $175k - $205k
...an impact?West Monroe is seeking a Data Architect, Google Cloud Platform (GCP) to design and... ...migrating data workloads to GCP.Leverage AI tools to accelerate analysis, synthesize... ...for clients, exercising sound judgment in evaluating outputs.Apply AI technologies (e.g., generative...Local areaImmediate startFlexible hours$170k - $200k
...modern cloud-based data capabilities and AI-driven initiatives to enhance their products... ...seeking a strategic and hands-on Data Architect to design and implement scalable, secure,... ...process, including sourcing, screening, and evaluating candidates. AI helps assess applications...Permanent employmentRemote work$168.5k - $206k
...Information Job Title Principal Data Architect Job ID 108701 Work Areas... ...cloud and data architectures, and integrate AI to enable scalable end-to-end digital transformations... ...validating data architecture proposals, evaluating options, and providing delivery assurance...Permanent employmentFull timeWork at officeLocal area- ...technology have finally made it possible for AI to impact clinical care in a meaningful... ...with traceability to source systems.Evaluate completeness of source system data models... ..., MPP, NoSQL) and have experience architecting solutions across multiple technologies.You...Full time
$175k - $205.9k
Are you ready to make an impact?As a Data Architect at West Monroe, you will lead the design,... ...on time and within scope.Technology Evaluation: Stay ahead of emerging technologies and... ...by identifying opportunities to leverage AI, machine learning, and advanced analytics...Work at officeLocal areaImmediate startFlexible hours- ...technology have finally made it possible for AI to impact clinical care in a meaningful... ...ecosystem. You will be responsible for architecting data environments that serve massive... ...fabric that supports real-time clinical evaluation at an enterprise scale.What You’ll DoMulti...Full timeRemote work
$30 - $60 per hour
...designer who thrives at the intersection of UX, visual design, behavioral psychology, and... ...experimentation mindset and embraces AI-powered design tools to accelerate ideation... ...process, including sourcing, screening, and evaluating candidates. AI helps assess applications and...Contract workTemporary workRemote work$180.4k - $244k
...everyday life. We are hiring a Principal UX Designer to define what it feels like to live... ...is iterative and demo-led: build fast, evaluate honestly, and let each round of feedback sharpen... ...(voice assistants, dialogue systems, AI companions) - Experience with character design...Flexible hours- ...traditional enterprise database engineering and the emerging Gen AI revolution — building next-generation, AI-powered data solutions... ..., Oracle AI Vector Search) for semantic search capabilities Evaluate and adopt AI/ML model serving patterns (batch vs. real-time inference...
Compunnel
New York, NY12 hours ago - ...an energetic and passionate Senior Data Architect to design and execute our company’s modern... ...cutting-edge technologies like AWS, APIs, and AI. What You’ll Do: Design scalable and... ...Experience in designing, deploying, and evaluating tools, frameworks, and patterns for scalable...Local area3 days per week
$146.38k - $217k
...opportunity to join our team as a Software Architect – Education IT & Innovation. This role... ...design decisions across cloud‑native and AI‑enabled platforms. The ideal candidate brings... ...institutional strategy and standards. Evaluate and recommend technologies, frameworks,...NYU Grossman School of Medicine
New York, NY10 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI UX Evaluation Architect. Be the first to apply!
