Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SMB AI Power User — Competitive Evaluations

$40 - $50 per hour

Agency

MERIDIAL SMB AI Power User — Competitive Evaluations Company Meridial Location Remote Engagement Type Independent Contractor About Meridial Meridial places skilled, remote-first professionals into high-trust, high-precision operational opportunities for leading technology companies. Our teams work as an embedded extension of our clients' own product and operations organizations, holding the same quality bar and the same deadlines. The Opportunity As an SMB AI Power User on the Competitive Evaluations team, you'll help a major consumer technology company find out where its bundled AI assistant subscription falls short of the standalone assistants small businesses already pay for. You are not an AI researcher studying the problem from the outside - you are a working or experienced business owner who already runs on these tools, and your own operations are the test bed. Your day is spent doing what you already do: drafting ad copy, planning content, answering customer messages, researching suppliers, and reconciling numbers. The difference is that you do it across competing assistants, side by side, and document precisely where each one breaks. The failures you surface are the failures real paying subscribers will hit, which is exactly why the seat calls for a genuine operator rather than an evaluator. What You'll Do Run head-to-head prompts and multi-turn workflows across the client's assistant and competing paid assistants, using tasks drawn from your own business operations and marketing. Build and maintain a library of realistic small-business test cases spanning ad creative and copy, organic content planning, customer messaging, competitor research, pricing, scheduling, and light bookkeeping. Identify and document failure modes - wrong answers, unnecessary refusals, weak instruction-following, tone misses, brand-unsafe output, broken formatting, context lost across turns, unusable image or video output. Write clear, reproducible reports: prompt used, model and surface, expected output, actual output, severity, and why the failure matters to a paying business subscriber. Assess the bundled subscription on value terms - what a business owner actually receives versus what a standalone competitor subscription delivers for comparable spend. Stress-test assistant features inside the social and commerce surfaces where business owners meet them, not only the standalone chat product. What We're Looking For Owner or operator of a small or medium business - sole proprietor, founder, or the person running day-to-day operations at a business of roughly 1–200 employees. Daily, habitual use of generative AI tools in that business, for both operations and marketing. Experimental or occasional use is not a fit. Organic presence on Instagram and Facebook for the business, maintained personally: posting, Stories, Reels, comment and message response. Hands-on paid advertising experience on Meta platforms - has personally built, launched, and optimized campaigns with real budget. Based in the United States and authorized to work here. Capacity sufficient to complete deliverables per the agreed scope and timeline, which may include up to 40 hours per week. Exceptional written English - able to describe a failure clearly enough that an engineer can reproduce it without follow-up. Comfortable working independently against a rubric and holding a weekly output cadence. Nice to Have At least one current paid AI subscription (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced, or similar), so competitive comparison rests on actual use. Runs a side business or second venture alongside a primary role - the profile that tends to test AI hardest against limited time. Heavy Instagram user, personally and commercially: fluent in Reels, Stories, trends, and creator tooling. Subscribes to two or more AI assistants simultaneously and holds an informed view on where each one wins. Uses AI beyond chat - automations, agents, API or no-code integrations, custom GPTs or Projects. Prior experience with model evaluation, red teaming, data annotation, QA, or structured user research. Working familiarity with adjacent SMB tooling: Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, Later, or similar. Industry range across the two hires - for example, one services or retail operator alongside one e-commerce or creator-economy operator. Compensation & Contract We offer a pay range of $40-$50 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply. #J-18808-Ljbffr Agency

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the SMB AI Power User — Competitive Evaluations in New York, NY vacancy
  • $40 - $50 per hour

    Meridial is seeking an SMB AI Power User on the Competitive Evaluations team as an independent contractor. You will operate as a business owner using AI tools to test, compare, and document how competing assistants perform for a real paying customer context. You will run... 
    Suggested
    Remote job
    For contractors

    Agency

    New York, NY
    13 hours ago
  • AI Agent Power User is a remote review track for evaluating AI outputs across ai agent power user specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the... 
    Suggested
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  • $262.5k - $299.6k

    Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows) At Capital...  ...bring the transformative power of emerging AI capabilities...  ...Worked datasets with 100m+ users ~ Proven ability to design...  ...One offers a comprehensive, competitive, and inclusive set of... 
    Suggested
    Full time
    Part time
    Work at office
    Local area
    Flexible hours

    Capital One

    New York, NY
    1 day ago
  •  ...Job DescriptionJob Description Job Title AI Evaluation Engineer Location Hybrid / Remote...  ...teams to improve AI system reliability and user experience. Key Responsibilities Design...  ...Statistical analysis Data visualization (Power BI, Tableau, Matplotlib) Git and CI/CD REST... 
    Suggested
    Full time
    Remote work

    Ova Technologies

    New York, NY
    3 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability) At Capital One, we are creating responsible...  ...will help bring the transformative power of emerging AI capabilities to...  ...One offers a comprehensive, competitive, and inclusive set of health, financial... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $229.9k - $262.4k

    AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable...  ...help bring the transformative power of emerging AI capabilities to...  ...One offers a comprehensive, competitive, and inclusive set of health,... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $229.9k - $262.4k

    Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible...  ...help bring the transformative power of emerging AI capabilities to...  ...One offers a comprehensive, competitive, and inclusive set of health,... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $146.8k - $272.6k

     ...for artificial intelligence (AI) model evaluation and benchmarking. You will...  ..., validate them with users, and improve them through iterative...  ...AI-enabled future.Industry Competitive Benefits: We offer...  ...journalism and news.We are powered by the talents of 26,000 employees... 
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    5 days ago
  •  ...knowledge and agentic AI platform. The Senior Data...  ...business impact of AI-powered experiences used across...  ...in relevance, accuracy, user satisfaction, and...  ...experimentation, and AI evaluation, while one-third focuses...  ...offering a comprehensive and competitive mix of pay and benefits... 
    Full time
    Contract work
    Work experience placement
    Local area

    Oak St. Health

    New York, NY
    1 day ago
  • $153k - $376k

     ...AI Applied ScientistSan Francisco, CA • New York...  ...'s products through AI powered featuresCollaborate closely...  ...engineers to transform user feedback into...  ...requirements for AI systemsBuild evaluation systems to measure and...  ..., as well as a competitive package of additional benefits... 
    Minimum wage
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    Figma

    New York, NY
    4 days ago
  • $161.8k - $184.6k

     ...Principal Data Scientist - Ai Foundations, Specialist...  ...A core capability that powers a wide range of use...  ...our data and platform users to drive productivity and...  ...through training, evaluation, validation, and implementationLeverage...  ...a comprehensive, competitive, and inclusive set of... 
    Full time
    Part time
    Immediate start

    Capital One

    New York, NY
    1 day ago
  • $122.5k

     ...or familiarity in using AI coding tools...  ...and the impact on market competition, the impact of intellectual...  ...of financial markets, evaluation of fair merger prices,...  ...to build practical, AI-powered products that reshape how...  ...direct access to real user problems, and strong distribution... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship

    Cornerstone Research

    New York, NY
    5 days ago
  • $44.5k - $71.2k

    Graduate Intern - Power Data Analysis for AI Data Centers Location: CO - Golden Position Type: Intern...  ...development opportunities, and a competitive benefits package designed to support...  ...automated event detector, trained and evaluated on their own labeled data, that... 
    Full time
    Fixed term contract
    Internship
    Local area
    Relocation

    NLR

    New York, NY
    4 days ago
  •  ...Role Title: Competitive Data Scientist Role Type: Contractor Location: Global Fully Remote...  ...data science experience to support an AI training project. Youll develop...  ...verified reference solution and reliable evaluation criteria. Key Responsibilities... 
    Full time
    For contractors
    Remote work
    Flexible hours

    YO AI Labs

    New York, NY
    28 days ago
  • $169k - $250k

     ...code, or iterating with AI. From idea to product,...  ...hiring a Researcher, AI Evaluations to join AI Insights...  ...of quality that reflect user needs, and your findings...  ...performance metrics for AI-powered features Advanced...  ...employees, as well as a competitive package of additional... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    New York, NY
    19 hours ago
  • $80k

     ...Services' company, is looking for a Power BI Developer to support the...  ...translate business needs into scalable, user-friendly reporting solutions. Apply...  ...environment administration. Support evaluation of emerging Power Platform and AI capabilities, including Copilot. Agile... 
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Chenega Corporation

    New York, NY
    2 days ago
  • $70k - $80k

     ...performance and seamless user experiences. Beyond...  ...practices and tools, including AI-assisted solutions....  ...software. Benefits Competitive annual salary ranging from...  ...Works We use an AI-powered matching process to ensure...  ...your personal data to evaluate your candidacy and share... 
    Remote work

    Jobgether

    New York, NY
    1 day ago
  • $160k - $174k

     ...highly motivated Senior AI Engineer to design,...  ...recommendation systems, and AI-powered business workflows....  ...retrieval tuning, and evaluation. AI Engineering & Agentic...  ...production metrics and user feedback. Business...  ...new skills to retain a competitive advantage. Equal... 
    Part time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours

    NAC Voya Services Company

    New York, NY
    2 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high...  ...in improving the quality of search engine results, ensuring users find the most relevant and useful information. Your work... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • $250k - $350k

     ...Udio builds extraordinary AI experiences to empower...  ...of music, metadata and user interactions/feedback....  ...and the music evaluation manager, you will apply...  ...as needed, including a powerful personal TPU pod. Join...  ...Benefits ~ Highly competitive salary and equity ~ Quarterly... 
    Work experience placement
    Flexible hours

    Udio

    New York, NY
    5 days ago
  • $42.69 - $86.68 per hour

     ...business impact, many centered on AI and emerging technologies,...  ...insights and develop powerful machine learning models that...  ...and ETL. Build, train, and evaluate machine learning and deep learning...  ...mindset. Intuit provides a competitive compensation package with a strong... 
    Full time
    Summer work
    Internship
    Summer internship
    Work at office
    Relocation
    Monday to Friday

    Intuit

    New York, NY
    1 day ago
  •  ...role of Senior Director, AI Solution Architect to...  ...new projects by aligning user needs, platform...  ...architecture, including evaluation frameworks and guardrail...  ...exceptional talent. Together, we power the future of finance -...  ...:BNY offers highly competitive compensation, benefits,... 
    Work experience placement
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    2 days ago
  • $214k - $285k

     ...AI Research EngineerHex is an AI-powered platform for modern Data Science and Data Analytics...  ...quality or using LLMs to evaluate agent threads, your job...  ...capabilities to thousands of users, come do it on the best...  ..., Hex proudly offers a competitive total rewards package, including... 
    Full time
    Work at office
    Flexible hours

    HEX

    New York, NY
    4 days ago
  • $170k - $250k

     ...Get AI-powered advice on this job and more exclusive features. Oakwell Hampton...  ...interaction patterns and get them into users hands quickly Create evaluation harnesses, instrument outcomes,...  ...across the stack What is on offer Competitive salary in the range of 165K to 250... 
    Full time
    Work at office
    Monday to Friday

    Oakwell Hampton Group

    New York, NY
    1 day ago
  • $125k - $292k

     ...financial lives. We're hiring AI/ML Engineers across...  ...access to credit, and power the personalized...  ...production — training, evaluation, deployment, monitoring...  ...eligible for bonus(es), competitive equity, and benefits. For...  ...and free. Through our user-friendly tools and intuitive... 
    Full time
    Work at office
    Local area
    Remote work

    Chime

    New York, NY
    5 days ago
  • $110k - $138k

     ..., build and scale intelligent AI, digital, cybersecurity, cloud...  ...company, supports commercial and SMB markets in the U.S. and Canada...  ..., and on how models will be evaluated, optimized for edge deployment...  ...Financial Benefits: Competitive Pay, Profit Sharing, 401k Plan... 
    Full time
    Work experience placement
    Remote work
    Flexible hours
    Shift work

    World Wide Technology

    New York, NY
    5 days ago
  • $244.7k - $279.2k

    Staff AI Engineer - Enterprise Analysis Platform...  ...bring the transformative power of emerging AI...  ...native, at-scale (15,000+ users at destination), enterprise...  ...search, guardrails, model evaluation, experimentation,...  ...offers a comprehensive, competitive, and inclusive set of health... 
    Full time
    Part time
    Local area
    Remote work

    Capital One

    New York, NY
    1 day ago
  • $40k - $60k

     ...seeking an accomplished AI Engineer for a remote,...  ..., and scale actual LLM-powered products, autonomous AI...  ...will empower enterprise users to harness cutting-edge...  ...opportunity offers competitive global remuneration ($4...  ...data science squads while evaluating model outputs, optimizing... 
    Remote job
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Immediate start
    Work from home

    Rochak Digital Private Limited

    New York, NY
    2 days ago
  • $164k - $295k

     ...with the world’s most advanced AI-native platform. We work on...  ...the analytics data systems that power the award-winning Falcon Console...  ...actionable insights on how users interact with our products and...  ...and mental wellness programs  Competitive vacation and holidays for... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    New York, NY
    14 days ago
  •  ...Interactive, the team behind Modo Casino, is seeking an experienced User Acquisition professional in the United States. You will run...  ...paid social, Google Search, and DSPs, owning budgets and leveraging AI tools to test, learn, and optimize performance. With 3+ years in... 

    arbinteractive.com

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SMB AI Power User — Competitive Evaluations. Be the first to apply!