Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SMB AI Power User — Competitive Evaluations

$40 - $50 per hour

Agency

MERIDIAL SMB AI Power User — Competitive Evaluations Company Meridial Location Remote Engagement Type Independent Contractor About Meridial Meridial places skilled, remote-first professionals into high-trust, high-precision operational opportunities for leading technology companies. Our teams work as an embedded extension of our clients' own product and operations organizations, holding the same quality bar and the same deadlines. The Opportunity As an SMB AI Power User on the Competitive Evaluations team, you'll help a major consumer technology company find out where its bundled AI assistant subscription falls short of the standalone assistants small businesses already pay for. You are not an AI researcher studying the problem from the outside - you are a working or experienced business owner who already runs on these tools, and your own operations are the test bed. Your day is spent doing what you already do: drafting ad copy, planning content, answering customer messages, researching suppliers, and reconciling numbers. The difference is that you do it across competing assistants, side by side, and document precisely where each one breaks. The failures you surface are the failures real paying subscribers will hit, which is exactly why the seat calls for a genuine operator rather than an evaluator. What You'll Do Run head-to-head prompts and multi-turn workflows across the client's assistant and competing paid assistants, using tasks drawn from your own business operations and marketing. Build and maintain a library of realistic small-business test cases spanning ad creative and copy, organic content planning, customer messaging, competitor research, pricing, scheduling, and light bookkeeping. Identify and document failure modes - wrong answers, unnecessary refusals, weak instruction-following, tone misses, brand-unsafe output, broken formatting, context lost across turns, unusable image or video output. Write clear, reproducible reports: prompt used, model and surface, expected output, actual output, severity, and why the failure matters to a paying business subscriber. Assess the bundled subscription on value terms - what a business owner actually receives versus what a standalone competitor subscription delivers for comparable spend. Stress-test assistant features inside the social and commerce surfaces where business owners meet them, not only the standalone chat product. What We're Looking For Owner or operator of a small or medium business - sole proprietor, founder, or the person running day-to-day operations at a business of roughly 1–200 employees. Daily, habitual use of generative AI tools in that business, for both operations and marketing. Experimental or occasional use is not a fit. Organic presence on Instagram and Facebook for the business, maintained personally: posting, Stories, Reels, comment and message response. Hands-on paid advertising experience on Meta platforms - has personally built, launched, and optimized campaigns with real budget. Based in the United States and authorized to work here. Capacity sufficient to complete deliverables per the agreed scope and timeline, which may include up to 40 hours per week. Exceptional written English - able to describe a failure clearly enough that an engineer can reproduce it without follow-up. Comfortable working independently against a rubric and holding a weekly output cadence. Nice to Have At least one current paid AI subscription (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced, or similar), so competitive comparison rests on actual use. Runs a side business or second venture alongside a primary role - the profile that tends to test AI hardest against limited time. Heavy Instagram user, personally and commercially: fluent in Reels, Stories, trends, and creator tooling. Subscribes to two or more AI assistants simultaneously and holds an informed view on where each one wins. Uses AI beyond chat - automations, agents, API or no-code integrations, custom GPTs or Projects. Prior experience with model evaluation, red teaming, data annotation, QA, or structured user research. Working familiarity with adjacent SMB tooling: Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, Later, or similar. Industry range across the two hires - for example, one services or retail operator alongside one e-commerce or creator-economy operator. Compensation & Contract We offer a pay range of $40-$50 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply. #J-18808-Ljbffr Agency

Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the SMB AI Power User — Competitive Evaluations in New York, NY vacancy
  •  ...Job Title AI Evaluation Engineer Location Hybrid / Remote Employment...  ...teams to improve AI system reliability and user experience. Key...  ...Statistical analysis Data visualization (Power BI, Tableau, Matplotlib) Git and CI/... 
    Suggested
    Full time
    Remote work

    Ova Technologies

    New York, NY
    1 day ago
  • $197.3k - $225.1k

    AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable...  ...help bring the transformative power of emerging AI capabilities to...  ...One offers a comprehensive, competitive, and inclusive set of health,... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging... 
    Suggested
    Remote job

    AuraOne

    New York, NY
    21 hours ago
  • About the Opportunity A leading AI research organization is seeking advanced LLM power users with strong experience using...  ...tasks. This project focuses on evaluating how well AI systems handle personalized...  ...Candidates who want to be more competitive for this and future... 
    Suggested
    Trial period

    Mercor

    New York, NY
    3 days ago
  • $229.9k - $262.4k

    Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible...  ...help bring the transformative power of emerging AI capabilities to...  ...One offers a comprehensive, competitive, and inclusive set of health,... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  •  ...role of Senior Director, AI Solution Architect to...  ...new projects by aligning user needs, platform...  ...architecture, including evaluation frameworks and guardrail...  ...exceptional talent. Together, we power the future of finance -...  ...:BNY offers highly competitive compensation, benefits,... 
    Work experience placement
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    2 days ago
  • $200k - $250k

     ...Applied AI Engineer, Agents & Evaluation Compensation: $200k–$250k base + equity Location: New York...  ...~ Hands-on experience shipping LLM-powered agents into production. ~ A clear understanding...  ...used by real customers or internal users. ~ The ability to work closely with... 
    Full time
    For contractors

    People In AI

    New York, NY
    4 days ago
  • $148.19k - $198.17k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with agents drive...  ....The RoleSummaryAs an SMB Technical Architect, you are a...  ...best. Together, we’ll bring the power of Agentforce to organizations...  ...help our recruiters assess and evaluate candidates’ resumes and qualifications... 
    Full time

    Salesforce

    New York, NY
    4 days ago
  • $289k

     ..., where we're on a mission to power exceptional service for every...  ...by building products rooted in AI, automation, and intelligent customer...  ...of Excellence.Compensation: Competitive executive package including...  ...may be used to screen or evaluate applications for this position... 
    Full time
    Remote work

    Forethought

    New York, NY
    6 days ago
  • $180k - $250k

     ...The Essential Cloud for AI. Built for pioneers by...  ...infrastructure and services that power the next generation of...  ...ML systems, services, evaluation frameworks, and product...  ..., or other technical users.Familiarity with human-...  ....In addition to a competitive salary, we offer a... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $180k - $275k

     ...Senior / Staff AI Platform Engineer About the...  ...one of the largest AI-powered productivity platforms...  ...world. Millions of users rely on the platform every...  ...frameworks, agent systems, evaluation layers, and platform...  ...75,000 Base Salary ~ Competitive Equity Package ~401(k... 
    Full time
    Flexible hours

    satoriq

    New York, NY
    4 days ago
  • $149k - $350k

     ...code, or iterating with AI. From idea to product,...  ...’s products through AI‑powered features. Collaborate...  ...engineers to transform user feedback into...  ...for AI systems. Build evaluation systems to measure and...  ...employees, as well as a competitive package of additional benefits... 
    Full time
    Temporary work
    Remote work
    Work from home

    SupportFinity

    New York, NY
    2 days ago
  • $30 per hour

     ...partner is looking for an AI Product Owner based in...  ...into actionable user stories, acceptance criteria...  ...technology leadership. Evaluate AI security tools and...  ...2 employment basis. Competitive compensation package...  ...works: We use an AI-powered matching process to ensure... 
    Hourly pay
    Remote work

    jobgether

    New York, NY
    12 hours ago
  •  ...platform architecture, and AI-native tooling. You...  ...business and millions of users. Beyond traditional...  ...planning resources. Competitive compensation and opportunities...  ...: We use an AI-powered matching process to...  ...your personal data to evaluate your candidacy and share... 
    Remote work
    Home office
    Flexible hours

    jobgether

    New York, NY
    3 days ago
  • $167k - $219k

     ...of college students, powering over 1 billion learning...  ...to design and deliver AI-powered learning tools...  ...Quizlet?Massive reach: 60M+ users, 1B+ interactions per...  ...best practices, evaluating what's worth adopting....  ...we expect you to take!Competitive health, dental, and vision... 
    Work at office
    2 days per week

    Quizlet

    New York, NY
    4 days ago
  •  ...Senior Principal, Anthropic AI Solutions (East Region)...  ...dozens to thousands of users.* Identify and engage...  ..., licensing tiers, and competitive positioning vs. OpenAI,...  ...) and the ability to evaluate and guide...  ...with clients to bring powerful customer experiences, innovative... 
    Temporary work
    Work at office
    Local area

    Slalom

    New York, NY
    5 days ago
  • $80k - $110k

     ...transforms outcomes. Sia’s AI & Data Business Unit is...  ...build, and deploy LLM-powered solutions that create...  ...production deployment, evaluation, and iteration. We...  ...refine outputs, improve user experience, and control...  ...enjoy as part of Sia. Competitive Compensation Annual Base... 
    Work at office
    Worldwide
    Visa sponsorship
    Work visa
    Flexible hours
    3 days per week

    SIA

    New York, NY
    4 days ago
  • $320k - $400k

     ...Building on our track record of AI-powered solutions (e.g., Bits AI,...  ..., RL training loops, and evaluation infrastructure needed to train...  ...to apply.Benefits and Growth:Competitive global benefits New hire...  ...Careers Page accessible to all users. If you would like to contact... 

    Datadog

    New York, NY
    2 days ago
  •  ..., and visualization.As AI Data Scientist Senior Associate...  ...workflow automations powered by LLMs and multi-agent...  ...through testing, evaluation, and monitoring. Your contributions...  ...business goals and user needs.•  Iterate...  .... We offer a competitive total rewards package including... 
    Work experience placement

    JP Morgan Chase

    New York, NY
    3 days ago
  • $210k - $285k

     ...making through our leading AI-infused scenario...  ...customers can outpace their competition and the market. What...  ...to building intuitive user interfaces. Youll build...  ...users to leverage the power of GenAI within their planning...  ...model monitoring evaluations and deployments.... 
    Full time
    Work at office
    2 days per week

    Anaplan

    New York, NY
    2 days ago
  • $229.6k - $337k

     ...visionary Senior Director of AI Engineering to lead...  ...AI and data engine powering Dataminr’s real-time...  ...modification of workflows, evaluations, and outputs of models...  ...work (context, end-user impact, etc), finding...  ...more, as part of our competitive benefits package aimed... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Dataminr

    New York, NY
    5 days ago
  • $110k - $115k

     ...Synechron, we believe in the power of digital to transform businesses...  ...processes, and develop AI-powered copilots using Microsoft...  ...Collaborate with business users to gather requirements and deliver...  ...environments We offer: ~ A highly competitive compensation and benefits... 
    Temporary work

    Synechron

    New York, NY
    5 days ago
  •  ...potential.About the RoleAs an AI Product Manager at...  ...technology to drive AI-powered innovation across a...  ...daily workflows.Establish evaluation metrics and design...  ...refinement by building user feedback loops that evolve...  ...backgrounds. Compensation is competitive and commensurate with... 
    Work at office
    Remote work
    Visa sponsorship
    Monday to Friday

    Success Academy Charter Schools

    New York, NY
    2 days ago
  • $192k - $240k

    Applied AI is where Datadog's ambitious AI bets get...  ...of shipping AI-powered products: balancing quality...  ...considerations. Drive evaluation and iteration practices...  ...employees and dependents age 6+Competitive global benefitsGiving...  ...Page accessible to all users. If you would like to... 
    Work at office

    Datadog

    New York, NY
    2 days ago
  • $70k - $85k

     ...seeking an early-career AI Solutions Analyst to...  ...platforms, and support for user-facing AI solutions....  ..., Microsoft Copilot, Power Apps, Power Automate, Copilot...  ...Assist with evaluating new AI tools, platforms...  ...offers a comprehensive and competitive benefits package designed... 
    Work at office
    Flexible hours

    WisdomTree.ai

    New York, NY
    2 days ago
  • $185k - $200k

     ...designing, building, and deploying AI-powered solutions that transform...  ...and monitoring. Design evaluation and quality framework. Build...  ...legal AI solutions — Understand user needs through discovery and...  ...array of comprehensive, competitive benefit programs that add value... 
    Full time
    Contract work
    Remote work
    Work from home
    Flexible hours

    Danaher Corporation

    New York, NY
    4 days ago
  •  ...in how people discover, evaluate, and purchase products....  ..., we're building the AI-native social operating...  ...the infrastructure that powers our AI workloads Improve...  ...thousands of daily users Collaborate...  ...What we Offer ~ Competitive compensation and early... 
    Remote work
    Shift work

    Nectar Social

    New York, NY
    3 days ago
  • $293.5k

     ...Expert Senior Manager, AI Engineering Job ID...  ...design and deliver AI-powered solutions that create measurable...  ...experimentation, and evaluation design to production...  ...suites integrating user signals, continual learning...  ...is commensurate with competitive geographic market rates... 
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    New York, NY
    3 days ago
  •  ...Labs Daice Labs is an AI research and product company...  ...decisions, model evaluation, and business operations...  ...including usage metrics, user behavior analysis, and...  ...visualization tools (Tableau, Power BI, Looker, or similar)...  ...metrics Compensation: Competitive offer will be discussed... 
    Full time
    Local area
    Remote work

    Daice Labs

    New York, NY
    2 days ago
  • About Baseten Baseten powers mission-critical inference...  ...world's most dynamic AI companies, like Cursor,...  ...expansion, reliability, and user experience. Design...  ...at each stage. Evaluate releases and recovery by...  ...and Dynamo. Benefits Competitive compensation, including... 
    Flexible hours
    Shift work

    Baseten

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SMB AI Power User — Competitive Evaluations. Be the first to apply!