SMB AI Power User — Competitive Evaluations
$40 - $50 per hourAgency
MERIDIAL SMB AI Power User — Competitive Evaluations Company Meridial Location Remote Engagement Type Independent Contractor About Meridial Meridial places skilled, remote-first professionals into high-trust, high-precision operational opportunities for leading technology companies. Our teams work as an embedded extension of our clients' own product and operations organizations, holding the same quality bar and the same deadlines. The Opportunity As an SMB AI Power User on the Competitive Evaluations team, you'll help a major consumer technology company find out where its bundled AI assistant subscription falls short of the standalone assistants small businesses already pay for. You are not an AI researcher studying the problem from the outside - you are a working or experienced business owner who already runs on these tools, and your own operations are the test bed. Your day is spent doing what you already do: drafting ad copy, planning content, answering customer messages, researching suppliers, and reconciling numbers. The difference is that you do it across competing assistants, side by side, and document precisely where each one breaks. The failures you surface are the failures real paying subscribers will hit, which is exactly why the seat calls for a genuine operator rather than an evaluator. What You'll Do Run head-to-head prompts and multi-turn workflows across the client's assistant and competing paid assistants, using tasks drawn from your own business operations and marketing. Build and maintain a library of realistic small-business test cases spanning ad creative and copy, organic content planning, customer messaging, competitor research, pricing, scheduling, and light bookkeeping. Identify and document failure modes - wrong answers, unnecessary refusals, weak instruction-following, tone misses, brand-unsafe output, broken formatting, context lost across turns, unusable image or video output. Write clear, reproducible reports: prompt used, model and surface, expected output, actual output, severity, and why the failure matters to a paying business subscriber. Assess the bundled subscription on value terms - what a business owner actually receives versus what a standalone competitor subscription delivers for comparable spend. Stress-test assistant features inside the social and commerce surfaces where business owners meet them, not only the standalone chat product. What We're Looking For Owner or operator of a small or medium business - sole proprietor, founder, or the person running day-to-day operations at a business of roughly 1–200 employees. Daily, habitual use of generative AI tools in that business, for both operations and marketing. Experimental or occasional use is not a fit. Organic presence on Instagram and Facebook for the business, maintained personally: posting, Stories, Reels, comment and message response. Hands-on paid advertising experience on Meta platforms - has personally built, launched, and optimized campaigns with real budget. Based in the United States and authorized to work here. Capacity sufficient to complete deliverables per the agreed scope and timeline, which may include up to 40 hours per week. Exceptional written English - able to describe a failure clearly enough that an engineer can reproduce it without follow-up. Comfortable working independently against a rubric and holding a weekly output cadence. Nice to Have At least one current paid AI subscription (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced, or similar), so competitive comparison rests on actual use. Runs a side business or second venture alongside a primary role - the profile that tends to test AI hardest against limited time. Heavy Instagram user, personally and commercially: fluent in Reels, Stories, trends, and creator tooling. Subscribes to two or more AI assistants simultaneously and holds an informed view on where each one wins. Uses AI beyond chat - automations, agents, API or no-code integrations, custom GPTs or Projects. Prior experience with model evaluation, red teaming, data annotation, QA, or structured user research. Working familiarity with adjacent SMB tooling: Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, Later, or similar. Industry range across the two hires - for example, one services or retail operator alongside one e-commerce or creator-economy operator. Compensation & Contract We offer a pay range of $40-$50 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply. #J-18808-Ljbffr Agency
$40 - $50 per hour
Meridial is seeking an SMB AI Power User on the Competitive Evaluations team as an independent contractor. You will operate as a business owner using AI tools to test, compare, and document how competing assistants perform for a real paying customer context. You will run...SuggestedRemote jobFor contractors- AI Agent Power User is a remote review track for evaluating AI outputs across ai agent power user specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the...SuggestedHourly payFor contractorsWork experience placementRemote work10 hours per week
$262.5k - $299.6k
Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows) At Capital... ...bring the transformative power of emerging AI capabilities... ...Worked datasets with 100m+ users ~ Proven ability to design... ...One offers a comprehensive, competitive, and inclusive set of...SuggestedFull timePart timeWork at officeLocal areaFlexible hours- ...Job DescriptionJob Description Job Title AI Evaluation Engineer Location Hybrid / Remote... ...teams to improve AI system reliability and user experience. Key Responsibilities Design... ...Statistical analysis Data visualization (Power BI, Tableau, Matplotlib) Git and CI/CD REST...SuggestedFull timeRemote work
$197.3k - $225.1k
AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability) At Capital One, we are creating responsible... ...will help bring the transformative power of emerging AI capabilities to... ...One offers a comprehensive, competitive, and inclusive set of health, financial...SuggestedFull timePart timeLocal area$229.9k - $262.4k
AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable... ...help bring the transformative power of emerging AI capabilities to... ...One offers a comprehensive, competitive, and inclusive set of health,...Full timePart timeLocal area$229.9k - $262.4k
Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible... ...help bring the transformative power of emerging AI capabilities to... ...One offers a comprehensive, competitive, and inclusive set of health,...Full timePart timeLocal area$146.8k - $272.6k
...for artificial intelligence (AI) model evaluation and benchmarking. You will... ..., validate them with users, and improve them through iterative... ...AI-enabled future.Industry Competitive Benefits: We offer... ...journalism and news.We are powered by the talents of 26,000 employees...Full timeWork at officeLocal areaFlexible hours- ...knowledge and agentic AI platform. The Senior Data... ...business impact of AI-powered experiences used across... ...in relevance, accuracy, user satisfaction, and... ...experimentation, and AI evaluation, while one-third focuses... ...offering a comprehensive and competitive mix of pay and benefits...Full timeContract workWork experience placementLocal area
$153k - $376k
...AI Applied ScientistSan Francisco, CA • New York... ...'s products through AI powered featuresCollaborate closely... ...engineers to transform user feedback into... ...requirements for AI systemsBuild evaluation systems to measure and... ..., as well as a competitive package of additional benefits...Minimum wageFull timeTemporary workLocal areaRemote workFlexible hours$161.8k - $184.6k
...Principal Data Scientist - Ai Foundations, Specialist... ...A core capability that powers a wide range of use... ...our data and platform users to drive productivity and... ...through training, evaluation, validation, and implementationLeverage... ...a comprehensive, competitive, and inclusive set of...Full timePart timeImmediate start$122.5k
...or familiarity in using AI coding tools... ...and the impact on market competition, the impact of intellectual... ...of financial markets, evaluation of fair merger prices,... ...to build practical, AI-powered products that reshape how... ...direct access to real user problems, and strong distribution...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorship$44.5k - $71.2k
Graduate Intern - Power Data Analysis for AI Data Centers Location: CO - Golden Position Type: Intern... ...development opportunities, and a competitive benefits package designed to support... ...automated event detector, trained and evaluated on their own labeled data, that...Full timeFixed term contractInternshipLocal areaRelocation- ...Role Title: Competitive Data Scientist Role Type: Contractor Location: Global Fully Remote... ...data science experience to support an AI training project. Youll develop... ...verified reference solution and reliable evaluation criteria. Key Responsibilities...Full timeFor contractorsRemote workFlexible hours
$169k - $250k
...code, or iterating with AI. From idea to product,... ...hiring a Researcher, AI Evaluations to join AI Insights... ...of quality that reflect user needs, and your findings... ...performance metrics for AI-powered features Advanced... ...employees, as well as a competitive package of additional...Minimum wageFull timeLocal areaRemote workFlexible hours$80k
...Services' company, is looking for a Power BI Developer to support the... ...translate business needs into scalable, user-friendly reporting solutions. Apply... ...environment administration. Support evaluation of emerging Power Platform and AI capabilities, including Copilot. Agile...Contract workTemporary workRemote workFlexible hours$70k - $80k
...performance and seamless user experiences. Beyond... ...practices and tools, including AI-assisted solutions.... ...software. Benefits Competitive annual salary ranging from... ...Works We use an AI-powered matching process to ensure... ...your personal data to evaluate your candidacy and share...Remote work$160k - $174k
...highly motivated Senior AI Engineer to design,... ...recommendation systems, and AI-powered business workflows.... ...retrieval tuning, and evaluation. AI Engineering & Agentic... ...production metrics and user feedback. Business... ...new skills to retain a competitive advantage. Equal...Part timeWork experience placementWork at officeLocal areaRemote workFlexible hours$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high... ...in improving the quality of search engine results, ensuring users find the most relevant and useful information. Your work...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours$250k - $350k
...Udio builds extraordinary AI experiences to empower... ...of music, metadata and user interactions/feedback.... ...and the music evaluation manager, you will apply... ...as needed, including a powerful personal TPU pod. Join... ...Benefits ~ Highly competitive salary and equity ~ Quarterly...Work experience placementFlexible hours$42.69 - $86.68 per hour
...business impact, many centered on AI and emerging technologies,... ...insights and develop powerful machine learning models that... ...and ETL. Build, train, and evaluate machine learning and deep learning... ...mindset. Intuit provides a competitive compensation package with a strong...Full timeSummer workInternshipSummer internshipWork at officeRelocationMonday to Friday- ...role of Senior Director, AI Solution Architect to... ...new projects by aligning user needs, platform... ...architecture, including evaluation frameworks and guardrail... ...exceptional talent. Together, we power the future of finance -... ...:BNY offers highly competitive compensation, benefits,...Work experience placementWorldwideFlexible hours
$214k - $285k
...AI Research EngineerHex is an AI-powered platform for modern Data Science and Data Analytics... ...quality or using LLMs to evaluate agent threads, your job... ...capabilities to thousands of users, come do it on the best... ..., Hex proudly offers a competitive total rewards package, including...Full timeWork at officeFlexible hours$170k - $250k
...Get AI-powered advice on this job and more exclusive features. Oakwell Hampton... ...interaction patterns and get them into users hands quickly Create evaluation harnesses, instrument outcomes,... ...across the stack What is on offer Competitive salary in the range of 165K to 250...Full timeWork at officeMonday to Friday$125k - $292k
...financial lives. We're hiring AI/ML Engineers across... ...access to credit, and power the personalized... ...production — training, evaluation, deployment, monitoring... ...eligible for bonus(es), competitive equity, and benefits. For... ...and free. Through our user-friendly tools and intuitive...Full timeWork at officeLocal areaRemote work$110k - $138k
..., build and scale intelligent AI, digital, cybersecurity, cloud... ...company, supports commercial and SMB markets in the U.S. and Canada... ..., and on how models will be evaluated, optimized for edge deployment... ...Financial Benefits: Competitive Pay, Profit Sharing, 401k Plan...Full timeWork experience placementRemote workFlexible hoursShift work$244.7k - $279.2k
Staff AI Engineer - Enterprise Analysis Platform... ...bring the transformative power of emerging AI... ...native, at-scale (15,000+ users at destination), enterprise... ...search, guardrails, model evaluation, experimentation,... ...offers a comprehensive, competitive, and inclusive set of health...Full timePart timeLocal areaRemote work$40k - $60k
...seeking an accomplished AI Engineer for a remote,... ..., and scale actual LLM-powered products, autonomous AI... ...will empower enterprise users to harness cutting-edge... ...opportunity offers competitive global remuneration ($4... ...data science squads while evaluating model outputs, optimizing...Remote jobPermanent employmentFull timeContract workWork experience placementImmediate startWork from home$164k - $295k
...with the world’s most advanced AI-native platform. We work on... ...the analytics data systems that power the award-winning Falcon Console... ...actionable insights on how users interact with our products and... ...and mental wellness programs Competitive vacation and holidays for...Permanent employmentWork experience placementWork at officeLocal areaWorldwide- ...Interactive, the team behind Modo Casino, is seeking an experienced User Acquisition professional in the United States. You will run... ...paid social, Google Search, and DSPs, owning budgets and leveraging AI tools to test, learn, and optimize performance. With 3+ years in...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SMB AI Power User — Competitive Evaluations. Be the first to apply!







