SMB AI Power User — Competitive Evaluations
$40 - $50 per hourAgency
MERIDIAL SMB AI Power User — Competitive Evaluations Company Meridial Location Remote Engagement Type Independent Contractor About Meridial Meridial places skilled, remote-first professionals into high-trust, high-precision operational opportunities for leading technology companies. Our teams work as an embedded extension of our clients' own product and operations organizations, holding the same quality bar and the same deadlines. The Opportunity As an SMB AI Power User on the Competitive Evaluations team, you'll help a major consumer technology company find out where its bundled AI assistant subscription falls short of the standalone assistants small businesses already pay for. You are not an AI researcher studying the problem from the outside - you are a working or experienced business owner who already runs on these tools, and your own operations are the test bed. Your day is spent doing what you already do: drafting ad copy, planning content, answering customer messages, researching suppliers, and reconciling numbers. The difference is that you do it across competing assistants, side by side, and document precisely where each one breaks. The failures you surface are the failures real paying subscribers will hit, which is exactly why the seat calls for a genuine operator rather than an evaluator. What You'll Do Run head-to-head prompts and multi-turn workflows across the client's assistant and competing paid assistants, using tasks drawn from your own business operations and marketing. Build and maintain a library of realistic small-business test cases spanning ad creative and copy, organic content planning, customer messaging, competitor research, pricing, scheduling, and light bookkeeping. Identify and document failure modes - wrong answers, unnecessary refusals, weak instruction-following, tone misses, brand-unsafe output, broken formatting, context lost across turns, unusable image or video output. Write clear, reproducible reports: prompt used, model and surface, expected output, actual output, severity, and why the failure matters to a paying business subscriber. Assess the bundled subscription on value terms - what a business owner actually receives versus what a standalone competitor subscription delivers for comparable spend. Stress-test assistant features inside the social and commerce surfaces where business owners meet them, not only the standalone chat product. What We're Looking For Owner or operator of a small or medium business - sole proprietor, founder, or the person running day-to-day operations at a business of roughly 1–200 employees. Daily, habitual use of generative AI tools in that business, for both operations and marketing. Experimental or occasional use is not a fit. Organic presence on Instagram and Facebook for the business, maintained personally: posting, Stories, Reels, comment and message response. Hands-on paid advertising experience on Meta platforms - has personally built, launched, and optimized campaigns with real budget. Based in the United States and authorized to work here. Capacity sufficient to complete deliverables per the agreed scope and timeline, which may include up to 40 hours per week. Exceptional written English - able to describe a failure clearly enough that an engineer can reproduce it without follow-up. Comfortable working independently against a rubric and holding a weekly output cadence. Nice to Have At least one current paid AI subscription (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced, or similar), so competitive comparison rests on actual use. Runs a side business or second venture alongside a primary role - the profile that tends to test AI hardest against limited time. Heavy Instagram user, personally and commercially: fluent in Reels, Stories, trends, and creator tooling. Subscribes to two or more AI assistants simultaneously and holds an informed view on where each one wins. Uses AI beyond chat - automations, agents, API or no-code integrations, custom GPTs or Projects. Prior experience with model evaluation, red teaming, data annotation, QA, or structured user research. Working familiarity with adjacent SMB tooling: Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, Later, or similar. Industry range across the two hires - for example, one services or retail operator alongside one e-commerce or creator-economy operator. Compensation & Contract We offer a pay range of $40-$50 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply. #J-18808-Ljbffr Agency
- ...Job Title AI Evaluation Engineer Location Hybrid / Remote Employment... ...teams to improve AI system reliability and user experience. Key... ...Statistical analysis Data visualization (Power BI, Tableau, Matplotlib) Git and CI/...SuggestedFull timeRemote work
$197.3k - $225.1k
AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable... ...help bring the transformative power of emerging AI capabilities to... ...One offers a comprehensive, competitive, and inclusive set of health,...SuggestedFull timePart timeLocal area- AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging...SuggestedRemote job
- About the Opportunity A leading AI research organization is seeking advanced LLM power users with strong experience using... ...tasks. This project focuses on evaluating how well AI systems handle personalized... ...Candidates who want to be more competitive for this and future...SuggestedTrial period
$229.9k - $262.4k
Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible... ...help bring the transformative power of emerging AI capabilities to... ...One offers a comprehensive, competitive, and inclusive set of health,...SuggestedFull timePart timeLocal area- ...role of Senior Director, AI Solution Architect to... ...new projects by aligning user needs, platform... ...architecture, including evaluation frameworks and guardrail... ...exceptional talent. Together, we power the future of finance -... ...:BNY offers highly competitive compensation, benefits,...Work experience placementWorldwideFlexible hours
$200k - $250k
...Applied AI Engineer, Agents & Evaluation Compensation: $200k–$250k base + equity Location: New York... ...~ Hands-on experience shipping LLM-powered agents into production. ~ A clear understanding... ...used by real customers or internal users. ~ The ability to work closely with...Full timeFor contractors$148.19k - $198.17k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ....The RoleSummaryAs an SMB Technical Architect, you are a... ...best. Together, we’ll bring the power of Agentforce to organizations... ...help our recruiters assess and evaluate candidates’ resumes and qualifications...Full time$289k
..., where we're on a mission to power exceptional service for every... ...by building products rooted in AI, automation, and intelligent customer... ...of Excellence.Compensation: Competitive executive package including... ...may be used to screen or evaluate applications for this position...Full timeRemote work$180k - $250k
...The Essential Cloud for AI. Built for pioneers by... ...infrastructure and services that power the next generation of... ...ML systems, services, evaluation frameworks, and product... ..., or other technical users.Familiarity with human-... ....In addition to a competitive salary, we offer a...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$180k - $275k
...Senior / Staff AI Platform Engineer About the... ...one of the largest AI-powered productivity platforms... ...world. Millions of users rely on the platform every... ...frameworks, agent systems, evaluation layers, and platform... ...75,000 Base Salary ~ Competitive Equity Package ~401(k...Full timeFlexible hours$149k - $350k
...code, or iterating with AI. From idea to product,... ...’s products through AI‑powered features. Collaborate... ...engineers to transform user feedback into... ...for AI systems. Build evaluation systems to measure and... ...employees, as well as a competitive package of additional benefits...Full timeTemporary workRemote workWork from home$30 per hour
...partner is looking for an AI Product Owner based in... ...into actionable user stories, acceptance criteria... ...technology leadership. Evaluate AI security tools and... ...2 employment basis. Competitive compensation package... ...works: We use an AI-powered matching process to ensure...Hourly payRemote work- ...platform architecture, and AI-native tooling. You... ...business and millions of users. Beyond traditional... ...planning resources. Competitive compensation and opportunities... ...: We use an AI-powered matching process to... ...your personal data to evaluate your candidacy and share...Remote workHome officeFlexible hours
$167k - $219k
...of college students, powering over 1 billion learning... ...to design and deliver AI-powered learning tools... ...Quizlet?Massive reach: 60M+ users, 1B+ interactions per... ...best practices, evaluating what's worth adopting.... ...we expect you to take!Competitive health, dental, and vision...Work at office2 days per week- ...Senior Principal, Anthropic AI Solutions (East Region)... ...dozens to thousands of users.* Identify and engage... ..., licensing tiers, and competitive positioning vs. OpenAI,... ...) and the ability to evaluate and guide... ...with clients to bring powerful customer experiences, innovative...Temporary workWork at officeLocal area
$80k - $110k
...transforms outcomes. Sia’s AI & Data Business Unit is... ...build, and deploy LLM-powered solutions that create... ...production deployment, evaluation, and iteration. We... ...refine outputs, improve user experience, and control... ...enjoy as part of Sia. Competitive Compensation Annual Base...Work at officeWorldwideVisa sponsorshipWork visaFlexible hours3 days per week$320k - $400k
...Building on our track record of AI-powered solutions (e.g., Bits AI,... ..., RL training loops, and evaluation infrastructure needed to train... ...to apply.Benefits and Growth:Competitive global benefits New hire... ...Careers Page accessible to all users. If you would like to contact...- ..., and visualization.As AI Data Scientist Senior Associate... ...workflow automations powered by LLMs and multi-agent... ...through testing, evaluation, and monitoring. Your contributions... ...business goals and user needs.• Iterate... .... We offer a competitive total rewards package including...Work experience placement
$210k - $285k
...making through our leading AI-infused scenario... ...customers can outpace their competition and the market. What... ...to building intuitive user interfaces. Youll build... ...users to leverage the power of GenAI within their planning... ...model monitoring evaluations and deployments....Full timeWork at office2 days per week$229.6k - $337k
...visionary Senior Director of AI Engineering to lead... ...AI and data engine powering Dataminr’s real-time... ...modification of workflows, evaluations, and outputs of models... ...work (context, end-user impact, etc), finding... ...more, as part of our competitive benefits package aimed...Full timeWork at officeRemote workFlexible hours$110k - $115k
...Synechron, we believe in the power of digital to transform businesses... ...processes, and develop AI-powered copilots using Microsoft... ...Collaborate with business users to gather requirements and deliver... ...environments We offer: ~ A highly competitive compensation and benefits...Temporary work- ...potential.About the RoleAs an AI Product Manager at... ...technology to drive AI-powered innovation across a... ...daily workflows.Establish evaluation metrics and design... ...refinement by building user feedback loops that evolve... ...backgrounds. Compensation is competitive and commensurate with...Work at officeRemote workVisa sponsorshipMonday to Friday
$192k - $240k
Applied AI is where Datadog's ambitious AI bets get... ...of shipping AI-powered products: balancing quality... ...considerations. Drive evaluation and iteration practices... ...employees and dependents age 6+Competitive global benefitsGiving... ...Page accessible to all users. If you would like to...Work at office$70k - $85k
...seeking an early-career AI Solutions Analyst to... ...platforms, and support for user-facing AI solutions.... ..., Microsoft Copilot, Power Apps, Power Automate, Copilot... ...Assist with evaluating new AI tools, platforms... ...offers a comprehensive and competitive benefits package designed...Work at officeFlexible hours$185k - $200k
...designing, building, and deploying AI-powered solutions that transform... ...and monitoring. Design evaluation and quality framework. Build... ...legal AI solutions — Understand user needs through discovery and... ...array of comprehensive, competitive benefit programs that add value...Full timeContract workRemote workWork from homeFlexible hours- ...in how people discover, evaluate, and purchase products.... ..., we're building the AI-native social operating... ...the infrastructure that powers our AI workloads Improve... ...thousands of daily users Collaborate... ...What we Offer ~ Competitive compensation and early...Remote workShift work
$293.5k
...Expert Senior Manager, AI Engineering Job ID... ...design and deliver AI-powered solutions that create measurable... ...experimentation, and evaluation design to production... ...suites integrating user signals, continual learning... ...is commensurate with competitive geographic market rates...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week- ...Labs Daice Labs is an AI research and product company... ...decisions, model evaluation, and business operations... ...including usage metrics, user behavior analysis, and... ...visualization tools (Tableau, Power BI, Looker, or similar)... ...metrics Compensation: Competitive offer will be discussed...Full timeLocal areaRemote work
- About Baseten Baseten powers mission-critical inference... ...world's most dynamic AI companies, like Cursor,... ...expansion, reliability, and user experience. Design... ...at each stage. Evaluate releases and recovery by... ...and Dynamo. Benefits Competitive compensation, including...Flexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SMB AI Power User — Competitive Evaluations. Be the first to apply!





