Social Media Expert - AI Environments
Obsidian
About the work We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO, ads, CMS, product analytics and support — populated with realistic documents, dashboards, personas and deliberately planted problems. You will help design and pressure-test the Social Media environments: the briefs, the artifacts, the judgment calls a strong practitioner would make, and the errors a weaker one would miss. What you will do Design task briefs drawn from work you have actually done in social media, including what the task is really testing — the planted issue and the decision a strong practitioner should reach Specify the documents, dashboards, personas and tool states a realistic version of that task requires Write or review the reference answer and the criteria that separate a strong response from a plausible-but-wrong one Review AI agent attempts and judge them against your own standard Tasks span the capabilities we measure: diagnosing what happened from messy or conflicting data, prioritizing and making tradeoffs, planning and executing, QA and reconciliation, triage and escalation, research and evaluation, reporting, and orchestrating multi-step work across several tools. Social Media scope Social inbox management, campaign and publishing execution, share-of-voice analysis, and the response judgment calls that come with an owned brand channel. Who we are looking for Hands-on practitioner experience running brand social — you have owned the account and the inbox, not only managed people who do it Fluent in a social management platform such as Sprout Social, and comfortable reading native platform analytics Prior experience building AI training environments, RL environments or simulated case studies is strongly preferred Rubric Academy or Rubric Bootcamp certification is strongly preferred Clear written reasoning — much of the value is in explaining why a decision is right Screening Applicants complete a short multiple-choice knowledge screener specific to this sub-domain before review. #J-18808-Ljbffr Obsidian
$60 - $100 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Summers , and Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments) Type: Contract Compensation: $60–$100/hour...SuggestedContract workSummer workRemote work$70 - $84 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...SuggestedContract workSummer workRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark. Qualifications Must-...SuggestedContract workSummer workRemote work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location:...SuggestedContract workSummer workImmediate startRemote work$145 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type: Contract...SuggestedContract workSummer workRemote work- ...Product Manager to lead O2R systems, with strong Zuora Billing and RevPro expertise. You'll bridge Finance, IT, and Engineering, drive AI-enabled automation, and own the system roadmap for ARR, MRR, and deferred revenue. The ideal candidate has 5-8 years in IT product...
- YO AI Labs in the United States (Remote) seeks seasoned Adobe Marketing Technology Experts to support an AI training and evaluation project focused on enterprise marketing operations. You will test workflows with Adobe Workfront, AEM, CJA, Analytics and Experience Cloud...Remote job
- ...You will own advisory reviews end to end for product launches, translate regulatory requirements into defensible guardrails, and lead AI-enabled compliance workflows to speed reviews. This hands-on role partners with Product, Engineering, Legal, Risk, and bank teams to...Flexible hours
- YO AI Labs seeks a GIS & Geospatial AI Expert for a remote contractor role. You will contribute domain knowledge, document advanced workflows, and evaluate AI-generated solutions in geospatial environments. Strong emphasis on GIS, remote sensing, spatial analytics, and...Remote jobContract workFor contractors
$60 per hour
Prolific is seeking Accountant Subject Matter Experts to join their Expert Network to provide professional insights in AI training. Responsibilities include evaluating financial documents, providing AI model guidance, and ensuring data integrity. The ideal candidates will...Remote jobHourly payWork from homeFlexible hours- Mercor is seeking an independent contractor for their Benchmark Dataset Project, focusing on evaluating AI models in visual document understanding and instruction-following. This fully remote position offers flexibility in scheduling and competitive pay. You'll collaborate...Remote jobFor contractors
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original, executable research problems that today's frontier models cannot solve...Part timeImmediate start
- YO AI Labs is seeking a Product Management Expert for a remote contractor role to shape AI-driven product workflows. You will design realistic scenarios and gold-standard deliverables—PRDs, launch memos, roadmaps, and executive briefs. No AI experience required; senior...Remote jobFor contractors
- Mercor is seeking a remote Physics PhD to tackle complex physics problems and ensure the accuracy of AI-generated solutions. The role involves independently solving physics challenges and collaborating with AI research teams. Ideal candidates will have a PhD in Physics...Remote jobImmediate start
- Mercor is seeking experienced musicians to evaluate generative music AI models. You will compare AI-generated lyrics with published songs across genres and rate them against detailed quality standards in Greek and English. The role requires native or near-native Greek,...Remote workFlexible hours
$80 - $150 per hour
A leading behavioral health consulting firm is seeking Senior Behavioral Health Experts to work part-time and remotely on frontier AI research projects. You will be responsible for designing evaluations and testing AI systems in critical mental health contexts. The ideal...Hourly payPart timeRemote work- ...languages is required. Why This Role Exists At Mercor, we believe the safest AI is the one that’s already been attacked — by us. We are assembling a red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and...Remote work
- YO AI Labs is seeking a Hematology Expert for remote contractor work. You will contribute clinical expertise in Oncology and Hematology to evaluate trial data, review regulatory documents, and provide expert medical judgments for advanced AI healthcare projects. The role...Remote jobFor contractors
- We are seeking experienced AI Safety Red Teamers to identify vulnerabilities in frontier AI systems through adversarial testing. You will design challenging prompts, uncover model weaknesses, and evaluate AI behavior across complex, high-risk, and ambiguous ("grey-area...
$120 per hour
...Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour...Hourly payRemote workWork from homeFlexible hours- Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they...Remote jobHourly pay
- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...Remote jobHourly payWork at office
- Mercor, Inc. in San Francisco seeks a Growth Associate to connect AI companies with specialized experts. This role involves sourcing top professionals, managing recruitment pipelines, and collaborating across teams to support Mercor’s expansion. The ideal candidate will...
- YO AI Labs is seeking a Development & Infrastructure Expert to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and deployment workflows and provide...Remote job
- ...experienced investment banking analysts to join a flexible, remote engagement. Work 5-20 hours per week (more if desired) on training our AI model with professional presentations and slide decks. You'll apply 2+ years of bulge-bracket or elite-boutique experience to create,...Remote jobImmediate startFlexible hours
- ...Associate in San Francisco to architect and scale the expert supply engine driving frontier AI training. You will own both manual and automated pipelines... ...automation-driven scale, diligence, and initiative in a high-pressure startup environment. #J-18808-Ljbffr David Joseph
- Cincinnatus LLC is seeking a Marketing SME to join a leading GenAI team focused on evaluating AI outputs against rubrics and strengthening brand strategy in AI training data. We require 8+ years of marketing experience with top-tier brands, plus hands-on evaluation of...Weekday work
- ...tasks. You will contribute to creating, evaluating, and refining AI-generated presentations across core workflows: conference decks,... ...active research, possess a strong publication record, and demonstrate expert PowerPoint skills, with superb written communication and...Remote job
- Obsidian evaluates Neuron Kernel Interface (NKI) development tasks used for frontier AI model training and evaluation. The role focuses on assessing CUDA→NKI migration fidelity, Trainium-specific performance optimization quality, and cross-platform numerical-correctness...
$60 - $70 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Social Media Expert - AI Environments. Be the first to apply!
- subject matter expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- technology expert San Francisco, CA
- social media marketing San Francisco, CA
- social media internship San Francisco, CA
- social media marketing no experience San Francisco, CA
- real estate marketing social media coordinator San Francisco, CA
- social media evaluator San Francisco, CA
- weekend social media San Francisco, CA


