Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Social Media Expert - AI Environments

Obsidian

About the work We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO, ads, CMS, product analytics and support — populated with realistic documents, dashboards, personas and deliberately planted problems. You will help design and pressure-test the Social Media environments: the briefs, the artifacts, the judgment calls a strong practitioner would make, and the errors a weaker one would miss. What you will do Design task briefs drawn from work you have actually done in social media, including what the task is really testing — the planted issue and the decision a strong practitioner should reach Specify the documents, dashboards, personas and tool states a realistic version of that task requires Write or review the reference answer and the criteria that separate a strong response from a plausible-but-wrong one Review AI agent attempts and judge them against your own standard Tasks span the capabilities we measure: diagnosing what happened from messy or conflicting data, prioritizing and making tradeoffs, planning and executing, QA and reconciliation, triage and escalation, research and evaluation, reporting, and orchestrating multi-step work across several tools. Social Media scope Social inbox management, campaign and publishing execution, share-of-voice analysis, and the response judgment calls that come with an owned brand channel. Who we are looking for Hands-on practitioner experience running brand social — you have owned the account and the inbox, not only managed people who do it Fluent in a social management platform such as Sprout Social, and comfortable reading native platform analytics Prior experience building AI training environments, RL environments or simulated case studies is strongly preferred Rubric Academy or Rubric Bootcamp certification is strongly preferred Clear written reasoning — much of the value is in explaining why a decision is right Screening Applicants complete a short multiple-choice knowledge screener specific to this sub-domain before review. #J-18808-Ljbffr Obsidian

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Social Media Expert - AI Environments in San Francisco, CA vacancy
  • $60 - $100 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Summers , and Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments) Type: Contract Compensation: $60–$100/hour... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $70 - $84 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark. Qualifications Must-... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location:... 
    Suggested
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $145 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type: Contract... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  •  ...Product Manager to lead O2R systems, with strong Zuora Billing and RevPro expertise. You'll bridge Finance, IT, and Engineering, drive AI-enabled automation, and own the system roadmap for ARR, MRR, and deferred revenue. The ideal candidate has 5-8 years in IT product... 

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  • YO AI Labs in the United States (Remote) seeks seasoned Adobe Marketing Technology Experts to support an AI training and evaluation project focused on enterprise marketing operations. You will test workflows with Adobe Workfront, AEM, CJA, Analytics and Experience Cloud... 
    Remote job

    YO AI Labs

    San Francisco, CA
    3 days ago
  •  ...You will own advisory reviews end to end for product launches, translate regulatory requirements into defensible guardrails, and lead AI-enabled compliance workflows to speed reviews. This hands-on role partners with Product, Engineering, Legal, Risk, and bank teams to... 
    Flexible hours

    FLEX Capital

    San Francisco, CA
    2 days ago
  • YO AI Labs seeks a GIS & Geospatial AI Expert for a remote contractor role. You will contribute domain knowledge, document advanced workflows, and evaluate AI-generated solutions in geospatial environments. Strong emphasis on GIS, remote sensing, spatial analytics, and... 
    Remote job
    Contract work
    For contractors

    YO AI Labs

    San Francisco, CA
    5 days ago
  • $60 per hour

    Prolific is seeking Accountant Subject Matter Experts to join their Expert Network to provide professional insights in AI training. Responsibilities include evaluating financial documents, providing AI model guidance, and ensuring data integrity. The ideal candidates will... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    San Francisco, CA
    4 days ago
  • Mercor is seeking an independent contractor for their Benchmark Dataset Project, focusing on evaluating AI models in visual document understanding and instruction-following. This fully remote position offers flexibility in scheduling and competitive pay. You'll collaborate... 
    Remote job
    For contractors

    Mercor

    San Francisco, CA
    3 days ago
  • Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original, executable research problems that today's frontier models cannot solve... 
    Part time
    Immediate start

    Mercor

    San Francisco, CA
    2 days ago
  • YO AI Labs is seeking a Product Management Expert for a remote contractor role to shape AI-driven product workflows. You will design realistic scenarios and gold-standard deliverables—PRDs, launch memos, roadmaps, and executive briefs. No AI experience required; senior... 
    Remote job
    For contractors

    YO AI Labs

    San Francisco, CA
    3 days ago
  • Mercor is seeking a remote Physics PhD to tackle complex physics problems and ensure the accuracy of AI-generated solutions. The role involves independently solving physics challenges and collaborating with AI research teams. Ideal candidates will have a PhD in Physics... 
    Remote job
    Immediate start

    Mercor

    San Francisco, CA
    3 days ago
  • Mercor is seeking experienced musicians to evaluate generative music AI models. You will compare AI-generated lyrics with published songs across genres and rate them against detailed quality standards in Greek and English. The role requires native or near-native Greek,... 
    Remote work
    Flexible hours

    Obsidian

    San Francisco, CA
    1 day ago
  • $80 - $150 per hour

    A leading behavioral health consulting firm is seeking Senior Behavioral Health Experts to work part-time and remotely on frontier AI research projects. You will be responsible for designing evaluations and testing AI systems in critical mental health contexts. The ideal... 
    Hourly pay
    Part time
    Remote work

    Aligned Labs

    San Francisco, CA
    4 days ago
  •  ...languages is required. Why This Role Exists At Mercor, we believe the safest AI is the one that’s already been attacked — by us. We are assembling a red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and... 
    Remote work

    Obsidian

    San Francisco, CA
    3 days ago
  • YO AI Labs is seeking a Hematology Expert for remote contractor work. You will contribute clinical expertise in Oncology and Hematology to evaluate trial data, review regulatory documents, and provide expert medical judgments for advanced AI healthcare projects. The role... 
    Remote job
    For contractors

    YO AI Labs

    San Francisco, CA
    3 days ago
  • We are seeking experienced AI Safety Red Teamers to identify vulnerabilities in frontier AI systems through adversarial testing. You will design challenging prompts, uncover model weaknesses, and evaluate AI behavior across complex, high-risk, and ambiguous ("grey-area... 

    Obsidian

    San Francisco, CA
    5 days ago
  • $120 per hour

     ...Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    San Francisco, CA
    2 days ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they... 
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    4 days ago
  • Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    3 days ago
  • Mercor, Inc. in San Francisco seeks a Growth Associate to connect AI companies with specialized experts. This role involves sourcing top professionals, managing recruitment pipelines, and collaborating across teams to support Mercor’s expansion. The ideal candidate will... 

    Mercor, Inc.

    San Francisco, CA
    2 days ago
  • YO AI Labs is seeking a Development & Infrastructure Expert to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and deployment workflows and provide... 
    Remote job

    YO AI Labs

    San Francisco, CA
    2 days ago
  •  ...experienced investment banking analysts to join a flexible, remote engagement. Work 5-20 hours per week (more if desired) on training our AI model with professional presentations and slide decks. You'll apply 2+ years of bulge-bracket or elite-boutique experience to create,... 
    Remote job
    Immediate start
    Flexible hours

    Ethos

    San Francisco, CA
    5 days ago
  •  ...Associate in San Francisco to architect and scale the expert supply engine driving frontier AI training. You will own both manual and automated pipelines...  ...automation-driven scale, diligence, and initiative in a high-pressure startup environment. #J-18808-Ljbffr David Joseph

    David Joseph

    San Francisco, CA
    4 days ago
  • Cincinnatus LLC is seeking a Marketing SME to join a leading GenAI team focused on evaluating AI outputs against rubrics and strengthening brand strategy in AI training data. We require 8+ years of marketing experience with top-tier brands, plus hands-on evaluation of... 
    Weekday work

    Mercor

    San Francisco, CA
    2 days ago
  •  ...tasks. You will contribute to creating, evaluating, and refining AI-generated presentations across core workflows: conference decks,...  ...active research, possess a strong publication record, and demonstrate expert PowerPoint skills, with superb written communication and... 
    Remote job

    Ethos

    San Francisco, CA
    2 days ago
  • Obsidian evaluates Neuron Kernel Interface (NKI) development tasks used for frontier AI model training and evaluation. The role focuses on assessing CUDA→NKI migration fidelity, Trainium-specific performance optimization quality, and cross-platform numerical-correctness... 

    Obsidian

    San Francisco, CA
    2 days ago
  • $60 - $70 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Social Media Expert - AI Environments. Be the first to apply!