Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Content Operations Project Manager, AI Evaluation

Part-time

ScaledOps

We’re building the future of how AI agents and humans work together on complex projects.

We’re looking for experienced project and program managers to help us train and supervise our agents that manage marketing campaigns.

Your job is to apply your real-world project management judgment to realistic scenarios around Content Operations and help us define what great project management looks like.

What you'll do

  • Review realistic project management scenarios and decide what a strong PM should do
  • Evaluate and supervise AI-generated plans, decisions, and responses
  • Create examples of good project plans, status updates, prioritization, and follow-up around Content Operations
  • Identify risks, blockers, dependencies, and missing information
  • Explain why a response or decision is good, bad, or incomplete
  • Help us turn real project management judgment into high-quality eval data

What we're looking for

  • 5+ years of project or program management experience
  • Experience owning complex, cross-functional projects
  • Strong judgment around prioritization, planning, risk, and stakeholder management
  • Clear written communication
  • Attention to detail
  • Comfortable working with AI tools and evaluating AI-generated work
  • Experience in software, technology, or startups is a plus.

The setup

This is a paid contract project starting at 10 hours, fully remote and mostly flexible hours. If it’s a good fit, there may be opportunities for additional projects.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Content Operations Project Manager, AI Evaluation in United States vacancy
  • $156k - $234k

     ...We solve complex operational challenges for global...  ...leaders within AI, autonomous vehicles...  ...testing, model evaluation services, and AI safety...  ...leadership on project delivery, work closely...  ...Responsibilities: Manage the delivery of AI...  ...testing, and AI content safety moderation.... 
    Content
    Full time
    Freelance
    Remote work

    TaskUs

    Austin, TX
    4 days ago
  • Overview Website Project Manager (eCommerce Operations) — Hay House, Inc. Position Summary...  ...performance. Develop compelling content and oversee metadata,...  ...processing and inventory. Evaluate and implement third-party...  ...user experience. Utilize AI-driven tools to streamline... 
    Content
    Full time
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Hay House

    Austin, TX
    4 days ago
  • $134.4k - $219.2k

    Senior Manager, Veeva Medical Affairs Regeneron Global Development IT...  ..., Medical Affairs systems and AI. The role is responsible for...  ...metadata to support scientific content management and medical review...  ...selection, implementation, and operations. Strong problem‑solving skills... 
    Content

    Regeneron Pharmaceuticals, Inc (USA)

    Brooklyn, NY
    5 days ago
  •  ...Description Job Title AI Operations Manager Roles Responsibilities...  ...• Develop and distribute content through AI-enhanced...  ...by leveraging AI tools to evaluate market trends and recommend...  ...Excellent communication and project management skills. • Experience... 
    Content

    ASK Consulting LLC

    Plano, TX
    1 day ago
  • £40.2k - £57.53k per year

     ...:The Delivery Traffic Manager is part of the Customer...  ...function, ensuring projects are effectively scheduled...  ..., events, science content, and health and IME initiatives...  ..., Advertising Operations, project managers, and...  ...affirmative action employer. We evaluate all qualified... 
    Content
    Local area

    Wiley

    Great Barrington, MA
    2 days ago
  •  ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Project & Operations Manager based in the United States....  ...Jobgether will process your personal data to evaluate your candidacy and share relevant information... 
    Full time

    Jobgether

    Remote
    7 days ago
  • $170.5k - $315.49k

     ...The Supply Chain Planning Operations (SCPO) organization is seeking an AI Software Architect to...  ...sensitivity capabilities that evaluate supply disruptions,...  ...technical partners, senior managers, and executives.Operate...  ...complex technical content for engineering, planning... 
    Content
    Full time
    Local area
    Immediate start
    Shift work

    Intel

    Hillsboro, OR
    4 days ago
  •  ...technology, enterprise operations, digital health,...  ...for life by enabling AI innovation through clear...  ...enterprise. As a Senior Project Manager, Responsible AI, you will...  ..., examples, training content, facilitation guidance...  ...Scientific continues to evaluate its policies and... 
    Content
    Hourly pay
    Work at office
    Local area
    Relocation
    Shift work
    3 days per week

    Boston Scientific Corporation

    Marlborough, MA
    1 day ago
  •  ...Apple, Inc. is seeking a Music Content Operations AIML Program Lead in Cupertino, CA to scale music content curation through models, agents...  ...Editorial, Analytics, and Operations to deliver end‑to‑end solutions, evaluate model outputs, and drive #J-18808-Ljbffr Jobleads-US
    Content

    Jobleads-US

    Cupertino, CA
    4 days ago
  •  ...for handling medium to large projects for a Line of Business that...  ...working with senior management to evaluate current methods and develop...  ...Description: Global Credit Operations (GCO): Responsible for the...  ...developing and delivering content Desired Skills: Commercial... 
    Content
    Work at office
    Flexible hours
    Shift work
    Day shift

    Bank of America

    Phoenix, AZ
    2 days ago
  • $99k - $232k

     ...a Cloud Infrastructure and Operations Delivery Manager you will oversee client-facing...  ...workstreams by balancing project planning, delivery...  ...automation, digital tooling, and AI-enabled workflows- Building...  ...closely with team members. We evaluate these factors thoughtfully... 
    Full time
    H1b

    PwC

    New Orleans, LA
    4 days ago
  •  ...contribute their expertise to a specialized AI training and evaluation project focused on instrument approach briefings and commercial flight operations. We are particularly interested in...  ...and validate AI-generated aviation content, assess instrument approach procedures... 
    Content
    Contract work
    Remote work
    Flexible hours

    Gramian Consulting Group

    Remote
    10 days ago
  •  ...experienced Intelligence Operations and Collection Specialists to contribute to an AI training and evaluation project focused on intelligence operations...  ..., intelligence collection management, or operational planning...  ...in AI-generated content. - Evaluate the application... 
    Content
    Contract work
    For contractors
    Remote work
    Flexible hours

    Gramian Consulting Group

    Remote
    10 days ago
  •  ...Contract Program Manager (Digital, Websites...  ...technical consulting projects from start to...  ...engineers, analysts, and content producers. The...  ...feedback, evaluating all proposed features...  ...feasible. Manage operational aspects of projects...  ...and clients. Use AI to accelerate your... 
    Content
    Contract work
    Work at office
    Remote work

    Blue State

    New York, NY
    3 days ago
  •  ...Reference26-28900Digital Operations - Digital Marketing...  ...Overview The US Content Production Manager serves as a pivotal...  ...technologies, including AI-enabled platforms,...  ...accurate year-end projections to support annual brand...  ..., performance evaluation, contract adherence,... 
    Content
    Contract work

    Mindlance

    Trenton, NJ
    4 days ago
  • $65 - $75 per hour

     ...partner company, who manages all applications and next...  ...is looking for an AI Operations Specialist based in the...  ...are ready for launch by evaluating accuracy, consistency,...  ...to take ownership of projects from initial design through...  ...in trust and safety, content moderation, data... 
    Content
    Hourly pay
    Full time
    Contract work
    Remote work

    Jobgether

    United States
    5 days ago
  • $120k - $150k

     ...advances in technology, AI and automation, and...  ...improvements across brand and content quality, creative...  ...the AI and Automation Manager, Corporate...  ...Marketing, IT, Sales Operations, Analytics and external...  ...simplification and tool evaluation.Fluency in how AI and... 
    Content
    Temporary work
    Local area
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours
    Shift work

    Willis Towers Watson

    Tampa, FL
    1 day ago
  • $159k - $360k

     ...Senior Supply Manager - Resource Management Location...  ...San Jose Team: Project Management Employment...  ...leading edge in the global AI competition wave. Our...  ...and Refined Operation.3. Controllable business...  ...with, consume, and create content. Why Join ByteDance... 
    Content
    Temporary work
    Local area

    Jobleads-US

    San Jose, CA
    4 days ago
  •  ...Largest Construction Projects ~ Nationwide...  ...Construction), project management, detailing,...  ...needs into practical AI-driven solutions that...  ...all AI-generated content incorporates...  ...Emerging Technologies Evaluate emerging AI...  ...collaboration, and operational efficiency.  Support... 
    Content
    Full time
    For contractors
    For subcontractor
    Work at office
    Worldwide

    ISAT Total Support

    La Mirada, CA
    17 days ago
  • $107.1k - $154k

     ...As the Data Strategy and Operations Manager at Abnormal AI, you will own our go-to-market...  ...cross-functional teams to evaluate system changes that affect...  ...quality and automation projects with clear priorities, owners...  ...tools analyze resume content and role requirements to suggest... 
    Content
    Full time

    Abnormal

    Remote
    3 days ago
  • $183.7k - $319.8k

     ...WW Business Operations Analytics Manager Cupertino, California, United States Operations...  ...building frameworks to evaluate containment, resolution...  ...capabilities needed for an AI-driven future. Responsibilities...  ...the schedule and content of weekly business reviews... 
    Content
    Worldwide
    Relocation

    Jobleads-US

    Cupertino, CA
    2 days ago
  • $105k - $190k

     ...Position Dexis is currently seeking a Project Manager & Directorate Operations and Mission Support Lead for a...  ..., cradle-to-grave information and content management and general mission...  ...terms with ESD, including analytic evaluations, policy development, strategic planning... 
    Content
    Full time
    Contract work
    Temporary work
    Work at office

    Dexis

    Washington DC
    3 days ago
  •  ...testing, and deploying AI solutions that...  ...systems and project-level applications...  ...Demonstrated ability to evaluate complex business...  ...dynamically adjust content, messaging, and sequencing...  ...optimize internal operations while preserving...  .... Experience managing the rapid, secure... 
    Content
    Permanent employment
    Remote work

    Stralynn Consulting Services, Inc.

    Brentwood, TN
    6 days ago
  • $40 - $65 per hour

     ...looking for a Digital Marketing Project Manager who can lead client...  ...understand our clients business, evaluate performance, identify what is...  ...media, social, CRO, analytics, content, and related workstreams Help...  ...to strategic thinking around AI, AEO, and the changing search... 
    Content
    Contract work
    Part time

    blennd Agency

    Denver, CO
    3 days ago
  • $70k - $85k

     ...Purpose The Technical Project Manager supports the planning,...  ...emerging business and operational issues, and provides...  ...artificial intelligence (AI) requires data. LOTS...  ...developing, deploying and evaluating ML models. RWS TrainAI...  ...data collection and content generation, data... 
    Content
    Full time
    Work at office
    Local area
    Flexible hours

    RWS Group

    Remote
    11 days ago
  •  ...auto finance solutions, with operations in North America, South America...  ...effectively within an AI enabled environment: Ability...  ...support daily work Skills in evaluating AI outputs for accuracy,...  ...research, summarization, and content generation Understanding of... 
    Content
    Work experience placement
    Work at office
    Visa sponsorship
    Flexible hours
    2 days per week

    GMAC Financial Services

    Arlington, TX
    2 days ago
  •  ...electric Transmission projects. You will bring a...  ...automations, and AI integrations to...  ...projects.Identify operational bottlenecks and develop...  ...tasks.Explore, evaluate, and integrate AI...  ...This includes the management of PLS-CADD licenses...  ...with content creation and management... 
    Content
    Work at office

    HDR

    Houston, TX
    1 day ago
  • $150.1k - $227k

     ...CategoryProgram & Project ManagementJob DetailsAbout...  ...is the #1 AI CRM, where humans...  ...development) into daily operations across multiple...  .... Dynamically evaluate and adapt to evolving...  ...technical product management, software...  ...creating instructional content, facilitating hands... 
    Content
    Full time
    Shift work

    Salesforce

    San Francisco, CA
    4 days ago
  •  ...EMR and practice management solutions to its clients...  ...fully integrated, AI-powered cloud EHR...  ...a Marketing Operations Strategist to develop...  ...enjoys managing projects, documenting processes...  ...for lead scoring, content generation,...  ...personalization. Evaluate and integrate AI tools... 
    Content
    Full time
    Remote work
    Night shift

    WRS Health

    Remote
    20 days ago
  • $67 - $72 per hour

    AI Operations Specialist Remote The Community you will join...  .... Our methods and projects change as the models...  ...operations, program management, analytics, consulting...  ...need to have designed evaluations or calibrated LLM judges...  .... Trust and safety, content moderation,... 
    Content
    Hourly pay
    Immediate start
    Remote work

    Crystal Equation

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Content Operations Project Manager, AI Evaluation. Be the first to apply!