Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Safety Policy Lead, Youth Safety

$192k - $216k

Ultimate LLC

What you'll be doing Research and develop safety policies governing youth safety harms on Discord, including CSAM, grooming and solicitation, child exploitation, and age assurance, covering both reactive harm response and proactive age‑appropriate design. Own the full policy lifecycle for your domain: problem scoping, data justification, structured XFN consultation, testing against enforcement criteria, and post‑launch feedback loop management. Partner with Legal early in the development process. Embed compliance requirements for KOSA, COPPA, DSA Article 28, and the Online Safety Act into policy design before drafting begins. Co‑develop enforcement infrastructure with Trust and Safety, Engineering, and ML teams, including golden datasets, classification hierarchies, ML signal specifications, and IKB anchor criteria. Own the feedback loop from implementation and QA back to your policy work. When QA findings or overturn data indicate a policy gap, you drive the revision. Collaborate with civil society, NCMEC, ICAC, and other external child safety organizations. Represent Discord externally in this domain with credibility and consistency. Deliver rapid policy responses to emerging child safety threats, including cross‑functional coordination during incidents and regulatory notifications where applicable. Own at least one functional domain area for the Safety Policy team beyond your harm portfolio. Current team needs include policy implementation systems, AI/LLM governance, or safety‑by‑design frameworks. Expected travel: 15 % What you should have 5 or more years of experience in trust and safety, policy development, or child safety roles at a technology platform or civil society organization focused on child protection. Deep expertise in youth safety: CSAM, NCMEC/ICAC frameworks, CSAM hash‑matching systems, grooming and solicitation patterns, age assurance methodologies, and the regulatory landscape governing minors online. Direct experience with KOSA, COPPA, DSA child safety provisions, and/or the Online Safety Act. Regulatory literacy is required, not a bonus. Proven ability to write policy that survives implementation: clear enforcement criteria, defined classification hierarchies, and usable edge case guidance. Experience working with ML and automation teams to translate policy criteria into detection signals. You do not need to write the model, but you need to know what the model needs from you. Comfort making decisions under ambiguity and pressure. Strong written and verbal communication for audiences ranging from frontline moderators to regulators to executive leadership. Bachelor’s degree or equivalent professional experience. Bonus points Advanced degree in law, public policy, child development, psychology, or a related field. Experience with Discord’s platform or gaming and creator communities. Multilingual capabilities, particularly in languages relevant to Discord’s global user base. Candidates must reside in or be willing to relocate to the San Francisco Bay Area (Alameda, Contra Costa, Marin, Napa, San Francisco, San Mateo, Santa Clara, Solano, and Sonoma counties). Relocation assistance may be available. The US base salary range for this full‑time position is $192,000 to $216,000 + equity + benefits. Discord is committed to inclusion and providing reasonable accommodations during the interview process. We want you to feel set up for success, so if you are in need of reasonable accommodations, please let your recruiter know. Please see our Applicant and Candidate Privacy Policy for details regarding Discord’s collection and usage of personal information relating to the application and recruitment process. #J-18808-Ljbffr Ultimate LLC

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Safety Policy Lead, Youth Safety in San Francisco, CA vacancy
  • A leading provider of workforce development services is seeking a dedicated individual to enforce laws and policies while ensuring a safe environment for students and staff. The role involves...  ...or GED, experience working with youth, and a valid driver's license. This position... 
    Policy
    Youth

    Equus Workforce Solutions

    San Francisco, CA
    1 day ago
  • Discord is looking for a Safety Policy Lead to manage youth safety policies. Your responsibilities will include developing policies for various youth safety harms, partnering with legal teams for compliance, and collaborating with Trust and Safety on implementation. The... 
    Policy
    Youth

    Vamp

    San Francisco, CA
    2 days ago
  • $192k - $216k

    Discord is looking for a Policy Development Specialist for Child Safety in San Francisco. This role involves researching and developing safety policies while...  ...ideal candidate will bring a strong understanding of youth safety and regulatory compliance. A Bachelor's degree... 
    Policy
    Youth

    Discord

    San Francisco, CA
    2 days ago
  • $192k - $216k

    Ultimate.ai in San Francisco is seeking a Policy Development Specialist focused on youth safety to research and develop safety policies addressing CSAM, grooming, and child exploitation on Discord. You will manage the policy lifecycle and collaborate with legal and external... 
    Policy
    Youth
    Full time

    Ultimate.ai

    San Francisco, CA
    4 days ago
  • $144k - $198k

     ...About this role We’re looking for an experienced Trust & Safety (T&S) Strategy Lead to help protect the integrity of our marketplace and the community...  ...role: building and scaling enforcement programs and policies from the ground up, and helping set the strategic... 
    Policy
    Work experience placement
    Work at office
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire Inc

    San Francisco, CA
    4 days ago
  • Common Sense Media in San Francisco seeks a Standards Analyst for its Youth AI Safety Institute. You'll develop and maintain AI safety standards for youth-facing products, engaging with stakeholders and synthesizing input to ensure coherence in standards documentation.... 
    Youth
    Full time

    Common Sense Media

    San Francisco, CA
    1 day ago
  • $207k - $295k

     ...seeking a professional to define AI model behavior and enhance safety frameworks in their San Francisco office. This role involves collaborating...  ...strong judgment about AI risks and have experience with policy frameworks. The position offers a hybrid work model and... 
    Policy
    Work at office

    Slope

    San Francisco, CA
    1 day ago
  • $134.4k - $168k

     ...By leveraging Scale's massive, industry-leading data infrastructure, we are partnering with...  ...R&D environment, we are looking for a Safety Coordinator / Lab Lead to anchor our physical...  ...134,400 — $168,000 USD PLEASE NOTE: Our policy requires a 90‑day waiting period before... 
    Policy
    Full time

    Scale AI, Inc.

    San Francisco, CA
    4 days ago
  • ## Robotics Safety & Compliance LeadApplylocations: CA Client Field Office (San Fran Bay Area...  ...use ALL CAPS.Thank you!NOTICE: For Privacy Policy please review here**Job Responsibilities:**The Robotics Safety & Compliance Lead is responsible for ensuring all robotics operations... 
    Policy
    Work at office

    Welocalize, Inc

    San Francisco, CA
    4 days ago
  • $240k - $285k

    As the Trust and Safety (T&S) Responsible Deployment Policy Lead, you will manage and grow a high-impact team focused on developing policies that guide the safe and responsible deployment of Anthropic's tools and services. Your team will set policy frameworks that help... 
    Policy
    Work at office
    Home office
    Relocation package
    Weekend work

    Anthropic

    San Francisco, CA
    4 days ago
  • $220k - $300k

     ...civilization-scale infrastructure for AI. Role Fire Life Safety (FLS) Commissioning Lead to take technical ownership of FLS commissioning across...  ...norms. Health, dental, and vision insurance. Generous PTO policy, in line with local norms. The base salary range for... 
    Policy
    For contractors
    For subcontractor
    Local area

    Fluidstack

    San Francisco, CA
    1 day ago
  • The Site Safety & Operations Coordinator at Boys and Girls Clubs of San Leandro, based at Edendale Middle School in San Lorenzo, ensures...  ...of care. You will train staff in emergency procedures, lead drills, manage incident reporting, and coordinate with school leadership... 
    Youth

    Boys & Girls Clubs of San Leandro

    San Francisco, CA
    1 day ago
  •  ...Francisco is seeking an Executive Director for the Youth AI Safety Institute. The role involves leading a globally recognized institute focused on youth AI...  ...stakeholders. A strong background in AI and public policy is required, along with fundraising capabilities. #J... 
    Policy
    Youth

    Common Sense Media

    San Francisco, CA
    4 days ago
  • Ellis Technologies, Inc. is seeking an experienced professional to lead the global policy strategy for Youth Safety & Well-being. Responsibilities include developing enforceable policy standards, representing the company in public forums, and collaborating with cross-functional... 
    Policy
    Youth

    Ellis Technologies, Inc.

    San Francisco, CA
    1 day ago
  • The Consulting Solutions is looking for a Trust & Safety Operations specialist to manage Ads workflows. This role involves collaboration with Product, Engineering, and Policy teams to enhance safety and operational efficiency in advertising. The ideal candidate will have... 
    Policy

    The Consulting Solutions

    San Francisco, CA
    3 days ago
  • $27 - $27.5 per hour

    Alliance Ground International in San Francisco is seeking a dedicated member to ensure effective training and compliance with safety policies. Responsibilities include conducting internal audits, investigating claims, and performing statistical analyses at the station level... 
    Policy
    Hourly pay

    lliance Ground International

    San Francisco, CA
    1 day ago
  • $250k - $300k

    EXECUTIVE DIRECTORYouth AI Safety InstituteABOUT COMMON SENSE MEDIACommon...  ...Sense Media is the nation’s leading nonprofit dedicated to...  ...year.Launched in May 2026, the Youth AI Safety Institute is the first...  ...in AI, technology, or public policy who brings existing credibility... 
    Policy
    Youth
    Local area

    Common Sense Media

    San Francisco, CA
    3 days ago
  • $116k - $167k

    Google is seeking a Policy Enforcement Manager for YouTube's Partner Program. This role involves driving strategies, enforcing policies...  ...have a Bachelor's degree, 4+ years in data analytics and trust and safety, and strong communication skills. The position offers a... 
    Policy

    Google

    San Bruno, CA
    5 days ago
  • $90k - $110k

    Overview Common Sense Media is the leading nonprofit organization dedicated to improving...  ...AI. We rate, educate, and advocate for policies to protect and prepare kids online. Our...  ...Opportunity Launched in May 2026, the Youth AI Safety Institute is Common Sense Media's... 
    Policy
    Youth
    Full time
    Local area
    Worldwide

    Common Sense Media

    San Francisco, CA
    5 days ago
  • $159k - $384k

    Responsibilities Own the global policy strategy for Youth Safety & Well‑being—including CSAM, age‑inappropriate content, and psychological and developmental...  ...on child or adolescent safety. Demonstrated ability to lead and manage teams, set strategic direction, and deliver... 
    Policy
    Youth
    Temporary work

    Ellis Technologies, Inc.

    San Francisco, CA
    1 day ago
  •  ...through an intense commitment to safety, quality service, excellence,...  ...enforcing all laws, rules and policies authorized by the Safety and...  ...experience. Experience working with youth. A valid driver’s license in...  ...Workforce Solutions is a leading provider of workforce... 
    Policy
    Youth
    Temporary work
    Local area

    Equus Workforce Solutions

    San Francisco, CA
    1 day ago
  • $50 per hour

     ...for an on-call Case Aide to support foster youth in the community. You can effect positive...  ...them transition from potential harm to safety. This is a perfect opportunity for someone...  ...Adhere to our attendance and punctuality policy Needed Upon Hire Obtain... 
    Policy
    Youth
    Part time
    Flexible hours
    Shift work
    Night shift
    Weekend work
    Afternoon shift

    AFS4Kids

    San Francisco, CA
    3 days ago
  • $23 - $30 per hour

    Title: Site Safety and Operations Coordinator Organization: Boys and...  ...after-school environment for youth and staff. This role ensures...  ...improvement. In this role, you will lead with empathy and authenticity,...  ...with staff to implement policies and practices that benefit them... 
    Policy
    Youth
    Full time
    Temporary work
    Work at office
    Flexible hours

    Boys & Girls Clubs of San Leandro

    San Francisco, CA
    2 days ago
  • $21 - $27.4 per hour

     ...children and families in need of stability, safety, and well-being in communities. We...  ...adoption, mental health and transition-aged youth services in English and Spanish. We have...  ...Adhere to our attendance and punctuality policy Assume other duties as assigned by supervisor... 
    Policy
    Youth
    Hourly pay
    Full time
    Weekend work
    Afternoon shift

    AFS4Kids

    San Francisco, CA
    3 days ago
  • $26.03 - $28.63 per hour

     ...28.63 About Us: Caminar is a leading behavioral health organization that supported over 48,000 youth and adults across six counties...  ...our vision is to be a BEACON of SAFETY, COMPASSION, and FULFILLMENT,...  ...ensuring compliance with all agency policies and procedures, contractual... 
    Policy
    Youth
    Hourly pay
    Work at office
    Local area
    Shift work
    Night shift

    Caminar

    Daly City, CA
    4 days ago
  •  ...accomplish this through an intense commitment to safety, quality service, excellence, and...  ...and other staff. Follows all guidelines, policies, and procedures set forth by the...  ...and/or training. Experience working with youth and adults ages 16-24 in an educational or... 
    Policy
    Youth
    Work at office
    Local area

    Equus

    San Francisco, CA
    1 day ago
  • $146k - $166k

     ...Anthony's is the most comprehensive safety net service center in San...  ..., families, children, youth, and groups as appropriate. Conduct...  ...the organization's programs, policies, and procedures, and support behavioral...  ...-informed care. Assist and lead onboarding and mentoring of... 
    Policy
    Youth
    Temporary work
    Local area
    Monday to Friday

    St Anthony Foundation

    San Francisco, CA
    4 days ago
  • $90k - $110k

    Standards Analyst (Youth AI Safety Institute)Common Sense Media is the leading nonprofit organization dedicated to improving the lives of kids and families by providing...  ..., and AI. We rate, educate, and advocate for policies to protect and prepare kids online. Our ratings,... 
    Policy
    Youth
    Full time
    Local area
    Worldwide

    Common Sense Media

    San Francisco, CA
    1 day ago
  •  ...-ExemptAbout Us: Caminar is a leading behavioral health organization that supported over 48,000 youth and adults across six counties...  ...our vision is to be a BEACON of SAFETY, COMPASSION, and FULFILLMENT,...  ...compliance with all agency policies and procedures, contractual agreements... 
    Policy
    Youth
    Full time
    Part time
    Casual work
    Work at office
    Local area
    Shift work
    Night shift

    Caminar

    Daly City, CA
    1 day ago
  •  ...includes activities related to: engagement of children, youth and families; assessment of safety and risk; case planning and service delivery; and...  ...Child Welfare process, legal requirements and departmental policies and procedures by communicating verbally and in writing... 
    Policy
    Youth
    Permanent employment
    Work experience placement
    Trial period
    Shift work
    Night shift
    Weekend work

    Itlearn360

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Safety Policy Lead, Youth Safety. Be the first to apply!