Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Trust & Safety

$196k - $294k
Full-time

Vercel

Responsibilities

  • Analyze threat actor behavior and evolving abuse patterns across large, heterogeneous datasets.
  • Research, prototype, and implement LLM-driven techniques for abuse detection, classification, and prevention.
  • Design and develop production-ready systems that detect and disrupt abusive behavior across the Vercel platform.
  • Build, maintain, and fine-tune internal tools, datasets, and evaluation pipelines for trust and safety workflows.
  • Collaborate with security, product, and infrastructure teams to bring research ideas into stable, scalable production systems.
  • Own systems end-to-end from initial research through production deployment and iteration.

Requirements

  • At least 5 years of experience in abuse prevention, trust and safety, or security engineering.
  • Strong programming skills in JavaScript/TypeScript and Python.
  • Hands-on experience with LLMs, including prompt engineering, evaluation, and fine-tuning.
  • Solid understanding of cloud infrastructure, including AWS.
  • Strong understanding of real-world threat actor behavior and abuse tactics.
  • Experience owning systems through research, production deployment, and iteration.

Benefits

  • Competitive compensation package including equity, with a San Francisco base pay range of $196,000-$294,000.
  • Inclusive healthcare package.
  • Mentorship and support for attending professional events.
  • Flexible time off.
  • Company-provided equipment and a work-from-home budget.
  • Hybrid work with Monday, Tuesday, and Friday in-office anchor days for employees within the commuting distance of SF, NY, London, or Berlin offices; fully remote otherwise.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Trust & Safety in San Francisco, CA vacancy
  •  ...Lightspeed Venture Partners, Matrix Partners, NVentures (venture arm of NVIDIA). About the Role Suno is hiring a Software Engineer, Trust and Safety, to be on the front lines of protecting our platform and users from abuse, fraud, and harmful behaviors / content.... 
    Suggested
    Full time
    Work at office
    Local area

    Suno

    San Francisco, CA
    15 hours ago
  • $196k - $294k

     ...exceptional developer experience. Now, software is entering a new era, and the next...  ...building the platform for that future, trusted by companies like OpenAI, PayPal,...  ...define what comes next.As a Software Engineer on our Trust & Safety at Vercel, you’ll build and operate systems... 
    Suggested
    Full time
    Work at office
    Remote work
    Work from home
    Worldwide
    Monday to Friday
    Flexible hours

    Vercel

    San Francisco, CA
    2 days ago
  • $250k - $325k

    Principal Software Engineer- Trust & Safety This range is provided by Storm3. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $250,000.00/yr - $325,000.00/yr Additional compensation types RSUs Seeking... 
    Suggested
    Full time

    Storm3

    San Francisco, CA
    2 days ago
  • $160k - $190k

    A leading sports technology company in San Francisco is seeking a Senior Android Engineer to enhance the trust and safety of its community. You will collaborate with cross-functional teams to develop features impacting millions of users, ensuring a trustworthy mobile experience... 
    Suggested
    Flexible hours

    Strava

    San Francisco, CA
    2 days ago
  • $160k - $190k

     ...drive people forward. We’re looking for a Senior Android Engineer to join our Trust and Safety engineering team. This team is responsible for...  ...let’s build something incredible together. Strava builds software that makes the best part of our athletes’ days even better... 
    Suggested
    Work at office
    Worldwide
    Flexible hours
    3 days per week

    Strava

    San Francisco, CA
    2 days ago
  •  ...broadly beneficial Artificial General Intelligence (AGI). Safety is more important to us than unfettered growth....  ...is vital to our mission. That's why we're seeking a software engineer to help us build out our trust and safety capabilities. In this role, you'll work... 
    Full time

    OpenAI

    San Francisco, CA
    15 hours ago
  •  ...About the Team The Safety Systems team is dedicated to ensuring the safety, robustness, and reliability of AI models...  ...is vital to our mission. That's why we're seeking a software engineer to help us build out our trust and safety capabilities. In this role, you'll... 
    Full time

    OpenAI

    San Francisco, CA
    15 hours ago
  • $196k - $220.5k

     ...accurate, scalable, and fair and the engineering challenges that come with that are genuinely hard. Our Safety Engineering teams build and...  ...We're looking for a Senior Software Engineer who thrives on...  ...Collaborate closely with Trust & Safety, ML, Policy, and product... 
    Full time
    Work at office
    Remote work
    Relocation package
    2 days per week

    Discord

    San Francisco, CA
    2 days ago
  •  ...employees are creative, productive, and happy. The Role Cash Trust Identity is building the next generation of customer identity...  ...a rapidly growing fintech portfolio. We're looking for a Software Engineer to join our platform team and help modernize identity systems... 
    Full time
    Work at office
    Local area
    Remote work

    Block

    San Francisco, CA
    15 hours ago
  • $200k - $280k

     ...people, from students to large enterprises, trust us to keep their data secure and...  ...build in Notion.Notion is looking for software engineers who are excited to make trust and security...  ...fraud and abuse.Shape the future of AI safety at Notion by building controls and guardrails... 
    Local area

    Notion Labs

    San Francisco, CA
    15 hours ago
  • $185k - $218k

     ...Breakthrough Company.About the team/roleCheckr Trust is building safer communities by...  ...we are looking for a Senior Full Stack Software Engineer to play a pivotal role in the continued...  ..., etc).Background in trust & safety, IDV, background check products or criminal... 
    Temporary work
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    2 days ago
  • $225k - $250k

     ...educational institutions Work together with engineers, scientists, operators, and more from...  .... About the Role As a Senior Software Engineer on the Pay squad, you'll own...  ...us build out a much more sophisticated Trust & Safety surface area: KYC and identity verification... 
    Full time
    Contract work
    Work at office
    Flexible hours

    Handshake

    San Francisco, CA
    a month ago
  • $196k - $220.5k

     ...during, and after playing games. The Safety Processing team builds the...  ...gets actioned. We're looking for a Senior Software Engineer who can take ownership of complex, critical...  ...and legally compliant. Partner with Trust & Safety, Policy, ML, Data Science, and... 
    Full time
    Relocation
    Relocation package

    Discord

    San Francisco, CA
    20 hours ago
  • $196k - $220.5k

     ...during, and after playing games. The Safety Processing team builds the...  ...gets actioned. We're looking for a Senior Software Engineer who can take ownership of complex, critical...  ...and legally compliant. Partner with Trust & Safety, Policy, ML, Data Science, and... 
    Full time
    Work at office
    Relocation package
    2 days per week

    Discord Inc.

    San Francisco, CA
    20 hours ago
  • $57 - $61 per hour

    Join to apply for the Software Engineer, AI Safety, Mid-Level role at Jobright.ai 2 days ago Be among the first 25 applicants Join to apply for the...  ...connect you with verified openings from employers you can trust. Job Summary: OpenAI is an AI research and deployment... 
    Full time
    Summer work
    Internship
    H1b

    Jobright.ai

    San Francisco, CA
    2 days ago
  • $248k - $279k

    A leading gaming communication platform seeks a Staff Software Engineer for its Safety Processing team. You'll design scalable backend systems and...  ...have experience in an adversarial field like security or trust. The role offers a competitive salary ranging from $248,0... 

    Discord

    San Francisco, CA
    3 days ago
  •  ...Handshake is seeking a Senior Software Engineer in San Francisco to own payout and money movement systems. The ideal candidate has over...  ...on Rails and PostgreSQL. Responsibilities include building Trust & Safety tools and leading engineering practices. Attractive perks offered... 

    Handshake

    San Francisco, CA
    20 hours ago
  •  ...during, and after playing games. The Safety Platform team is at the heart of...  ...on Discord. We're looking for a Senior Software Engineer who is capable of handling ambiguous, complex...  ...protect Discord's users Collaborate with Trust & Safety, ML, and product teams to... 
    Work at office
    Relocation package
    2 days per week

    EngineersOfAI

    San Francisco, CA
    20 hours ago
  • $272k - $306k

     ...leading technology company is looking for a Staff Software Engineer specializing in Machine Learning Safety to lead the Safety ML team. Candidates should have...  ...experience in ML engineering, including 2 years focusing on Trust & Safety. The role involves guiding technical... 
    Full time

    ESR Healthcare

    San Francisco, CA
    2 days ago
  • $248k - $310k

     ...people to hang out before, during, and after playing games. We’re looking for aStaff Software Engineer to join our Safety Processing team. This team plays a crucial role in ensuring trust and safety across Discord, processing signals from user reports and automated... 
    Full time
    Work at office
    Remote work
    Relocation package
    2 days per week

    Discord

    San Francisco, CA
    2 days ago
  • $204k - $259k

     ...Waymo is seeking a skilled Software Engineer to contribute to their mission of autonomous driving technology. This role involves deploying solutions to rapidly address in-field behavioral issues and improving the production monitoring capabilities. Candidates should have... 

    Waymo

    San Francisco, CA
    20 hours ago
  • $272k - $306k

    Staff Software Engineer, Machine Learning (Safety) San Francisco, CA Overview We are seeking an accomplished and experienced Staff Machine Learning Engineer...  ...ML roles. 2+ years of experience applying ML in Trust & Safety to counter adversarial actors. Strong coding... 
    Full time

    ESR Healthcare

    San Francisco, CA
    3 days ago
  •  ...About the Team The Safety Systems org is responsible for various safety work to ensure our best models can be...  ...our commitment to AI safety and fostering a culture of trust and transparency. The Safety Engineering team builds the platforms and tools that make OpenAI’... 
    Full time

    OpenAI

    San Francisco, CA
    15 hours ago
  •  ...Adyen in San Francisco is seeking a Senior Full Stack Engineer for Customer Interfaces to advance our experience platform. You will build...  ...teams to deliver secure, scalable interfaces, implement zero-trust AI guardrails, and own production code from development through... 

    EngineersOfAI

    San Francisco, CA
    20 hours ago
  • $293k - $385k

     ...services for people around the world.API Safety's goal is to ensure safe deployment of...  ...RoleWe're looking for product-minded software engineers to join a team that is addressing emerging...  ....Develop scalable systems that extend trusted safety capabilities to new use cases,... 
    Internship

    OpenAI

    San Francisco, CA
    2 hours ago
  •  ...at the ground floor: you’ll ship code that shapes the company and the ecosystem we’re building. We move quickly, operate with high trust, and care deeply about craft. Our Stack Infra : Terraform, AWS, LGTM (Loki, Grafana, Tempo, Mimir), Tailscale, Cloudflare... 
    Full time
    Flexible hours

    Koah

    San Francisco, CA
    15 hours ago
  •  ...The ChatGPT team operates at the intersection of research, engineering, product, and design to bring OpenAI’s technology to a global...  ...APIs, and growth surfaces that scale adoption while upholding trust and safety. Our work is multidisciplinary—merging product,... 
    Full time

    OpenAI

    San Francisco, CA
    15 hours ago
  • $196k - $220.5k

     ...and game-related launches at Discord. Our engineering culture values collaboration, and this...  ...Scientists to build engaging, fun, and trusted experiences, while experimenting and iterating...  ...5+ years of experience as a fullstack software engineer. You have experience with... 
    Full time

    Discord

    San Francisco, CA
    15 hours ago
  •  ...Frontend Software Engineer About Pi Pi is building an agentic product security platform for teams that need to secure software at the...  ...maintainable way. Build robust forms and validation flows for high-trust product interactions. Create complex tables and data-heavy... 
    Full time

    Pi Security

    San Francisco, CA
    15 hours ago
  •  ...filtering, or anonymization policies. We are trusted by leading companies such as Ramp ,...  ...is on a mission to build the best engineering team and we're looking for people who want...  ...more traffic What You Need Software development experience building data-intensive... 
    Full time
    Flexible hours

    Formal

    San Francisco, CA
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Trust & Safety. Be the first to apply!