Security Engineer - LLM SecOps
3B Staffing LLC
Key Responsibilities
LLM Security
- Design and implement guardrail systems for securing LLM inputs and outputs in production environments
- Secure Retrieval-Augmented Generation (RAG) pipelines, vector databases, and embedding workflows
- Develop runtime monitoring solutions for AI systems, including prompt logging, context analysis, and response validation
- Secure LLM API endpoints through authentication, rate limiting, and abuse prevention mechanisms
- Detect and respond to AI-related security incidents using structured Root Cause Analysis (RCA) methodologies
- Manage AI supply chain risks, including third-party models, APIs, and plugin integrations
- Collaborate closely with Product Security, Machine Learning Engineering, and Platform teams.
LLM Security
- Experience with prompt injection defense, jailbreak detection, and output filtering
- Familiarity with OWASP Top 10 for LLM Applications
- Knowledge of vector database security and embedding pipeline protection
- Experience with data isolation in multi-tenant environments and PII protection
- Experience with logging, anomaly detection, and SIEM integration for AI systems
- Strong understanding of incident response frameworks and RCA practices
- Hands-on experience with AWS environments
- Knowledge of Kubernetes security, container isolation, and IAM/RBAC models
- Experience securing APIs using OAuth, JWT, and rate limiting techniques
- Strong proficiency in Python for automation, scripting, and security tooling
- Experience in fintech, payments, or regulated financial services environments
- Exposure to AI security platforms such as Lakera, Protect AI, HiddenLayer, or similar tools
- Relevant certifications (e.g., AWS Security Specialty, CISSP, OSCP)
- Familiarity with regulatory and data protection frameworks (e.g., PCI-DSS, FCRA)
- Cloud: AWS (EKS, Aurora MySQL)
- Data Processing: Apache Spark
- Backend: Python, Kotlin
- Frontend: JavaScript, TypeScript, React / React Native
- Security & Operations: mTLS, CDN/Edge Security, SLI/SLO frameworks, RCA practices
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Security Engineer - LLM SecOps in San Francisco, CA vacancy
$200k - $315k
...moves together across 1M+ interactions per day. As our second security engineer, you'll help secure a fast-growing, AI-native platform and the... ...style. Nice to haves Experience securing AI agents / LLM systems or governing AI agent use within an organization....SuggestedNooks
San Francisco, CA4 days ago- ...Workspace. What you'll do Lead Security for Our Platform. Take charge of... ...Functional Teams. Partner closely with engineering, product, and GRC to embed security throughout... ...AI systems, with understanding of LLM and Agentic AI risks. Prior success in...SuggestedFull timeFlexible hours
Sierra
San Francisco, CA5 days ago $165k - $200k
...Security Engineer Merge is the leading provider of agentic tools and customer-facing integrations for frontier LLMs, Fortune 500 organizations... ...areas of Security where needed ~ Bonus: experience with AI/LLM security, agent security, or securing data-heavy API platforms...SuggestedFull timeWork at officeHome officeMerge LLC
San Francisco, CA3 days ago- ...Security Engineer LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers... ...a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders...SuggestedWorldwide
BerriAI
San Francisco, CA13 hours ago $300k - $405k
...Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build... .... In this role, you will have the opportunity to shape our security capabilities from the ground up alongside our world-class research...SuggestedFull timeWork at officeVisa sponsorshipFlexible hours- ...the last 12 months. The Opportunity We're hiring a Senior Security Engineer to own how Ivo detects, responds to, and defends against... ...treating detections like software. Experience securing AI / LLM infrastructure and the operational risks around agents and model...Contract workWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
IVO Inc
San Francisco, CA1 day ago $175k - $220k
...Senior Security Engineer San Francisco, CA About the Role We are looking for a highly technical Senior Security Engineer who thrives... ...improve decision making, and reduce operational overhead. AI & LLM Security Design and implement security controls for AI...Full timeWork at officeFlexible hoursSigma Computing
San Francisco, CA5 days ago$190k - $225k
...Senior Security Engineer We are looking for a highly technical Senior Security Engineer who thrives on building security capabilities from... ...improve security effectiveness and business agility. AI & LLM Security Design and implement security controls for AI applications...WinMax
San Francisco, CA4 days ago- ...committed to the highest standards of data security and privacy protection. To learn more... ...via JIT/CIEM. SIEM Build & Detection Engineering - Deploy the SIEM platform and author 30... ...narratives for Cloud Security and SecOps domains. Security Reporting & Risk Governance...Worldwide
Plaud
San Francisco, CA2 days ago $234.4k - $385k
...About the Team Security is at the foundation of OpenAI's mission to ensure that artificial general intelligence benefits all of humanity... ...security culture. About the Role As a Security Engineer, Application Security you will be responsible for identifying and...Work at officeRemote workRelocation packageOpenAI
San Francisco, CA4 days ago- ...Persona builds identity verification infrastructure where security isn't a layer we add later, it's core to everything we ship. When... ...generalist security team. You'll work alongside experienced security engineers to defend Persona's people, devices, and systems against...Full timeFor contractorsInternshipWork at officeWork from homeRelocation packageMonday to FridayFlexible hours
Persona Identities, Inc
San Francisco, CA1 day ago - ...Corporate Security Engineer Millions of people rely on Notion to do their most important work. Protecting that trust starts with protecting the people who build Notion: our employees, their laptops, their identities, and the SaaS apps they rely on every day. We are...Local area
Notion, LLC
San Francisco, CA3 days ago $82.6k - $162.8k
...you will support organizations as they modernize security operations through advanced analytics, cyber data engineering, and AI-enabled capabilities. You will work with... ...ends on 12/31/2026.Work you'll doAs a Cyber SecOps Consultant on the Cyber Defense & Resilience team...Local areaVisa sponsorship$105.4k - $207.8k
...Join Deloitte’s Cyber practice as a Cyber SecOps Senior Consultant and help clients... ...threat landscape through scalable, resilient security operations solutions. In this hands-on... ...focused on Google SecOps, threat detection engineering, and automation. You will work with...Local areaVisa sponsorship- ...Distributed LLM Inference Engineer At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We're commercializing Ray, a popular open-source project that's creating an ecosystem of libraries...Work at office
Anyscale
San Francisco, CA1 day ago - ...scale. We are specifically seeking an expert in high‑performance LLM serving systems and inference optimization. In this role, you... ...inference, with expertise debugging and optimizing major inference engines such as SGLang, vLLM, or TensorRT. Deep knowledge of state‑of‑...
NEAR.AI
San Francisco, CA2 days ago $188k - $282k
...getting started. Role Overview As a Senior Software Engineer on the Product Security team at Harvey, you'll be a key technical contributor... ...with AI/ML systems and emerging security considerations for LLM-based applications Compensation Range $188,000-28...Work experience placementHarvey
San Francisco, CA2 days ago$187k - $260k
...Airtable to transform how work gets done. Join Airtable as a Product Security Engineer and play a pivotal role in shaping the security of our rapidly evolving platform as we expand our AI and LLM-powered offerings. You will join the team responsible for safeguarding...For contractorsLive inRemote workAirtable
San Francisco, CA3 days ago- ...Product Security Engineer Collective is on a mission to redefine the way businesses-of-one work. Our technology and team of trusted advisors... ...software composition analysis (SCA) — integrated into CI/CD, LLM-based triage that separates real findings from noise, and automated...Self employmentWork at officeRemote workFlexible hours
Collective
San Francisco, CA3 days ago - ...Security Research Engineer We are seeking talented engineers intent on changing the security industry. If you have experience on fast-moving... ...generative AI: ideal candidates have built tools powered by an LLM Ideal candidates will be familiar with DevOps or...
Sybil
San Francisco, CA2 days ago $208k - $312k
...move from idea to production with speed, security, and exceptional developer experience.... ...is manual penetration testing. A software engineer with a strong desire to move into security... ...into agentic analysis: Build and operate LLM/agent-based reasoning that can validate business...Work at officeRemote workWork from homeWorldwideMonday to FridayFlexible hoursVercel Corp
San Francisco, CA1 day ago- ...A fintech company in San Francisco is looking for a Security-Focused DevOps Engineer for a full-time, in-person position. The role involves securing payment infrastructure, building CI/CD pipelines, and conducting security audits. Candidates should have over 4 years of...Full time
EmberPay Inc.
San Francisco, CA1 day ago - ...our voice superintelligence.To achieve this, we need more great engineers. The work affects millions of people every day and our... ...with you, please apply! The Role We're looking for a security engineer to build the systems and practices that keep our platform...
Giga AI Inc
San Francisco, CA1 day ago - ...the globe. Join us on this journey to redefine resource management-and change lives along the way. The Role As a Security Engineer at Air Apps, you will be responsible for safeguarding our applications, infrastructure, and data from threats and vulnerabilities...Temporary workWorldwide
Air Apps
San Francisco, CA3 days ago - ...on administration instead of care. If you want to help change that, apply below. About the role We are looking for a Security Engineer to help build and strengthen security foundations from the ground up in a fast-moving startup environment. This is a strong opportunity...Work at officeImmediate startFlexible hoursShift work
Assort Health
San Francisco, CA3 days ago - ...career, join us. About the team The Airwallex Information Security Team is a high calibre and highly proactive team that work... ...across our infrastructure, app security, Corporate IT and broader engineering functions. What you’ll do As a Senior Software...Full timeWorldwide
Airwallex
San Francisco, CA1 day ago $146.3k - $257.7k
...future of work with AI. About the roleThis is where security meets innovation at enterprise scale. As a security engineer, applications at WRITER, you'll be building the... ...are secured, from threat modeling our LLM architectures to building automated security controls...Full timeWork at officeLocal area$208k - $312k
...Senior Security Software Engineer Hybrid - San Francisco, New York City, London, Berlin Vercel is the agentic infrastructure company. We free... ...-tenant systems. Done prompt injection / jailbreak / LLM application security research on an agentic or AI-powered product...Full timeWork from homeWorldwideFlexible hoursc e r e m o n y
San Francisco, CA5 days ago$200k - $275k
A leading technology firm in San Francisco is seeking a Staff Software Engineer focused on Product Security. This role involves building secure frameworks, resolving security risks, and collaborating with teams to ensure best practices in security. The ideal candidate...Peregrine Technologies
San Francisco, CA1 day ago$100k - $150k
...A technology venture firm is seeking a Founding Member of Technical Staff (Security) in San Francisco. In this hybrid role, you will lead security research and vulnerability testing on real-world software. Ideal candidates should have strong skills in web application...Crane Venture Partners
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Security Engineer - LLM SecOps. Be the first to apply!
Related searches
- staff security engineer San Francisco, CA
- network security engineer San Francisco, CA
- product security engineer San Francisco, CA
- senior application security engineer San Francisco, CA
- sr security engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA
- senior security operations engineer San Francisco, CA
- cloud security engineer San Francisco, CA
- physical security engineer San Francisco, CA
- information technology security engineer San Francisco, CA