Security Engineer - LLM SecOps
3B Staffing LLC
Key Responsibilities
LLM Security
- Design and implement guardrail systems for securing LLM inputs and outputs in production environments
- Secure Retrieval-Augmented Generation (RAG) pipelines, vector databases, and embedding workflows
- Develop runtime monitoring solutions for AI systems, including prompt logging, context analysis, and response validation
- Secure LLM API endpoints through authentication, rate limiting, and abuse prevention mechanisms
- Detect and respond to AI-related security incidents using structured Root Cause Analysis (RCA) methodologies
- Manage AI supply chain risks, including third-party models, APIs, and plugin integrations
- Collaborate closely with Product Security, Machine Learning Engineering, and Platform teams.
LLM Security
- Experience with prompt injection defense, jailbreak detection, and output filtering
- Familiarity with OWASP Top 10 for LLM Applications
- Knowledge of vector database security and embedding pipeline protection
- Experience with data isolation in multi-tenant environments and PII protection
- Experience with logging, anomaly detection, and SIEM integration for AI systems
- Strong understanding of incident response frameworks and RCA practices
- Hands-on experience with AWS environments
- Knowledge of Kubernetes security, container isolation, and IAM/RBAC models
- Experience securing APIs using OAuth, JWT, and rate limiting techniques
- Strong proficiency in Python for automation, scripting, and security tooling
- Experience in fintech, payments, or regulated financial services environments
- Exposure to AI security platforms such as Lakera, Protect AI, HiddenLayer, or similar tools
- Relevant certifications (e.g., AWS Security Specialty, CISSP, OSCP)
- Familiarity with regulatory and data protection frameworks (e.g., PCI-DSS, FCRA)
- Cloud: AWS (EKS, Aurora MySQL)
- Data Processing: Apache Spark
- Backend: Python, Kotlin
- Frontend: JavaScript, TypeScript, React / React Native
- Security & Operations: mTLS, CDN/Edge Security, SLI/SLO frameworks, RCA practices
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Security Engineer - LLM SecOps in San Francisco, CA vacancy
$105.4k - $207.8k
...Join Deloitte’s Cyber practice as a Cyber SecOps Senior Consultant and help clients... ...threat landscape through scalable, resilient security operations solutions. In this hands-on... ...focused on Google SecOps, threat detection engineering, and automation. You will work with...SuggestedLocal areaVisa sponsorship$146.3k - $257.7k
...future of work with AI. About the roleThis is where security meets innovation at enterprise scale. As a security engineer, applications at WRITER, you'll be building the... ...are secured, from threat modeling our LLM architectures to building automated security controls...SuggestedFull timeWork at officeLocal area$165k - $200k
...Agent Handler, which empowers AI agents with secure access to thousands of third-party tools,... ...sales, reduce customer churn, and save engineering resources—allowing them to focus on their... ...where neededBonus: experience with AI/LLM security, agent security, or securing data...SuggestedFull timeWork at officeHome office$230k - $260k
...build.We’re looking for a hands-on Detection Engineer to build and operate the systems and... ...work closely with Engineering, Corporate Security, and Infrastructure, with broad latitude... ...investigation, and detection authoring, including LLM-based workflows where useful.Translate...SuggestedLocal area$200k - $330k
...for Google Workspace. What you'll doLead Security for Our Platform. Take charge of... ...-Functional Teams. Partner closely with engineering, product, and GRC to embed security throughout... ...securing AI systems, with understanding of LLM and Agentic AI risks.Prior success in...SuggestedFull timeFlexible hours- ...Security Engineer LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers... ...a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders...Worldwide
BerriAI
San Francisco, CA3 days ago - ...Security Engineer Juicebox is on a mission to help teams win the talent war. In the age of AI, human ingenuity is the ultimate scarce resource... ...independently. Bonus Points If You… Interest in AI/LLM security, prompt injection, data poisoning, model extraction,...Work at officeWorldwide
Juicebox
San Francisco, CA1 day ago $320k - $405k
...growing group of committed researchers, engineers, policy experts, and business leaders working... ...AI systems.About the role Corporate Security protects the environment Anthropic's people... ...CI/CD applied to corporate infrastructure LLM-assisted security tooling you built that...Work at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA7 days ago$200k - $315k
...moves together across 1M+ interactions per day. As our second security engineer, you'll help secure a fast-growing, AI-native platform and the... ...style. Nice to haves Experience securing AI agents / LLM systems or governing AI agent use within an organization....Nooks
San Francisco, CA1 day ago$175k - $220k
About the RoleWe are looking for a highly technical Senior Security Engineer who is passionate about protecting data across modern SaaS, cloud... ..., or similar modern data platforms.Strong understanding of AI/LLM data protection risks, data leakage prevention, and AI governance...Full timeWork at office- ...ingenuity of the world’s largest community of security researchers to continuously discover,... ..., and accountability.Senior Security Engineer, Detection and ResponseRemote Location: Austin... ..., and remediationDevelop and deploy AI/LLM-powered tooling to accelerate investigations...ApprenticeshipLocal areaRemote workFlexible hoursShift work
$175k - $220k
About the RoleWe are looking for a highly technical Senior Security Engineer who thrives on building security capabilities from the ground up.... ...improve decision making, and reduce operational overhead.AI & LLM SecurityDesign and implement security controls for AI applications...Full timeWork at office$200k - $225k
...our team as we help shape a brighter way forward. The Senior Security Engineer, AI Enablement is Security's embedded, full-time representative... ...based tool integrations in production. Familiarity with the OWASP LLM Top 10, MITRE ATLAS, or comparable agentic and AI threat...Full timeLocal areaImmediate startRemote work$210k - $230k
...interview process.About the Role:We're looking for a Senior Staff Security Engineer to lead Gusto's edge and network security strategy, owning the... ....Prototype and ship agents, custom MCP servers, and LLM-assisted automations that compress security work from days to...Full timeWork at officeLocal areaRemote work2 days per week3 days per week$190k - $225k
...Senior Security Engineer We are looking for a highly technical Senior Security Engineer who thrives on building security capabilities from... ...improve security effectiveness and business agility. AI & LLM Security Design and implement security controls for AI applications...WinMax
San Francisco, CA5 days ago- ...committed to the highest standards of data security and privacy protection. To learn more... ...via JIT/CIEM. SIEM Build & Detection Engineering - Deploy the SIEM platform and author 30... ...narratives for Cloud Security and SecOps domains. Security Reporting & Risk Governance...Worldwide
Plaud
San Francisco, CA4 days ago - ...TextNow is seeking a SecOps/SRE professional to secure, monitor, and enable automated response within our infrastructure. The role involves securing... ...with Terraform and Ansible, and collaborating with engineering to prevent threats. You will participate in on-call incident...
TextNow
San Francisco, CA2 days ago $232k - $290k
...join us, and build real world value.THE WORK:As a Senior Staff Security Engineer focused on AI Security, you will be Ripple's deepest technical... ...the agentic SDLC, define and operationalize guardrails for LLM and agentic AI adoption, and build AI-powered security tooling...Full timeWork at officeLocal area- ...platforms, or workflows you use today.ROLE OVERVIEWAs an Enterprise Security Engineer at Benchling you’ll be joining a team responsible for building... ...and enforce security standards for AI agent and LLM service identities — including scoped API keys, short-lived credentials...Work at officeLocal areaFlexible hours3 days per week
$275k - $300k
...at Postman.About the TeamThe Information Security organization at Postman operates across three... ...for a Principal Offensive Security Engineer who is as much a strategist as they are a... ...testing of AI systems, agentic workflows, and LLM integrations.You will lead a team that...Work at officeFlexible hours3 days per week- ...career, and the financial world.The role: We’re seeking a Staff Security Detection Engineer to build and mature SoFi’s machine learning-driven... ...and community detection.Experience applying deep learning or LLM-based approaches to security, log, or sequence data.Experience...Remote work
- ...serial entrepreneurs alongside a world-class engineering team (with backgrounds from Jane Street,... ...About the Role Seeking a Founding Security Engineer with 7+ years of experience who... ...from scratch and securing the entire LLM pipeline, multi-tenant cloud infrastructure...
Success Matcher Recruitment
San Francisco, CA8 days ago - TextNow is seeking a SecOps engineer to secure, monitor, and automate security within our MVNO infrastructure. You will design secure, scalable systems and work with DevOps to embed security into CI/CD. The role emphasizes IAM, threat detection, incident response, and automated...
- ...Responsibilities: - Define and build the company's security architecture across the product, infrastructure, and AI/LLM pipeline - Take ownership of the security program as the first dedicated security engineering hire, reporting directly to the CTO - Partner with...Full timeH1b
Wise Insight
San Francisco, CA13 days ago $230k - $300k
...rather than weeks. This is the company's first dedicated security engineering hire. You will report directly to the co-founder and CTO,... ...ll do • Define and build security architecture across the LLM pipeline, cloud infrastructure, and customer-facing product....H1bVisa sponsorshipRaydar
San Francisco, CA14 days ago- ...the last 12 months. The Opportunity We're hiring a Senior Security Engineer to own how Ivo detects, responds to, and defends against... ...treating detections like software. Experience securing AI / LLM infrastructure and the operational risks around agents and model...Contract workWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
IVO Inc
San Francisco, CA3 days ago $155k - $400k
...team is building its AI-native future. About The Role The Security Team is responsible for securing all things Sentry: our... ...autonomy to tackle hard security problems with creativity and an engineering mindset. We work at a company with a strong developer culture,...Hourly payFull time$234.4k - $385k
...artificial general intelligence benefits all of humanity. The Security team protects OpenAI’s technology, people, and products. We are... ...engaging a robust security culture. About the RoleAs a Security Engineer, Application Security you will be responsible for identifying and...Work at officeRemote workRelocation packageFlexible hours$237.6k - $297k
We are seeking a highly technical Security Engineer to join our Product Security team. This role is integral to ensuring the security and integrity of our products and services. You will conduct in-depth code reviews, implement security best practices, and influence the...Full time$208k - $312k
...move from idea to production with speed, security, and exceptional developer experience.... ...is manual penetration testing. A software engineer with a strong desire to move into security... ...into agentic analysis: Build and operate LLM/agent-based reasoning that can validate business...Work at officeRemote workWork from homeWorldwideMonday to FridayFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Security Engineer - LLM SecOps. Be the first to apply!
Related searches
- security engineering manager San Francisco, CA
- application security engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- sr security engineer San Francisco, CA
- entry level security engineer San Francisco, CA
- senior application security engineer San Francisco, CA
- staff security engineer San Francisco, CA
- security solutions engineer San Francisco, CA
- principal security engineer San Francisco, CA
- physical security engineer San Francisco, CA