Security Engineer - LLM SecOps
3B Staffing LLC
Key Responsibilities
LLM Security
- Design and implement guardrail systems for securing LLM inputs and outputs in production environments
- Secure Retrieval-Augmented Generation (RAG) pipelines, vector databases, and embedding workflows
- Develop runtime monitoring solutions for AI systems, including prompt logging, context analysis, and response validation
- Secure LLM API endpoints through authentication, rate limiting, and abuse prevention mechanisms
- Detect and respond to AI-related security incidents using structured Root Cause Analysis (RCA) methodologies
- Manage AI supply chain risks, including third-party models, APIs, and plugin integrations
- Collaborate closely with Product Security, Machine Learning Engineering, and Platform teams.
LLM Security
- Experience with prompt injection defense, jailbreak detection, and output filtering
- Familiarity with OWASP Top 10 for LLM Applications
- Knowledge of vector database security and embedding pipeline protection
- Experience with data isolation in multi-tenant environments and PII protection
- Experience with logging, anomaly detection, and SIEM integration for AI systems
- Strong understanding of incident response frameworks and RCA practices
- Hands-on experience with AWS environments
- Knowledge of Kubernetes security, container isolation, and IAM/RBAC models
- Experience securing APIs using OAuth, JWT, and rate limiting techniques
- Strong proficiency in Python for automation, scripting, and security tooling
- Experience in fintech, payments, or regulated financial services environments
- Exposure to AI security platforms such as Lakera, Protect AI, HiddenLayer, or similar tools
- Relevant certifications (e.g., AWS Security Specialty, CISSP, OSCP)
- Familiarity with regulatory and data protection frameworks (e.g., PCI-DSS, FCRA)
- Cloud: AWS (EKS, Aurora MySQL)
- Data Processing: Apache Spark
- Backend: Python, Kotlin
- Frontend: JavaScript, TypeScript, React / React Native
- Security & Operations: mTLS, CDN/Edge Security, SLI/SLO frameworks, RCA practices
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Security Engineer - LLM SecOps in San Francisco, CA vacancy
- ...Google Workspace. What you'll do Lead Security for Our Platform. Take charge of... ...Functional Teams. Partner closely with engineering, product, and GRC to embed security throughout... ...AI systems, with understanding of LLM and Agentic AI risks. Prior success in...SuggestedFull timeFlexible hours
Sierra
San Francisco, CA6 days ago - ...Security Engineer This is where security meets innovation at enterprise scale. As a security engineer, applications at WRITER, you'll be building... ...AI applications are secured, from threat modeling our LLM architectures to building automated security controls that scale...SuggestedFull timeLocal areaFlexible hours
Writer.ly
San Francisco, CA5 days ago - ...Juicebox Security Engineer Opportunity Juicebox is on a mission to help teams win the talent war. In the age of AI, human ingenuity is the... ...projects independently. Bonus Points For Interest in AI/LLM security, prompt injection, data poisoning, model extraction,...SuggestedWorldwide
Juicebox
San Francisco, CA4 days ago $200k - $315k
...moves together across 1M+ interactions per day. As our second security engineer, you'll help secure a fast-growing, AI-native platform and the... ...style. Nice to haves Experience securing AI agents / LLM systems or governing AI agent use within an organization....SuggestedNooks
San Francisco, CA3 days ago- ...Security Engineer We are looking for a strong security engineer to join our team at Vals AI. You will be a generalist, handling tasks on both... .... This is especially true for this role. Intensity: The LLM landscape is constantly changing. Foundation model labs are continuously...SuggestedFull timeWork experience placementWork at officeRelocationRelocation packageShift work
Vals AI
San Francisco, CA1 day ago $249k - $405k
...Senior Security Engineer We're hiring a Senior Security Engineer to own how Ivo detects, responds to, and defends against threats across our... ...detections like software. Experience securing AI / LLM infrastructure and the operational risks around agents and model...Work at officeRemote workIVO Inc
San Francisco, CA5 days ago- ...Senior Security Engineer The Security Engineering team is responsible for protecting Sift's products, infrastructure, and data while enabling... ...security controls or detection. ~ Direct experience with AI/LLM-specific security risks (prompt injection, model supply chain,...
Sift
San Francisco, CA3 days ago $175k - $220k
...Senior Security Engineer San Francisco, CA About the Role We are looking for a highly technical Senior Security Engineer who thrives... ...improve decision making, and reduce operational overhead. AI & LLM Security Design and implement security controls for AI...Full timeWork at officeFlexible hoursSigma Computing
San Francisco, CA4 days ago- ...committed to the highest standards of data security and privacy protection. To learn more... ...via JIT/CIEM. SIEM Build & Detection Engineering - Deploy the SIEM platform and author 30... ...narratives for Cloud Security and SecOps domains. Security Reporting & Risk Governance...Worldwide
Plaud
San Francisco, CA1 day ago $190k - $225k
...Senior Security Engineer We are looking for a highly technical Senior Security Engineer who thrives on building security capabilities from... ...improve security effectiveness and business agility. AI & LLM Security Design and implement security controls for AI applications...WinMax
San Francisco, CA3 days ago- ...Security Engineer, Application Security Security is at the foundation of OpenAI's mission to ensure that artificial general intelligence benefits all of humanity. The Security team protects OpenAI's technology, people, and products. We are technical in what we build...Work at officeRemote workRelocation package
OpenAI
San Francisco, CA3 days ago - ...cloud infrastructure provider is looking for a Senior Software Engineer to join their Trust & Safety team. This role involves protecting... ...you have strong programming skills and a solid background in security engineering, this role could be perfect for you. Competitive compensation...Remote job
$170k - $190k
...As a HIPAA-regulated, AI-native company, security is foundational to our ability to serve patients... ...looking for our first dedicated Security Engineer to help scale our security posture... ...help secure patient-facing voice agents, LLM-powered workflows, internal developer tooling...Temporary workLocal areaRemote workWork from homeFlexible hoursPair Team
San Francisco, CA6 days ago$187k - $260k
...Airtable to transform how work gets done. Join Airtable as a Product Security Engineer and play a pivotal role in shaping the security of our rapidly evolving platform as we expand our AI and LLM-powered offerings. You will join the team responsible for safeguarding...For contractorsLive inRemote workAirtable
San Francisco, CA7 days ago$113.03k - $140k
...that simplifies how individuals securely prove their identity online.... ...are seeking a Threat Detection Engineer to join our security... ...including Splunk, Google Chronicle (SecOps), and Elastic/Logstash. Build... ...Lucene). Design and evaluate LLM-assisted detection and triage...Full timeTemporary workWork experience placementWork at officeRemote workFlexible hoursShift work- ...from home day is currently Tuesday. About the Role Lambda Security protects some of the world's most valuable digital assets:... ...powers breakthrough artificial intelligence. As a Security Engineer at Lambda, you'll touch many areas across the security program...Work at officeLocal areaWork from homeFlexible hoursShift work
Lambda
San Francisco, CA4 days ago $155k - $240k
...is building its AI-native future. About The Role The Security Team is responsible for securing all things Sentry: our customers... ...to tackle hard security problems with creativity and an engineering mindset. We work at a company with a strong developer culture,...Hourly paySentry
San Francisco, CA5 days ago$170k - $205k
...part of a high-performing team that believes in each other, come build with us at Crusoe. About the Role: Crusoe is seeking a Security Engineer to join the Security Engineering team as the primary driver for implementing security defaults and endpoint visibility. This...Temporary workCrusoe
San Francisco, CA5 days ago- ...IT Security Engineer Location(s): Santa Clara, CA; San Francisco, CA; San Diego, CA This position reports to: Director of IT Security Max Rate:70/hr on w2 without benefits. ServiceNow is changing the way people work. With a service-orientation toward the activities...
ClifyX
San Francisco, CA5 days ago - ...biologists develop drugs, just as language models are changing how engineers write code. Our vision is a design suite for molecules, with... ...rigorous research and pace of execution. About the Role Security is what earns Chai the trust of the world's largest pharma...
Chai Discovery
San Francisco, CA4 days ago - ...Security Engineer San Francisco, California, United States Security Engineer Overview Thunes Financial Services is hiring a Security Engineer to be the architect of trust for our fintech platform. We are looking for a hybrid specialist who can bridge the gap between...
Thunes
San Francisco, CA5 days ago $300k - $405k
...Security Engineer, Detection & Response San Francisco, CA | New York City, NY | Seattle, WA; Washington, DC About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and...Work at officeVisa sponsorshipFlexible hoursanthropic
San Francisco, CA2 days ago$180k - $258k
...Senior Security Engineer We're looking for a Senior Security Engineer who is ready to elevate the safety and security of our systems and networks. You will serve as our guardian, ensuring our platforms are resilient against all threats while meeting compliance requirements...Flexible hoursCandid Health
San Francisco, CA2 days ago$237.6k - $297k
...We are seeking a Senior Security Engineer with a specialty in Detection and Incident Response to join our Security Engineering team. This role sits at the intersection of security operations and software engineering - you won't just investigate incidents, you'll build...Full timeScale AI
San Francisco, CA2 days ago- ...Overview AI has changed software development. Security hasn't caught up - until now. Corridor is changing the game of product security... ...at Stanford. As Corridor grows, we're hiring a Security Engineer to strengthen both our customers' security posture and our own....
Corridor Security Inc
San Francisco, CA2 days ago - ...Security Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable...Flexible hours
BaseTen
San Francisco, CA1 day ago - ...Agents Raindrop is the monitoring platform for AI agents. Engineering teams at Fortune 100s and the fastest-growing AI companies (Vercel... ...Hsu), Notion (Akshay Kothari) and more. Your Focus Secure the platform end-to-end from application code to cloud...
Raindrop
San Francisco, CA5 days ago - ...the globe. Join us on this journey to redefine resource management-and change lives along the way. The Role As a Security Engineer at Air Apps, you will be responsible for safeguarding our applications, infrastructure, and data from threats and vulnerabilities...Temporary workWorldwide
Air Apps
San Francisco, CA2 days ago - ...Security Engineer Andalusia Labs is building foundational economic infrastructure for programmable global markets, connecting capital, computation, and coordination across the internet. Our work sits at the intersection of distributed systems, finance, and machine intelligence...Contract work
Andalusia Labs
San Francisco, CA5 days ago $220k - $330k
...getting started. Role Overview As a Staff Software Engineer on the Product Security team at Harvey, you'll play a critical role in shaping how... ...AI/ML systems and emerging security considerations for LLM-based applications Compensation $220,000 -...Work experience placementHarvey
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Security Engineer - LLM SecOps. Be the first to apply!
Related searches
- IT security engineer San Francisco, CA
- sr security engineer San Francisco, CA
- information technology security engineer San Francisco, CA
- endpoint security engineer San Francisco, CA
- application security engineer San Francisco, CA
- staff security engineer San Francisco, CA
- senior application security engineer San Francisco, CA
- security engineering manager San Francisco, CA
- aws cloud security engineer San Francisco, CA
- security engineer San Francisco, CA