AI Product Testing Engineer
Virtue AI
Testing Engineer (Product & Back-End Focus) Location: San Francisco, CA (Onsite | Hybrid) About Virtue AI Virtue AI sets the standard for advanced AI security platforms. Built on decades of foundational and award-winning research in AI security, its AI-native architecture unifies automated red-teaming, real-time multimodal guardrails, and systematic governance for enterprise apps and agents. We are a well-funded, early-stage startup founded by industry veterans, and we're looking for passionate builders to join our core team. What You'll Do As a Testing Engineer, you will be responsible for ensuring the functionality, reliability, and quality of our proprietary AI platform, focusing on both product features and backend systems. Your work will involve traditional QA/system testing combined with cutting-edge AI security validation. You will:
- Design and execute comprehensive test plans for new product features, focusing on end-to-end functionality and user experience.
- Develop and automate system-level test cases for backend APIs, data pipelines, and platform reliability.
- Contribute to the optimization of the overall testing platform and CI/CD pipelines.
- Perform comprehensive model evaluations and analyze the results to ensure robust product behavior.
- Apply and develop core techniques for agent and model red-teaming, including designing new red-teaming methods to discover security vulnerabilities.
- Collaborate closely with backend, ML, and infra teams to align testing strategy with product requirements and deployment realities.
- Communicate with customers to understand customer requirements and be involved in product planning and management.
- Bachelor's degree in CS, CE, EE, or a related field.
- Proficiency in programming languages such as Python.
- Strong experience in software testing (especially AI-related software) methodologies, including test case design, automation, and defect tracking.
- Deep experience with backend testing, including API testing (e.g., REST/gRPC) and performance testing.
- Experience with containerization and deployment tools like Docker and Kubernetes .
- Strong problem-solving skills and effective communication abilities .
- Experience developing LLM-related and AI agent-related products.
- Hands-on experience in back-end (Go, C/C++) or front-end development (Node.js, Typescript).
- Familiarity with LLM libraries like PyTorch, HuggingFace, or agent development kits.
- Enthusiasm for thriving in a fast-paced startup environment .
- Competitive base salary compensation + equity commensurate with skills and experience.
- Impact at scale - Help define the category of AI security and partner with Fortune 500 enterprises on their most strategic AI initiatives.
- Work on the frontier - Engage with bleeding-edge AI/ML and deploy AI security solutions for use cases that don't yet exist anywhere else.
- Collaborative culture - Join a team of builders, problem-solvers, and innovators who are mission-driven and collaborative.
- Opportunity for growth - Shape not only our customer engagements, but also the processes and culture of an early lean team with plans for scale.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Product Testing Engineer in San Francisco, CA vacancy
$246k - $280k
Staff Product Design Engineer San Francisco — Device About the Company World is building a real human... ...designed to accelerate people in the age of AI. As bots and autonomous agents reshape... ...product development (design, develop, test, manufacture and implement)...SuggestedContract workWork experience placementWork at officeLocal areaFlexible hours- ...highly motivated Staff or Sr Staff engineer who will be responsible for developing tests and test methodologies for... ...maintenance. Ensure quality of products being developed and delivered to the... ...Enterprise). Know how on usage pf AI tools and leveraging AI for improving...SuggestedWork experience placementWorldwide
- ...the unique demands of advanced AI workloads. The team is... ...models. In addition to delivering production-grade silicon for OpenAI’s supercomputing... ...of experience in quality engineering, manufacturing quality,... ..., plating, and automated test). Experience with optical interconnects...SuggestedContract work
- ...Job DescriptionSenior Product EngineerCompanyCalqulateLocationSan Francisco, CA / Remote... ...Vision, PTOAbout The CompanyVenture-backed AI infrastructure company building tools for... ...organizations.The RoleSenior product-focused engineering role working directly with founders and...SuggestedRemote work
- ...The Opportunity As a founding product engineer engineer at Seekeasy, you'll shape the products that get into the hands of our customers. You'll use the latest advancements in AI, including computer vision, language, and generative ML models, work in a flexible development...SuggestedLive inWork at officeFlexible hours
$150k - $215k
...real-time streaming platform that moves production data across systems in real time, with zero... ...simple, reliable, and scalable for engineering teams. Our platform powers mission-critical... ..., customer-facing analytics, and AI workloads. Artie is built for engineers...Visa sponsorship- ...New Grad Product Engineer About Titan: Titan is an AI holding company transforming IT services with its Augmented AI platform. We acquire and partner with the best Managed Service Providers (MSPs) and embed AI at the core of their operations, empowering technicians...Rotational program
- ...Mission: We're looking for full stack Product Engineers to join our team building AthenaHQ, the leading platform powering global brands on AI Search. We're looking for an engineer who enjoys owning products You'll work with the latest technologies, interface...
- ...software vulnerabilities. We are training and scaling security AI agents to discover zero-days vulnerabilities across large... ...this role We're seeking an experienced front-end focused Product Engineer to lead the charge in building the world's first AI-native platform...Work at office
- ...Senior Product Engineer @ Kato About the Job Position: Senior Product Engineer (Full-Time) Reporting to: CTO Location: San Francisco... ...agents to perform manual, repetitive servicing work. Existing AI solutions try to automate this, but they treat regulatory...Full timeStart working today
- ...We're building the next hyperscaler for AI agents. About the role Your job will... ...'ll ship features quickly and make key product decisions with minimal oversight. You'... ...architectural decisions around observability, testing, and security best practices This role...Work from home
$300k
...Senior Product Engineer (North America) About OpenArt OpenArt is an AI-native storytelling and visual creation platform used by millions worldwide. We're building the next generation of creative tools powered by cutting-edge AI, enabling users to create videos...Remote workWorldwideVisa sponsorship- ...businesses to unlock the untapped potential of AI and personalization. We are passionate about revolutionizing product-led growth, and our mission is to transform the... ...driven startup looking for a talented full-stack engineer to join our early-stage team. You will play a...Flexible hours
- ...About Zed Zed is building the first AI-native, licensed neobank in the Philippines... ...to solve this. We are Stanford engineers and former YC founders who have spent our... ...Kunal Shah (Cred). The Role As a Product Engineer, you'll build the core systems that...Work at office
- ...Title: Product Engineer Location: San Francisco Company: Thorin Stage: Seed About Thorin Most enterprise software still depends... ...fall through the cracks. Thorin is building autonomous AI agents that understand the full context of your organization,...Work from home
$230k - $385k
...technology. About the Role We're looking for product mindset software engineers to join the GTM Innovation team. As a product engineer... ...motivated to make an outsized impact at the frontier of AI About OpenAI OpenAI is an AI research and deployment...- ...market. We’re growing rapidly and expanding our team of full-stack product engineers. The Enterprise team develops products that enable... ...religion, disability or age. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as...Remote workFlexible hours
- ...Anything Anything is the AI product engineer for the next wave of entrepreneurs. It's an AI agent that turns English into apps... ...Raise the quality bar through thoughtful system design, testing, and code review Identify and resolve structural issues that...Temporary work
- ...design partners who are global leaders in AI, e-commerce, and financial services:... ...happens in two ways: building first-party products like Tempo Wallet, and working directly with... ...Qualifications ~4+ years of full-stack engineering experience, including 1+ year(s) in...
$130k - $220k
...best people in the right roles to drive long-term success for both clients and candidates. Title of Role: Senior Product Engineer (Backend / AI Product) Location: San Francisco, CA Company Stage of Funding: Seed Stage (VC-backed) Office Type: Hybrid (...Work at officeImmediate start$200k - $300k
...a mission to make any company instantly AI native. We're the universal intelligence... ...for the whole organization, not just one engineer. Every person shows up on day one with the... ...engineer to join the small, but cracked, product engineering team at Adapt. We only hire product...Work at officeRelocation$250k
...This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers. She will pick the best candidates... ...network The next step is to speak to Jack. Job Title: Product Engineer, Applications Operations Salary: $250K-$500K Company...- ...AirOps Product Engineer AirOps is the first end-to-end content engineering platform built for the AI era. In a world where discovery is shifting from traditional search to AI-driven platforms, we help brands get found—and stay found. We are currently in a phase of...Flexible hoursShift work
$205k - $265k
...Quanta Quanta is an AI-powered accounting and finance platform... ...intersection of finance and engineering. As a group, we have built... ...from one to dozens, shipped 0→1 products, and scaled systems that support... ...data model to apply, stress-test, and evolve these abstractions...Work at officeImmediate startRemote work$150k - $300k
...talent firm that focuses on placing the best product managers, software, and hardware talent... ...them hire. Title of Role: Product Engineer Location: San Francisco, CA or New York... ...Description Our client is building AI-native data infrastructure for financial...Work at officeRemote workVisa sponsorship$200k
...with us. About the Role: AngelList is hiring a Senior Product Engineer to continue to build one of our most loved products - "Investor... ...or disability status. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...Work at office2 days per week$120k - $200k
...playing field by building financial products that help users better manage... ...to change that by being an AI enabled automated tax... ...further. We're adding a Product Engineers to our team to help monetize and... ...backend makes heavy use of pubsub. Testing and debugging complex state...Work experience placementWork at office$250k
...Full-Stack Product Engineer Y Combinator is hiring a full-stack product engineer to work at the center of how YC operates — from the application... ...internal teams, external founders and more Build deep AI and search systems (semantic search, embeddings, natural...Work at officeRelocationVisa sponsorshipWork visaFlexible hours$230k - $385k
...About the team Marketing Innovation is a product engineering team embedded within OpenAI's broader Demand Gen and Marketing organization... ...orchestration, and production monitoring. Are curious about modern AI models and excited to experiment with how evolving...- ...encryption key management and secret storage product. Vault enables applications to encrypt,... ...teams (e.g., AuthKit, Radar), solutions engineering, and GTM to ensure Vault integrates... ...age. We may use artificial intelligence (AI) tools to support parts of the hiring process...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Product Testing Engineer. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai research engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- entry level design engineer San Francisco, CA
- senior software design engineer San Francisco, CA


