Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - Research, Cyber

Vals AI, Inc.

About the role We are looking for an exceptional researcher to design and build the next generation of AI benchmarks for cybersecurity. You will create high-impact, challenging evaluations that push the boundaries of what we can measure in foundation models. This role is ideal for someone with deep research expertise who wants to see their work directly influence how the world evaluates AI systems. You will lead the design and development of novel benchmarks that assess real-world capabilities and risks of LLMs. Our benchmarks shape how foundation models are developed and generative AI applications are built. We work with every major foundation model lab - along with leading financial institutions and the application-layer companies pushing the frontier forward. Our work has been featured by the Wall Street Journal, New York Times, Washington Post, and Bloomberg. We are building the standard for evaluating the ability of LLMs to perform real-world tasks. You will be at the forefront of defining what that standard looks like. What you'll do Design and develop novel, high-impact benchmarks that assess challenging real-world capabilities for cybersecurity Conduct research to ensure our benchmarks are valid, reliable, and meaningful Collaborate with foundation model labs and enterprise security teams to understand evolving evaluation needs Analyze model performance across benchmarks and articulate results Publish research findings and contribute to the broader security and evaluation research communities Work closely with the infrastructure team to implement your benchmark designs at scale Stay current with the latest developments in LLM cyber capabilities and evaluation methodologies Requirements Cybersecurity experience: Hands-on work in security, e.g., as a security engineer, penetration tester, red teamer or vulnerability researcher. You may have found and reported vulnerabilities through bug bounty programs or CVEs. Systems depth: Strong grounding in operating systems, cloud infrastructure and networking. Interest in benchmarking: You care about measuring capability rigorously, not just demonstrating it. Ideally, you've built cyber evals, CTF challenges or security benchmarks before. AI-forward: You already use LLMs in your security work and want to work with them every day. Communication : Ability to clearly communicate complex research ideas to both technical and non-technical audiences. Collaboration : Experience working in research teams and integrating feedback. Location: We are an in-person team in San Francisco and will support relocation or transportation as needed. Nice to haves You've previously worked as a security engineer at a security company or on an in-house security team, and/or you have experience on an AI or ML team at a security company Strong ties to the security community: CTF teams, conference talks, open-source security tools, or research collaborations, published security research, papers or well-read technical write-ups What we offer Highly competitive salary and meaningful ownership. Excellence is well rewarded. Relocation and transportation support Health/dental insurance coverage Lunch and dinner provided, free snacks/coffee/drinks Unlimited PTO $1,500 housing stipend (within one-mile radius) Collaborate with leading AI labs and work on the front lines of AI development and evaluations Opportunity to publish and present your work About us Founding team : The core methodology behind this platform comes from NLP evaluation research we conducted at Stanford. We raised a $5M seed from some of the top institutional and angel investors in the valley. Our team has prior work experience at NVIDIA, Meta, Microsoft, Palantir and HRT. Collectively, we have over 300 citations in our published work. Our early team includes Stanford PhDs, ex-Jane Street quants, and the first designer at Snorkel. Tech stack : We use Python for most things at Vals AI. Our platform is built on Django, with a React frontend. All of the infra is on AWS using CDK for IaC. What We're Looking For Learning velocity: The role encompasses a wide variety of tasks. Rather than expecting you to be an expert on Day 1, we are looking for someone who can learn new skills and technologies quickly. Ownership : Working in a small, talent-dense team, we expect everyone to show initiative to build where it's needed, not where it's asked. We strive for autonomy over consensus. Intensity : The LLM landscape is constantly changing. Foundation model labs are continuously pushing the frontier. The unicorn companies that will emerge from this technology shift are being built now. Those that win will have an incredibly high speed of execution. Solution-oriented mindset : We're looking for people who see opportunities to craft solutions at each juncture, not those who pass hard problems to others or admit defeat. Vals in the Media AI tools mostly fumble basic financial tasks, study finds The Winners (and Losers) of This New Vibe-Coding Benchmark Will Surprise You OpenAI’s Less-Flashy Rival Might Have a Better Business Model Meta Announces New AI Model in Major Test of Company’s Ambitions DeepSeek’s Sequel Set to Extend China’s Reach in Open-Source A.I. #J-18808-Ljbffr Vals AI, Inc.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - Research, Cyber in San Francisco, CA vacancy
  •  ...Member of Technical Staff, Science Our mission is to advance humanity's ability to engineer biology. We approach this by understanding and improving AI’s application to biology across basic research, drug discovery, and biosecurity. We are a team of engineers, scientists... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Relocation package
    Flexible hours

    LatchBio

    San Francisco, CA
    13 days ago
  •  ...Job Title: Member of Technical Staff Agent Infrastructure & Research Job Location: San Francisco, CA Job Type: Full-Time Job Description: About Client & the Role Company is building infrastructure to make AI provably trustworthy for software... 
    Suggested
    Full time
    Internship
    Work at office
    Remote work

    Staffingine LLC

    San Francisco, CA
    2 days ago
  •  ...Job Description Job Description Our client, an AI healthcare software startup, is seeking a Member of Technical Staff (Research Scientist) to join their team. In this role, you'll be at the forefront of developing benchmarks and evaluation methodologies for large language... 
    Suggested
    H1b
    Relocation

    Thomas Talent Network

    San Francisco, CA
    21 days ago
  • $250k

     ...General Analysis is an AI safety and security research lab building guardrails, red-teaming frameworks, evaluations and runtime protection...  ..., ICML, ICLR or similar are a plus. ~ High agency, strong technical acumen and clear thinking. Compensation: $250K – $450K +... 
    Suggested
    Full time
    H1b
    Work at office

    General Analysis

    San Francisco, CA
    13 days ago
  •  ...and interpretability teams to connect physical understanding to research direction What we're looking for We value a relentless...  ...with ML researchers and translate physical principles into technical requirements A rigorous, evidence-driven approach to evaluating... 
    Suggested
    Full time

    causal

    San Francisco, CA
    9 days ago
  • Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible... 
    Work at office
    Visa sponsorship

    Reflection

    San Francisco, CA
    5 days ago
  •  ...understanding. About the Role We are looking for an AI Research Engineer to join our document understanding team. This role...  ...can figure things out without waiting to be told. ~ Strong technical writing and communication skills. Nice to Have Prior... 
    Full time

    llamaindex

    San Francisco, CA
    9 days ago
  •  ...primitive of software development. In this role, you will build the research systems behind our behavioral intelligence agents. Your work...  ...will also help define our research program through papers, technical writing, open-source work, and conference talks.... 

    a16z-speedrun

    San Francisco, CA
    5 days ago
  • $275k - $315k

     ...fight each other and that friction shows up as a tax on every researcher trying to build something ambitious. We're here to axe...  ...down to smaller and edge-deployable models. We're hiring a Member of Technical Staff to own the modeling side of that end to end. The... 
    Full time
    Work at office
    Relocation package

    sf-tensor

    San Francisco, CA
    9 days ago
  •  ...Job Description As a Member of Technical Staff (Research) at Trajectory, you will design and build the post‑training stack that lets our customers’ models continually learn from real production workflows. You will own end‑to‑end experiments across data, training, and... 
    Full time

    trajectory

    San Francisco, CA
    9 days ago
  •  ...Member of Technical Staff, Translational Science Our mission is to advance humanity's ability to engineer biology. We approach this by understanding...  ...and improving AI’s application to biology across basic research, drug discovery, and biosecurity. We are a team of... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package
    Flexible hours

    LatchBio

    San Francisco, CA
    5 days ago
  • $300k - $400k

     ...Member of Technical Staff - Science I San Francisco Bay Area | Bellevue, Washington | Hybrid | Department: Science About AIVista NTT...  ...Member of Technical Staff Scientist advances AIVista's AI research agenda and turns research results into production systems.... 
    Remote job
    Full time
    Work experience placement
    Local area
    Flexible hours

    ntt-data-aivista

    San Francisco, CA
    9 days ago
  • $10,000 per month

     ...; and from text to multimodal and physical AI. Ask any AI researcher or roboticist: the core bottleneck to progress is the availability...  ...startups and F500 enterprises.   THE ROLE As a Member of Technical Staff, you will work directly with Abundant's founding team to... 
    Full time
    Summer work
    Internship
    Flexible hours

    abundant

    San Francisco, CA
    9 days ago
  •  ...About Us Radical Numerics is an AI research lab building general biological intelligence. Our mission is to master the...  ...responsibility to defend. About the Role As a Member of Technical Staff, Pre-Training Science at Radical Numerics, you will work on... 
    Full time
    Local area

    radical-numerics

    San Francisco, CA
    9 days ago
  •  ...About Polymath Polymath is an applied research lab focused on advancing long-horizon agent capabilities through reinforcement...  ...& angels. About the role We’re hiring a Founding Member of Technical Staff - Research to help advance the frontier of autonomous... 
    Full time
    Work at office

    polymath

    San Francisco, CA
    9 days ago
  •  ...Job Description – Member of Technical Staff (Applied AI Research) Location: San Francisco, CA (on-site, 5 days a week, in our San Francisco office) About Artificial Analysis Artificial Analysis is the leading independent AI benchmarking company. We support labs... 
    Full time
    Work at office
    Immediate start

    artificialanalysis

    San Francisco, CA
    9 days ago
  •  ...Member of Technical Staff, Research The Token Company (YC W26, HF0 S26) · San Francisco, CA The Token Company is a seed stage startup in San Francisco. We have raised $12M from First Round Capital, NEA, Y Combinator and SV Angel, alongside the founders of Dropbox... 
    Full time
    Visa sponsorship

    the-token-company

    San Francisco, CA
    9 days ago
  •  ...Kinetic Systems is a healthcare AI research lab. We partner with frontier labs and healthcare organizations to help make AI...  ...Conviction, and other great investors.   The Role As a Member of Technical Staff (Research) , you’ll help drive our research agenda towards... 
    Full time
    Work experience placement

    kineticsystems

    San Francisco, CA
    9 days ago
  • $200k - $350k

     ...Mercor, Ramp, Midjourney, Apple, Jane Street and Zoox. This is a research-first role, not an engineering role: you'll own Pantheon's...  ...equity. Full-time, on-site in San Francisco. Interview: screening, technical chat with the RL research lead, 6-hour technical interview, 1–... 
    Full time
    H1b
    Work at office
    Visa sponsorship

    Pantheon

    San Francisco, CA
    13 days ago
  •  ...Member of Technical Staff: AI Research & Engineering in Media Integrity About Synhawk Synhawk builds omnimodal foundation models for communication integrity , aimed at infrastructure-side deployment in telco and banking sectors. Our platform analyzes the integrity... 
    Remote job
    Full time
    Internship
    Immediate start
    Shift work

    synhawk

    San Francisco, CA
    9 days ago
  •  ...interactive environments. We are looking for exceptional researchers to advance the simulation technologies that will power the...  ...intelligence. The Role We're looking for a Member of Technical Staff – Simulation Researcher to advance the scientific and technical... 
    Full time

    Moonlake

    San Francisco, CA
    4 days ago
  •  ...the physical world.   The Role We are looking for a Member of Technical Staff – Robotics to help build the bridge between simulation,...  ...and operating physical robots. You will work closely with researchers and engineers developing next-generation simulation environments... 
    Full time

    Moonlake

    San Francisco, CA
    9 days ago
  • $200k - $400k

     ...populated by generative agents based on real humans. Our research pioneered the field of AI-based simulation, proving it is...  ...Health Ventures, and Definition. About the Role As a Member of Technical Staff (MTS) in Research, you will work across the stack to train... 
    Full time
    Flexible hours

    simile

    San Francisco, CA
    9 days ago
  •  ...Francisco or Seattle with a hybrid work arrangement, offering a collaborative environment where technical and product decisions shape the company's future. The Member of Technical Staff position involves full-stack product engineering, working closely with clinicians and... 

    AI Voice Base

    San Francisco, CA
    3 days ago
  •  ...Member of Technical Staff – Machine Learning I’m partnering with a rapidly scaling healthtech startup that has just raised a $40M Series A...  ...PyTorch or JAX experience is a plus) ~ Background taking research ideas into production-ready services ~ Good understanding... 
    Work at office

    Quantix Search

    San Francisco, CA
    1 day ago
  • $150k - $220k

    # Founding Member of Technical Staff (MTS)Bay Area, CAFull-time$150k-$220k + equity## About UsVizopsAI is the secure runtime for custom enterprise...  ...in the SF Bay Area. The founding team combines deep AI/ML research leadership at Google DeepMind, Amazon Alexa, and Oracle... 

    Vizops

    San Francisco, CA
    3 days ago
  • $300k - $400k

     ...Member of Technical Staff - Applied Scientist I Reinforcement Learning and Simulation Environments San Francisco Bay Area | Bellevue, Washington...  ...outcomes. This role blends reinforcement learning research with environment engineering. You will design reward and... 
    Remote job
    Full time
    Work experience placement
    Local area
    Flexible hours
    Shift work

    ntt-data-aivista

    San Francisco, CA
    2 hours ago
  • $300k - $400k

     ...Member of Technical Staff - Applied Scientist I Formal Methods for AI Driven Software Development Life Cycle San Francisco Bay Area | Bellevue...  ...publications, patents, open-source contributions, and research partnerships in formal methods, programming languages,... 
    Remote job
    Full time
    Work experience placement
    Local area
    Flexible hours

    ntt-data-aivista

    San Francisco, CA
    2 hours ago
  •  ...within a native office suite, and deploys them in secure environments for Fortune 500 companies. About the Role As a Member of Technical Staff, you will be part of the team responsible for the work platform. You will think end-to-end about what it means to build... 
    Work experience placement
    H1b
    Work at office
    Visa sponsorship

    Product Pulse

    San Francisco, CA
    3 days ago
  •  ...and Obvious, our team brings together world‑class expertise in machine learning and drug discovery. We are seeking a Member of Technical Staff, Machine Learning to join our talented, ambitious, and kind team. You’ll innovate on ML methods, work closely with leading... 

    Inductive Bio

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - Research, Cyber. Be the first to apply!