Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Cybersecurity Benchmarks

$150k - $350k
Full-time

Jobgether

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Software Engineer, Cybersecurity Benchmarks based in the United States.

As a Software Engineer, Cybersecurity Benchmarks, you will play a key role in evaluating the cybersecurity capabilities of advanced AI models through rigorous, reliable, and publicly accessible benchmarks. You will design, develop, and maintain evaluation frameworks while ensuring that testing environments remain secure against increasingly capable AI systems. Working at the intersection of software engineering, cybersecurity research, and artificial intelligence, you will contribute to innovative experiments and threat-modeling strategies. You will collaborate closely with researchers, analysts, and engineers to ensure evaluation results are accurate, meaningful, and actionable. Your work will help establish an independent understanding of AI cybersecurity capabilities and their potential risks. This is an opportunity to influence how emerging AI technologies are assessed while contributing to research that informs developers, policymakers, and the wider technology community.

\n Accountabilities:
  • Design, develop, and maintain cybersecurity benchmarks for evaluating AI capabilities within the organization's evaluation infrastructure, primarily using the Inspect library.
  • Develop and prototype new benchmark concepts, experiments, and evaluation methodologies to measure emerging AI cybersecurity capabilities.
  • Maintain and improve existing benchmark suites, ensuring evaluations can be executed reliably and efficiently whenever new AI models are released.
  • Design, implement, and strengthen secure sandboxing environments to prevent highly capable AI models from escaping their designated evaluation environments.
  • Monitor emerging developments in AI agents, coding harnesses, and their interactions with software environments to anticipate potential security vulnerabilities.
  • Apply threat modeling techniques to identify potential risks, guide benchmark design, and inform broader cybersecurity evaluation strategies.
  • Contribute strategic recommendations on how AI cybersecurity capabilities should be measured, tested, and evaluated.
  • Integrate with AI providers and configure benchmarks to run effectively within the organization's infrastructure.
  • Collaborate with researchers, analysts, and fellow engineers to ensure evaluation data and outputs are accurate, insightful, and suitable for integration into research projects and publications.
  • Help maintain robust evaluation infrastructure and continuously improve the reliability, security, and scalability of benchmarking processes.

Requirements:

  • Several years of strong software engineering experience, including building, maintaining, and improving complex systems while consistently producing robust, reliable, and maintainable code.
  • Practical experience designing and implementing software sandboxing solutions capable of defending against highly capable adversaries.
  • Previous red teaming experience, including ethical hacking and identifying security weaknesses in software systems.
  • Familiarity with agentic AI systems, AI coding agents, and the coding harnesses used to execute and interact with tools and environments.
  • Strong problem-solving and creative thinking skills, with the ability to independently develop ideas for new cybersecurity benchmarks, experiments, and evaluation approaches.
  • Genuine motivation to contribute to independent AI research and the development of rigorous, publicly accessible evaluations of AI capabilities.
  • Professional-level English proficiency, with the ability to communicate technical concepts clearly and collaborate effectively in an international research environment.
  • Ability to work independently in a fully remote setting while collaborating with multidisciplinary teams across different time zones.

Nice-to-Have Qualifications:

  • Previous experience benchmarking AI systems and conducting model evaluations.
  • Experience designing or managing Capture the Flag (CTF) infrastructure.
  • Familiarity with using modern AI tools and systems for red teaming and ethical hacking.
  • Strong understanding of AI coding harnesses, tool calls, and the mechanisms through which AI agents interact with external environments.
  • Experience using the Inspect AI framework or familiarity with the Inspect library.
  • Good understanding of current artificial intelligence developments, emerging capabilities, and cybersecurity trends.

Candidates who do not meet every listed qualification but have relevant experience and a strong interest in the role are encouraged to apply.

Benefits:

  • Annual Salary: Competitive compensation ranging from $150,000 to $350,000, depending on experience and qualifications.
  • Work Arrangement: Fully remote position, with opportunities to work from many countries.
  • Flexible Schedule: Full-time employment with flexible working hours, ideally with some overlap with Pacific Time (UTC–8) and Greenwich Mean Time (UTC).
  • Team Retreats: Opportunity to participate in three team retreats per year. Travel is not mandatory but is preferred.
  • Research Impact: Opportunity to contribute to influential research and public evaluations shaping the understanding of AI capabilities and cybersecurity risks.
  • Professional Growth: Work alongside researchers, analysts, and engineers at the forefront of AI benchmarking and cybersecurity research.
  • Innovation: Freedom to propose and prototype original benchmark ideas and contribute directly to the organization's evaluation strategy.
  • Meaningful Mission: Help develop independent, trustworthy research that informs policymakers, industry leaders, developers, and society about advances in artificial intelligence.
  • Application Flexibility: Applications are reviewed on a rolling basis, with the possibility of starting as soon as the selected candidate is available.
\n

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Cybersecurity Benchmarks in Remote vacancy
  •  ...Epoch AI is looking for a Software Engineer, Cybersecurity Benchmarks who will help us measure how capable frontier AI models are at cybersecurity, and keep those measurements safe to run. The role will involve building and owning cybersecurity benchmarks, securing our... 
    Suggested
    Full time
    Remote work
    Flexible hours

    Epoch Ai

    Remote
    7 days ago
  • $105k - $185k

     ...Job Title: Full Stack Software Engineer Job Description The Full Stack Software Engineer...  ...applications and services. Design, code, benchmark test, debug, and document application...  ...) customers. Experience working on cybersecurity-focused projects. Experience with... 
    Suggested
    Permanent employment
    Contract work
    Interim role
    Remote work

    Actalent

    Dahlgren, VA
    1 day ago
  • $164k - $295k

     ...As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since...  ...About the Role: We're looking for a Senior UI Platform Engineer to lead the design and build of the shared developer tooling... 
    Suggested
    Permanent employment
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    Shift work
    New York, NY
    5 days ago
  • $196k - $242k

     ...3 is a fast-growing, remote cybersecurity company dedicated to the mission...  ...cyber operators, startup engineers, and formerly frustrated...  ...Senior/Staff Offensive Security Software Engineer with extensive web...  ...customer applications, alongside benchmark and lab targets, to surface... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Horizon3

    Remote
    18 days ago
  • $140k - $180k

     ...verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance, Change Management...  ...a hands-on Senior Quantitative Software Engineer to support a major Fundamental Review...  ...calculations, reconcile results to quantitative benchmarks, investigate discrepancies, and... 
    Suggested
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    5 days ago
  • $62.9k - $119.7k

     ...than 100 years of experience and renowned engineering expertise to meet the needs of today’s...  ...and defense. At Raytheon's Software Engineering Directorate (SWE) Effectors...  ...like real-time systems, machine learning, cybersecurity, and DevOps. Join our team of creative... 
    Temporary work
    Work experience placement
    Interim role
    Work at office
    Remote work
    Relocation
    Flexible hours

    Raytheon

    Tucson, AZ
    6 days ago
  •  ...positions. About the role Applied is looking for a new grad Cybersecurity Engineer who is passionate about building security into vehicle...  ...ensure the integrity and authenticity of firmware and software during boot-up Partner with hardware engineers to integrate... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Internship
    Work at office
    Remote work
    Day shift

    Applied Intution

    Sunnyvale, CA
    5 days ago
  • $134k - $220k

     ...be a driving force in the evolution of cybersecurity and the convergence of networking and security...  ...: Design, Develop and maintain software features on current and future products...  ...: ~0-3 years’ experience in software engineering. ~ Strong C/Linux experience is... 
    Full time
    Worldwide
    Home office

    Fortinet

    Sunnyvale, CA
    3 days ago
  • $164k - $295k

     ...As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since...  ...threats detected in their environments. This is a Sr. Software Engineer role in the engineering team that delivers the sensor (... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    California
    a month ago
  • $100k - $180k

     ...As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations....  ...Windows, macOS and Linux, in both user mode and kernel mode. Engineering software at that depth and that scale is among the hardest problems... 
    Permanent employment
    Work experience placement
    Internship
    Work at office
    Local area
    Remote work
    Worldwide
    Redmond, WA
    a month ago
  • $194k - $349k

     ...As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies...  ...CrowdStrike is seeking a Senior Engineer II for our Policy Management team. As a...  ...team is responsible for the cloud-side software and user interfaces that provide configuration... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week
    Redmond, WA
    14 days ago
  • $120k - $165k

     ...For:If you are an experienced software developer with 8+ years of experience in software engineering and enterprise architecture,...  ...ADRs, diagrams, prototypes, benchmarks, and other appropriate artifacts...  ...Working experience with cybersecurity standards and practices (e.g.... 
    Full time
    Work experience placement
    Work at office
    Remote work

    Iridium

    McLean, VA
    1 day ago
  • $194k - $349k

     ...As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations...  ...detected in their environments. This is a Sr. Software Development Engineer II (SDE) role in the CTIO team that is bringing multiple... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Sunnyvale, CA
    a month ago
  • $115k - $207k

     ...As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since...  ...prove it — is a high-stakes problem. We're looking for a Software Engineer to design and build the systems, metrics, and dashboards... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Redmond, WA
    13 days ago
  •  ...applications and next steps. Our partner is looking for a Full Stack Software Engineer – AI-First based remotely in United States. In this role...  ...security principles, secure coding practices, and modern cybersecurity threats. Experience contributing to end-to-end... 
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    5 days ago
  • $111k - $211k

     ...Overview LMI is seeking a talented and motivated Full Stack Software Engineer to join the team developing and advancing RAPTR®, LMI's...  ...and customer feedback. Familiarity with DoD or federal cybersecurity requirements, security compliance, and vulnerability management... 
    Contract work
    Remote work

    LMI

    Remote
    5 days ago
  • $140k - $200k

     ...next steps. Our partner is looking for a Senior Front End Software Engineer (Autofill) based in the United States. The Senior Front...  ...organizations worldwide. Exposure to advanced technologies in cybersecurity, browser engineering, and open-source software.... 
    Full time
    Remote work
    Worldwide

    Jobgether

    Remote
    6 days ago
  • $200k - $240k

     ...Segundo, CA, US Date Posted: 2026-08-25 Category: Software Subcategory: SW Engineer Schedule: Full-Time Shift: Day Job Travel:...  ...architecture, interfaces, data, infrastructure, cybersecurity, DevSecOps, and mission applications while preserving... 
    Full time
    Work at office
    Remote work
    Shift work

    SAIC

    El Segundo, CA
    2 days ago
  •  ...DescriptionJob DescriptionShape the Future of Cybersecurity at ForescoutEvery day cyberattacks...  ...the design and development of complex software systems and features.• Write, review,...  ...solutions.• Mentor and support junior engineers, fostering a culture of learning and continuous... 
    Work at office
    Remote work
    Flexible hours

    ForeScout Technologies

    Austin, TX
    4 days ago
  • $91.7k - $163.7k

     ...From advanced data analytics and AI to cybersecurity, we use innovative approaches to solve...  ...Product Managers, UX Designers, and backend engineering teams to translate business...  ...technical field 6+ years of professional software development experience including full-stack... 
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Eden Prairie, MN
    6 days ago
  •  ...to be considered. Vantor is currently seeking a Full-Stack Software Engineer to join our team. This role will be performed at the customer...  ..., geospatial analysts, all-source analysts and our cybersecurity team to create and maintain a diverse range of applications... 
    Full time
    Remote work

    Maxar Technologies

    Springfield, VA
    6 days ago
  •  ...projects, writing technical documents including scopes of work, software requirements, and estimates. About Us: InterSources Inc , is...  ..., Data Analysis, Application Development, Cloud Services, Cybersecurity, Digital Marketing, ERP Management, Custom Software Development... 
    Remote work

    InterSources

    New York, NY
    4 days ago
  • $117k - $234k

     ...the Membership Experience Engineering team at Walmart, we provide...  ...assessments of key opportunities; benchmarking and analyzing industry best...  ...solutions; and defining software development guidelines,...  ...engineers, data scientists, cybersecurity expert's and service professionals... 
    Full time
    Temporary work
    Part time
    Remote work

    Walmart

    Sunnyvale, CA
    3 days ago
  • $194k - $349k

     ...As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations...  ...detected in their environments. This is a Senior Software Development Engineer (SDE) role in the CTIO team that delivers the cutting edge... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Sunnyvale, CA
    a month ago
  •  ...company that provides Artificial Intelligence systems and software engineering services/solutions to DoD and Federal clients. We seek a Full...  ...maintainable code adhering to best practices and DoD/DoW cybersecurity standards.Participate in code reviews, testing, and... 
    Full time
    Local area
    Remote work
    Flexible hours

    Integrity Defense Solutions Inc

    Washington DC
    1 day ago
  • $125k - $160k

     ...year Requirements: At least six years of professional software engineering experience with increasing responsibility for production web...  ...this is not a dedicated DevOps, system administration, or cybersecurity role. Practical experience using AI-assisted... 
    Work at office
    Remote work
    Work from home
    Flexible hours

    SwissDevJobs.ch

    Lynchburg, VA
    5 days ago
  • $88.4k - $154.7k

     ...analyzes, designs, and develops computer software to support marquee customers in Defense...  ...close guidance of senior and lead engineers, following established designs and standards...  ...in a related field (Computer Science, Cybersecurity, Computer Engineering, etc.) ~2+ years... 
    Full time
    Remote work
    Flexible hours

    Parsons Corporation

    Maryland
    13 days ago
  •  ...the work that you do, creating a safer world through our cybersecurity SaaS portfolio. Our culture of flexibility, trust, and...  ...yourself. The Role BeyondTrust is seeking a Sr Software Development Engineer with a passion for developing robust software and... 
    Full time
    Flexible hours

    BeyondTrust

    Remote
    22 days ago
  • $180k - $200k

     ...Dropzone AI Dropzone’s mission is to scale cybersecurity beyond human limits, and augment every single human security engineer/analyst with an army of AI security...  ...About the role We’re looking for a Senior Software Engineer to deepen Dropzone’s integrations.... 
    Full time
    Work at office
    Remote work
    Work from home
    Night shift

    Dropzone AI

    Remote
    19 days ago
  • $350k - $400k

     ...SecurityScorecard is the global leader in cybersecurity ratings, with over 12 million companies continuously...  ...About the Role: We're starting a new engineering team, and its job is to change how SecurityScorecard builds software. You'll be one of the first people on it.... 
    Full time
    Remote work

    SecurityScorecard

    Remote
    8 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Cybersecurity Benchmarks. Be the first to apply!