Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Professorial Open Rank, AI Test and Evaluation

$150k

Virginia Tech

Job Description The Virginia Tech National Security Institute (VTNSI) is a national leader in advancing security and resilience through innovative and applied research, empowering the next generation of experts, and building strategic alliances to address evolving national security challenges. We bring together exceptional interdisciplinary faculty, unique research infrastructure, and deep partnerships with industry and government sponsors to execute impactful research and development. VTNSI seeks a Research Assistant Professor, Research Associate Professor, or Research Professor in Artificial Intelligence (AI) Test & Evaluation (T&E) to play a central leadership role in a collaborative government–academia–industry research environment focused on accelerating the development, assessment, and transition of AI and machine learning (ML) capabilities for national security. This position blends responsibilities traditionally associated with technical integrators, chief engineers, and portfolio managers, requiring both deep technical expertise in AI and T&E and demonstrated leadership in managing interdisciplinary research teams, coordinating stakeholders, and shaping research direction in rapidly evolving mission contexts. The successful candidate will lead and coordinate research activities supporting rapid development, prototyping, test & evaluation, and transition of AI/ML capabilities. Academic research responsibilities will focus on advancing methods, tools, practices, and evaluation approaches that enable rapid, rigorous, and operationally relevant performance assessment of AI, while working closely with government and industry collaborators responsible for development, prototyping, and deployment. The position operates within a dynamic research ecosystem involving multiple universities, government and industry collaborators, and academic students operating in collaborative on‑site and distributed environments. Multiple project teams may operate concurrently, often within short execution timelines ( As a member of VTNSI’s research faculty, the individual will contribute to strengthening institutional capabilities in AI Test & Evaluation, AI Assurance, digital engineering, and mission engineering, while supporting growth of a sustainable research portfolio aligned to sponsor priorities. Responsibilities include the following: Technical Leadership and Research Integration: Lead the development and integration of AI Test & Evaluation research activities by translating mission needs and operational constraints into actionable evaluation strategies, technical approaches, and research plans; coordinating multidisciplinary teams; and addressing performance, uncertainty, trustworthiness, and system considerations in mission‑relevant environments. Program Leadership and Portfolio Development: Manage an interdisciplinary research portfolio supporting rapid development, prototyping, T&E, and transition of AI‑enabled capabilities by establishing research priorities across multiple concurrent projects; aligning technical efforts with sponsor needs and institutional objectives; guiding proposal development; and contributing to sustainable growth of research programs aligned to national security priorities. Collaborative Research Environment Leadership: Coordinate collaborative research activities across government, academia, and industry partners by facilitating integration of technical efforts among rotating faculty experts, interdisciplinary researchers, and external collaborators; establishing effective teaming structures and workflows; and ensuring shared understanding of research objectives, evaluation approaches, and mission priorities across concurrent projects. Sponsor Engagement and Mission Alignment: Support sponsor engagement and research alignment activities by interacting with government partners to clarify mission needs and evaluation priorities; providing technical insight to inform research direction and execution approaches; and communicating research findings to technical and non‑technical stakeholders to strengthen alignment between research outputs and mission outcomes. Experiential Learning and Workforce Development: Contribute to workforce development through mentorship of students, postdoctoral researchers, and early‑career technical staff engaged in experiential learning activities; integrating students into interdisciplinary project teams; and supporting development of practical technical and professional skills aligned with rapid AI T&E and national security mission needs. Required Qualifications Doctoral degree in engineering, computer science, mathematics, statistics, operations research, or related technical discipline. Demonstrated experience in AI, ML, or data‑driven systems. Demonstrated experience in test & evaluation, experimentation, validation, verification, or performance assessment of complex systems. Experience leading or coordinating interdisciplinary technical teams. Experience contributing to externally sponsored research programs. Demonstrated ability to translate technical concepts into mission‑relevant research approaches. Strong communication skills. US citizenship and active secret clearance. Preferred Qualifications Experience evaluating AI‑enabled systems in operational or mission‑relevant environments. Experience serving as PI or co‑PI on externally sponsored research programs. Experience working across government, academia, and industry research environments. Experience in mission engineering, digital engineering, modeling and simulation, or systems engineering. Experience supporting rapid prototyping or iterative capability development environments. Experience mentoring interdisciplinary research teams. Experience developing research proposals and establishing sponsor partnerships. Active TS/SCI clearance. Overtime Status Not eligible for overtime Appointment Type Restricted Salary Information Starting at $150,000; commensurate with experience Hours per week 40 hours per week Review Date 9/23/26 Additional Information Must be a US citizen with an active secret clearance. Ability to obtain and maintain a clearance. The successful candidate will be required to have a criminal conviction check. About Virginia Tech Dedicated to its motto, Ut Prosim (That I May Serve), Virginia Tech pushes the boundaries of knowledge by taking a hands‑on, transdisciplinary approach to preparing scholars to be leaders and problem‑solvers. A comprehensive land‑grant institution that enhances the quality of life in Virginia and throughout the world, Virginia Tech is an inclusive community dedicated to knowledge, discovery, and creativity. The university offers more than 280 majors to a diverse enrollment of more than 36,000 undergraduate, graduate, and professional students in eight undergraduate colleges, a school of medicine, a veterinary medicine college, Graduate School, and Honors College. The university has a significant presence across Virginia, including Blacksburg, the greater Washington, D.C. area, the Health Sciences and Technology Campus in Roanoke, sites in Newport News and Richmond, and numerous Extension offices and research institutes. A leading global research institution, Virginia Tech conducts more than $650 million in research annually. Virginia Tech endorses and encourages participation in professional development opportunities and university shared governance. These valuable contributions to university shared governance provide important representation and perspective, along with opportunities for unique and impactful professional development. Virginia Tech does not discriminate against employees, students, or applicants on the basis of age, color, disability, sex (including pregnancy), gender, gender identity, gender expression, genetic information, ethnicity or national origin, political affiliation, race, religion, sexual orientation, or military status, or otherwise discriminate against employees or applicants who inquire about, discuss, or disclose their compensation or the compensation of other employees or applicants, or on any other basis protected by law. If you are an individual with a disability and desire an accommodation, please contact Lynn Byrd at View email address on click.appcast.io during regular business hours at least 10 business days prior to the event. #J-18808-Ljbffr Virginia Tech

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Professorial Open Rank, AI Test and Evaluation in Arlington, VA vacancy
  •  ...Virginia Tech's National Security Institute (VTNSI) seeks a Research Assistant Professor, Research Associate Professor, or Research Professor in Artificial Intelligence Test & Evaluation to lead AI/ML evaluation efforts for national security. The role requires coordinating... 
    Suggested

    Virginia Polytechnic Institute and State University (VT)

    Arlington, VA
    5 days ago
  • Virginia Tech's National Security Institute seeks a senior researcher to lead AI Test & Evaluation activities, guiding rapid development, prototyping, and transition of AI/ML capabilities for national security. The role blends technical leadership with program management... 
    Suggested

    Virginia Tech

    Arlington, VA
    5 days ago
  • ## Test and Evaluation (T&E) Research ProfessionalApply: Posted Today: JR104947# **Job Description Summary**Organization's Summary Statement: The Applied...  ...member shall retain the rights. Appointments to this rank are typically one to three years and are renewable. #J-18... 
    Suggested
    Interim role
    Work at office

    Usmd

    College Park, MD
    5 days ago
  •  ...Hope you are doing well. We have an open position for a Project Manager with our client. Pl. go through the below description...  ...and Responsibilities Project: Artificial Intelligence (AI) Testing, Evaluation, Validation, and Deployment Readiness Services Project Location... 
    Suggested
    Contract work
    For contractors
    Remote work

    Vinsys Information Technology Inc

    Falls Church, VA
    2 days ago
  • $25k

     ...information sharing, training, research, & technology. Visit Learn...  ...Help This is an Open Continuous Announcement (OCA)...  ...screening and subject to random drug test. Must display and maintain...  ...score 85 or better on established ranking criteria. You must provide a copy... 
    Suggested
    Permanent employment
    Temporary work
    Work at office
    Local area
    Relocation package

    Bureau of Alcohol, Tobacco, Firearms and Explosives

    Washington DC
    3 days ago
  • $113.35k - $277.49k

     ...Analyses (IDA) is seeking an experienced Research Analyst to join the Science, Systems, and...  ...participate in and eventually lead studies that evaluate system capabilities, assess performance...  ....ResponsibilitiesDesign and execute Test and Evaluation (T&E) frameworks to assess... 
    Flexible hours

    Institute for Defense Analyses

    Alexandria, VA
    2 days ago
  • $236k - $339.2k

     ...this new era, we seek AI-native thinkers across...  ...mindset — who rapidly test emerging capabilities to...  ....We are hiring a Staff Research Scientist, Physical AI...  ...data pipelines, and model evaluation infrastructureDrive research...  ...through publications, open-source releases, and... 

    Snowflake

    Washington DC
    a month ago
  • $236k - $339.2k

     ...this new era, we seek AI-native thinkers across...  ...mindset — who rapidly test emerging capabilities to...  ...MISSIONWe are seeking a Staff Research Scientist to serve as a...  ...Parallelism, SwiftKV), open-sourced and powering...  ...coordinationEstablish evaluation standards for... 
    Shift work

    Snowflake

    Washington DC
    a month ago
  • Program Manager for Test and Evaluation Infrastructure Projects Location: US-VA...  ...ID: 2025-10687. Application Open Date: 12/23/2025....  ...Incorporate DoW-approved Generative AI (GenAI) tools into daily workflows...  ...and more. EEO Scientific Research Corporation is an equal opportunity... 
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Local area
    Remote work

    Scientific Research Corporation

    Alexandria, VA
    2 days ago
  • $102.1k - $202.2k

     ...Less than 25%Profession: Research, Applied, & Data...  ...that leverage the latest AI technology while upholding...  ...and conducting thorough evaluation of those.Work with tech...  ...methodologies: Unit testing, Test Driven Development...  ...:This position will be open for a minimum of 5 days... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Washington DC
    a month ago
  • $229.9k - $262.4k

    ## Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)Applylocations: McLean, VA: San...  ...team of engineers, research scientists, technical program...  ...Capital One.* Design, develop, test, deploy, and support AI...  ...Leverage a broad stack of Open Source and SaaS AI technologies... 
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    16 hours ago
  • $146.6k - $183.25k

     ...AI Research Scientist - AI BioDesign The Allen Institute accelerates...  ...system work. We share our work openly so others can build on it,...  ...methodological innovation – designing, testing, and refining new AI/ML...  ..., the AI Research Scientist evaluates model performance,... 
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Work visa
    Relocation package

    Allen Institute

    Washington DC
    more than 2 months ago
  • $147k - $200k

     ...applications. STR is seeking a Maritime Test and Evaluation Director with a highly operational...  ...intensive system testing, including autonomy, AI/ML model validation, sensor fusion, or...  ...Denver, CO. We specialize in advanced research and development for defense,... 
    Full time
    Local area
    Night shift

    STR

    Arlington, VA
    11 days ago
  • $119.8k - $234.7k

     ...MicrosoftOverviewMicrosoft Research (MSR) is a...  ...Artificial Intelligence (AI) to impact economics, health...  ...workflows to design, build, evaluate, and ship software...  ...extensible, maintainable, well-tested, secure, and performant...  ...:This position will be open for a minimum of 5 days... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Washington DC
    a month ago
  • $167.8k - $209.7k

     ...AI Research Scientist II – Office of the CTO The Allen Institute accelerates...  ...work. We share our work openly so others can build on it,...  ..., disseminating, and evaluating AI/ML/computational methods for...  ...across the model lifecycle by testing and documenting best practices... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Work visa
    Relocation package

    Allen Institute

    Washington DC
    more than 2 months ago
  • Test Engineering Analyst (ML/AI Chatbot) We are seeking a Machine Learning, AI Chatbot Test Engineering Analyst to our client's team to drive...  ...model drift, hallucination detection, and bias evaluation. - Work closely with Product Owners, developers, Data Scientists... 
    Contract work
    Work at office

    Elite Technical

    Washington DC
    8 days ago
  • $340 per month

     ...three federally funded research and development centers...  ...to join the Operational Evaluation Division (OED). These...  ...agencies to independently test and evaluate military...  ...posting covers multiple openings in the following OED...  ..., space, software, and AI systems against realistic... 
    Local area

    Institute for Defense Analyses

    Alexandria, VA
    2 days ago
  • $159.75k - $255.6k

     ...skilled and innovative Senior AI Research Scientist to join a new team...  ...through model development, evaluation, deployment, and iteration...  ...inference workflows, evaluation and ranking optimization, agentic tool...  ...process. All legitimate job openings are listed on our official... 
    Work experience placement
    Work at office
    Remote work

    Axon

    Washington DC
    a month ago
  • $155k - $215k

     ...vision and deep learning through research and development and through...  ...collaborative projects that build on our open source software platforms,...  ...and participate in live field tests and demonstrations. Much of...  ...use artificial intelligence (AI) tools to support parts of the... 
    Full time
    Contract work
    Temporary work
    Worldwide
    Flexible hours

    Kitware

    Arlington, VA
    4 days ago
  • $77.6k - $176k

    Operations Research Systems Analyst, SeniorThe Opportunity: With all the information available...  ...to use those skills to support AI governance.As an intelligence analyst on...  ...team, you’ll help your client understand testing and evaluation of AI systems. Using your comprehensive... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work
    Shift work

    Booz Allen Hamilton

    Washington DC
    4 days ago
  •  ...applications for a tenure-track Professor of Product Design, Open Rank. We seek a practitioner-scholar whose work bridges human-centered...  ...students through the full design process, from ideation, research, and prototyping to finished form, while emphasizing sustainable... 
    Full time
    Internship
    Work at office
    Immediate start
    Washington DC
    8 days ago
  • $262.5k - $299.6k

    Applied Researcher II (AI Foundations) Overview: At Capital One, we are creating trustworthy and...  ..., from design through training, evaluation, validation, and implementation. Engage...  ...Technical. You’re comfortable with open-source languages and are passionate about... 
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    McLean, VA
    5 days ago
  • $192k - $304.75k

    We are now looking for a Senior Research Engineer passionate about Generative AI inference. Are you excited to change the way people...  ...with research teams, engineers, and open-source community.What you will be doing:Design and evaluate routing policies for LLM traffic to... 
    Full time
    Remote work

    Nvidia

    Washington DC
    2 days ago
  •  ...products that inform program evaluation and public policy....  ...included studies in research methods in psychology or economics such as tests and measurements or business...  .... RPL candidates are ranked using Category Rating...  ...career very rewarding. Opens in a new windowLearn more... 
    Full time
    Part time
    Work experience placement
    Work at office
    Trial period
    Relocation package

    Commander, Navy Installations Command

    Washington DC
    1 day ago
  • $152.2k - $205.9k

     ...are seeking a Senior UX Researcher to re-imagine Amazon's...  ...latest machine learning and AI capabilities to help...  ...generative and evaluative user research on next-generation...  ..., surveys, usability testing, and heuristic...  ...that encourages speaking openly and candidly when issues... 
    Work experience placement
    Remote work
    Worldwide
    Flexible hours

    Amazon

    Washington DC
    2 days ago
  • $142.8k - $193.2k

    As part of the AWS Applied AI Solutions organization, we have a...  ...team tackles some of the hardest open problems at the intersection...  .... We combine frontier research with production-scale delivery...  .... You will design, train, and evaluate systems that reason over complex... 
    Worldwide
    Flexible hours

    Amazon

    Washington DC
    2 days ago
  • $105k - $145k

    OverviewWe are looking for an AI Evaluation Scientistto design and execute evaluation processes...  ...to develop evaluation metrics, build test harnesses, analyze model behavior, and support...  ...tools, frameworks, metrics, and research related to LLM assessment and generative... 
    Local area

    Steampunk

    McLean, VA
    1 day ago
  • $136k - $184k

     ...Partners to do business. The SPX AI Lab team is building the AI...  ...understand seller pain points, evaluate feature performance, and...  ...measurement frameworks, including A/B testing, quasi-experiments, and...  ...grounded in rigorous measurement.-- Research and experiment with new... 
    Flexible hours

    Amazon

    Washington DC
    a month ago
  •  ...Seeking a Senior Security Test & Evaluation Analyst with strong experience in security testing, vulnerability assessment, ethical hacking, and AI-enabled security testing. The ideal candidate will combine traditional security assessment expertise with hands-on experience... 
    Temporary work

    PB consulting

    Washington DC
    a month ago
  • $147.9k - $200.1k

     ...Nonprofit Business (NPO) is seeking a research industry expert and strategic...  ...customers with complex AI, model-building, and high-performance...  ...industry-wide presence that opens doors, shapes market...  ...influence active policy discussions Evaluate existing grants and... 
    Work experience placement
    Local area
    Flexible hours
    Day shift

    AmazonWebServices

    Arlington, VA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Professorial Open Rank, AI Test and Evaluation. Be the first to apply!