Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Research Scientist (Test & Evaluation)

$118k - $150k

Cognitive Performance Group

CPG’s mission is to apply science to improve and support decision-making and complex cognitive performance for individuals and teams. We do that by conducting studies and co-developing products that model, measure, train, and support decision-making and cognitive performance in complex, time-pressured, high-risk, uncertain, and dynamic operating environments. We specialize in military contexts and we solve novel problems for Warfighters with our cutting-edge techniques and scientific rigor. We are a dedicated, multi-disciplinary team of applied researchers, trainers, technologists, veterans, and military subject-matter experts who work closely and collaboratively with our partners, clients, stakeholders, and the end users we serve. Role Description Cognitive Performance Group (CPG) is seeking a full-time professional to join our team as an applied senior scientist specializing in human performance measurement in field test and evaluation contexts. The individual must be able to travel up to 50% of the time, work 10-14 hour days while on travel, and be willing to take their turn working overnight shifts during field events. The individual selected for this position will work on an inter-disciplinary team performing applied research on and evaluations of human-machine team (HMT) performance, human computer interaction, and user experience with systems and interfaces, primarily in military force-on-force or other test and exercise events. The ideal candidate for this position is a flexible problem-solver with 10+ years of experience conducting field-based research, development, test, and evaluation (RDT&E) on HMTs in military or in similarly complex, dynamic settings. We will consider candidates with equivalent years of professional experience conducting military training exercises and events. A proven record of advocating for end users’ requirements is a must. The ideal candidate thrives in dynamic environments where highly motivated teams detect and solve problems in stride, under time pressure, for highly visible programmatic work where their inputs result in meaningful new capabilities for our Nation’s Warfighters. Scope of Work & Responsibilities Develop and refine quantitative and qualitative metrics to measure HMT test objective(s). Develop and refine mixed methods collection tools and processes as the complexity and scale of the testing events increase. Develop and refine mixed methods visualizations of HMT performance. (Re-)design or (re-)organize the testing environment with stakeholders for each event; identify and resolve challenges to test rigor in stride. Collect or oversee the collection of HMT performance data through observations, surveys, interviews, focus groups, and other methods. Write test plans, daily reports, and final reports as well as support after action reviews with stakeholders at events. Oversee a team of researchers and software engineers responsible for execution of test plans and analysis of mixed method, multi-source test data. Represent the CPG team’s contributions to partners, stakeholders, and customers. Support the mission of the organization through knowledge sharing and collaboration. Required Qualifications Education and Professional Experience Minimum of a Master’s degree from an accredited institution in an applied social science discipline such as Human Computer Interaction, Industrial/Organizational Psychology, Human Factors Engineering, Educational Psychology, Cognitive Science, or Experimental Psychology; a learning and development discipline such as Modeling & Simulation; or a related field. 10+ years of combined professional experience in the Department of Defense as an active duty service member, Government civilian, or employee of a contractor. Applied Research Experience Proven ability to lead projects and remote teams, including budget and schedule management, quality control, and customer relations. Proven ability to conceptualize and develop new projects or programs of research that address customer and user community requirements. Strong research, analysis, and synthesis skills. Exceptional problem-finding and creative problem-solving skills. Functional understanding of statistics and data analysis methods and tools. Proven record of published writing and/or public speaking to a professional audience. Experience with two or more of the following: Uncrewed, autonomous, or semi-autonomous systems Operations Research/Systems Analysis Cognitive Task Analysis or similar qualitative analysis method Quantitative analysis Metrics and assessment instrument development Sociotechnical system analysis Design of learning tools or systems Talent management Job analysis Interest in conducting tests and evaluations for the Department of Defense that directly support Collaboration and Communication Experience collaborating with multi-disciplinary teams made up of researchers, engineers, technologists, subject-matter experts, end users, and other stakeholders on research and product development. Ability to work effectively as a team and independently in a virtual environment. Strong written, verbal, and interpersonal communication skills. Ability to coach and mentor junior staff members. Travel Requirements Must be willing and able to travel up to 40-50% of the time, including weekends, on trips ranging from 5 to 21 days. The travel requirement is expected to be two 3-week events per year, plus shorter travel engagements of up to 1 week each for planning meetings prior to the events. Must be willing to work 10- to 14-hour days while on travel for up to 21 consecutive days. Overtime is compensated. Recovery time following travel days is highly encouraged. Must be willing to work overnight shifts while on travel, if needed. Other Proficiency with Microsoft Office products, especially SharePoint, Teams, Word, PowerPoint, and Excel. Must possess an active security clearance. Preferred Qualifications PhD from an accredited institution in an applied social science discipline such as Human Computer Interaction, Industrial/Organizational Psychology, Human Factors Engineering, Educational Psychology, Cognitive Science, or Experimental Psychology; a learning and development discipline such as Modeling & Simulation; or a related field. Service in or research experience with the U.S. military. Experience working with one or more of the following organizations: Army Research Institute; Army Research Laboratory; Air Force Research Laboratory; Office of Naval Research; Naval Air Warfare Center Training Systems Division; Marine Corps Training and Education Command; or similar military organization. Experience with uncrewed, autonomous, or semi-autonomous systems. Job Classification: Full-time, 40 hours per week Start Date: 1 Jan 2027 Compensation: $118,000 - $150,000 Post Date: 30 Oct 2026 Security Clearance: US citizenship required. Active SECRET clearance or higher required. Closing Date: When filled Location: Remote. Up to 50% travel required (including international) #J-18808-Ljbffr Cognitive Performance Group

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Research Scientist (Test & Evaluation) in New York, NY vacancy
  • $295k

     ...the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about...  ...Francisco, Montreal, Paris, Berlin and Seoul. Join us!Role Overview:Evaluation is critical to making progress in scaling intelligence. As... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    1 day ago
  •  ...our customers. Cohere is a team of researchers, engineers, designers, and more, who...  ...and shape the future! Why this role?Evaluation is critical to making progress in scaling...  ...to measure LLM progress. As a Senior Research Scientist, Model Evaluation, you will: Create... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    New York, NY
    8 days ago
  • $235k - $300k

    Project/Division : AI, Applied Research Start date : As soon as...  ...Role SecureBio is hiring a Senior Research Scientist to work on our safety...  ...frontier AI developers. You will evaluate models for dual-use...  ...you to complete a short work test, and invite you to a screening... 
    Senior
    Full time
    Work at office
    Immediate start
    Remote work
    Overseas
    Flexible hours
    Shift work

    SecureBio, LLC

    New York, NY
    5 days ago
  • $130k - $150k

     ...Job You don't have to be a scientist to be part of the science....  ...Overview: Wonderlic is seeking a Senior Research Scientist to sit at the...  ..., and evidence-based evaluation standards - to every system...  ...error analysis, regression testing, and evaluation of LLM-generated... 
    Senior
    Full time
    Work at office
    Remote work

    Wonderlic

    New York, NY
    14 days ago
  • Geocomp, Inc. in Elmsford, NY is seeking a Senior Laboratory Technician to join our Soil Testing Laboratory. You will perform soil testing on state-of-the-art equipment, collect data, and report results to support site characterization and geotechnical design. Ideal candidates... 
    Senior

    Geocomp Solutions Inc.

    New York, NY
    14 minutes ago
  •  ...office. The Consumer Science & Product Research consultant will establish and lead the creation...  ...strategy, segmentation, communications testing, or market assessment. Instead, it...  ...approaches for understanding how consumers use, evaluate, and experience product performance... 
    Senior
    Remote job
    Permanent employment
    Full time
    Work at office

    Spectrum Brands

    New York, NY
    2 days ago
  • $183.8k - $248.7k

     ...We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols...  ...designing how we measure, stress-test, and improve robot behavior across...  ...'s degree and 6+ years of applied research experience - Experience in patents... 
    Senior
    Flexible hours

    Amazon

    New York, NY
    2 days ago
  • $119.8k - $234.7k

     ...Senior Applied ScientistDo you want to be part of a...  ...organization.As a Senior Applied Scientist, you will work with...  ...applied research that improves retrieval...  ...and agent experiences. Evaluate advances in information...  ...identify quality gaps, test hypotheses, understand... 
    Senior
    Ongoing contract
    Local area

    Microsoft Corporation

    New York, NY
    1 day ago
  • $183.8k - $248.7k

     ...Description We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection...  ...designing how we measure, stress-test, and improve robot behavior across...  ...'s degree and 6+ years of applied research experience Experience programming... 
    Senior
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  •  ...We're Hiring: Senior Research Scientist | LLMs, Conversational AI & Applied Machine LearningHit Apply below to send your application for consideration...  ...novel ML approaches, predictive models, and advanced evaluation methodologies.Taking research from initial hypothesis and... 
    Senior

    Alexander Chapman

    New York, NY
    4 days ago
  • $62.75k - $104.5k

     ...foundation of our code of ethics. Arbor Research expects all employees to embody and...  ...per week* Position Summary The Senior Research Scientist provides scientific leadership and methodological...  ...of health services research, program evaluation, and applied research initiatives... 
    Senior
    Remote work
    Night shift

    Arbor Research Collaborative for Health

    New York, NY
    4 days ago
  • $190k - $245k

     ...Senior Research ScientistSee yourself at Dataminr As a Senior Research Scientist at Dataminr, you will tackle some of the toughest AI problems in real time threat and risk...  ...LLM training and adaptation, distillation, evaluation and benchmarking, agentic systems, retrieval... 
    Senior
    Work at office
    Flexible hours

    IVP

    New York, NY
    1 day ago
  • $200k - $320k

     ...to strengthen our expansive research team. We are looking for candidates...  ...physicists, and computer scientists—who are passionate about...  ...large data, and more. As a Senior Research Scientist you will...  ...prototypes, run large‑scale evaluations, and drive the project through... 
    Senior
    Work at office
    Local area
    Relocation

    EliseAI

    New York, NY
    3 days ago
  • $65k - $120k

     ...thousands of physicians and scientists who have helped to shape the...  ...medical education, scientific research, and direct patient care. At...  ...opportunity to join our team as a Senior Research Scientist within the...  ...patient-centered data for evaluation of interventions and characteristics... 
    Senior
    Full time

    NYU Langone Health

    New York, NY
    3 days ago
  •  ...growth marketers, is seeking a Senior Marketing Scientist to drive the rigor,...  ...Design (Incrementality/Geo-Testing)—to help high-growth brands...  ...curves. Design, execute, and evaluate incrementality frameworks,...  ...forefront of marketing science research, continually testing new... 
    Senior

    Mile Marker

    New York, NY
    9 days ago
  • $166.98k - $220.66k

     ...Senior Computational Biologist - Early Discovery Oncology New...  ...with biologists, chemists, data scientists, platform and data engineers,...  ...Drive target discovery: Evaluate the molecular evidence for target...  ...from doing. We experiment, test, and refine, embracing iteration... 
    Senior
    Work at office

    Recursion Pharmaceuticals

    New York, NY
    5 days ago
  •  ...one that has prior worked on network engineering designs and testing plus evaluated products within a network lab This is NOT a simple...  ...Kubernetes and modern cloud architecture Experience: ~ Senior level, experienced, can lead projects and work independently... 
    Senior
    Full time
    Night shift

    ApTask

    New York, NY
    1 day ago
  •  ...Pennsylvania, Department of Microbiology, in Pennsylvania, is seeking a Research Associate with postdoctoral experience in mRNA biochemistry,...  ...grant-funded programme, performing advanced experiments, and evaluating vaccine-induced cellular and humoral responses in vivo. #J-18... 
    Senior

    Laplace Expert Ltd

    New York, NY
    5 days ago
  • Innodata Inc. is hiring a Research Scientist to own the science behind video evaluation for multimodal models. You will partner with customers and frontier labs to design data specifications, annotation schemas, and evaluation criteria. You will run experiments proving... 
    Senior

    Innodata Inc.

    New York, NY
    3 days ago
  • $174k - $252k

    Author research papers to share and generate impact of research results across function and...  ...data structure, framework, design, and evaluation metrics for research solution...  ...influencing other researchers. As a Research Scientist on the Graph Neural Network (GNN) team within... 
    Senior

    Google

    New York, NY
    2 hours ago
  • $207k - $300k

     ...current agent capabilities and establish research roadmaps and technical strategies to...  ...them.Mentor, guide, and elevate junior scientists and engineers, fostering a culture of technical...  ...Scientist, you'll setup large-scale tests and deploy promising ideas quickly and broadly... 
    Senior

    Google

    New York, NY
    2 days ago
  • $120k - $140k

     Research --> Basic Science/TechnicalNew York • ID: 1165673...  ...thousands of physicians and scientists who have helped to shape the...  ...opportunity to join our team as a Senior Research Scientist. The New...  ..., health services research, evaluation, biostatistics, and medical ethics... 
    Senior
    Full time

    NYU Langone Medical Center

    New York, NY
    1 day ago
  • $192k - $304.75k

     ...computing. Today, we are building software, systems, and research platforms that help scientists and engineers solve problems that were once out of...  ...precision algorithms, and sparse direct/iterative hybrids.Evaluate algorithms on workloads in mechanics, contact, thermal-... 
    Senior
    Full time
    Remote work

    Nvidia

    New York, NY
    1 day ago
  • $166.98k - $220.66k

     ...partner with biologists, chemists, data scientists, platform and data engineers, and translational...  ...will: Drive Target Discovery: Evaluate the molecular evidence for target...  ...Progress comes from doing. We experiment, test, and refine, embracing iteration over... 
    Senior
    Work at office
    Local area

    RECURSION CO

    New York, NY
    4 days ago
  • $134.5k - $265.1k

     ...currently seeking an experienced SeniorQuantum Research Scientist -- Fault Tolerant Quantum Computing to...  ...our quantum computing offering. As a Senior Research Scientist within the Research...  ...quantum software and research tools.Evaluate quantum approaches against relevant... 
    Senior
    Local area

    Deloitte

    New York, NY
    1 day ago
  •  ...Description: As a Senior AI Research Scientist, you will bridge cutting-edge AI research with production engineering to build intelligent systems...  ...architecture through implementation, deployment, evaluation, and continuous iteration. Build AI agents capable of... 
    Senior

    CTW

    New York, NY
    a month ago
  • $134.5k - $265.1k

     ...firm offering? We are currently seeking an experienced Senior Applied Research Scientist - Tensor Networks to help deliver advanced computational...  ...methods, and translate research into capabilities that can be evaluated and used. Work with national security and domain... 
    Senior
    Local area

    Deloitte

    New York, NY
    1 day ago
  • $169.16k - $241.65k

     ...Data, Research & Insights Permanent New York he Personalization team makes deciding...  ...-the-art deep learning methods and evaluation techniques, highly efficient data...  ...voice talent pool. We're looking for a senior applied research scientist with experience in developing novel... 
    Senior
    Permanent employment
    Full time
    Work from home
    Flexible hours

    Spotify

    New York, NY
    8 days ago
  • $165k - $180k

     ...South Africa, and Zambia. The Senior Medical Scientist will provide technical...  ...leadership to develop and test innovative approaches to improve...  ...in clinical/technical research and technical evidence dissemination...  ...experience with evaluation of quality in clinical care... 
    Senior
    Remote work

    Ipas

    New York, NY
    2 days ago
  • Economist Trainee*, NS, or Senior Economist (NY HELPS)- NYC For appointment...  ..., mathematics, operations research, research methods, or...  ...prepare reports; and designing and evaluating long-term simulations and...  ..., estimation and testing of structural and time series... 
    Senior
    Traineeship
    Work at office

    Southern Arkansas University

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Research Scientist (Test & Evaluation). Be the first to apply!