37th International Test and Evaluation Symposium Proceedings (2020)

37th International Test and Evaluation Symposium Proceedings (2020)

September 15-18,2020 ~ Virtual Symposium

ONLINE PROCEEDINGS and PRESENTATIONS


ITEA Annual Meeting – Pete Crump, GTRI


KEYNOTE ADDRESSES AND SPECIAL GUEST SPEAKERS


SPECIAL PANELS

Test & Evaluation Leadership Panel

  • Panel Chair: Dr. C. David Brown, CTEP, Chesapeake Systems Engineering
  • Mike Knoll – Vice President, IT, FedEx
  • James Wells – Acting Director, Test & Evaluation Division, Department of Homeland Security
  • Robin Poston, PhD – Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
  • Devin L. Cate – Director of Test & Evaluation, United States Air Force
  • Cathy O’Carroll – Global Campaign Director, Integrated Test & Evaluation QinetiQ
  • John Frederick – Federal Aviation Administration (FAA), Manager V&V Strategies & Practices Branch

Testing for Safety and Security Panel

  • Panel Chair: Wayne Dumais, Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security
  • Steve Rowson, PhD – Associate Professor, Department of Biomedical Engineering and Mechanics, Virginia Tech
  • Christopher Mocella – Senior Science Officer, DHS, U.S. Customs & Border Protection, Laboratory and Scientific Division
  • John Fitzgibbon – President, TEQ Games
  • Mark Espenant – Centre for Security Science
  • Bhargav Patel – Senior Technologist/Mechanical Engineer, Department of Homeland Security’s Science and Technology Directorate

T&E of Artificial Intelligence and Autonomy Panel

  • Panel Chair: Darryl Ahner, P.E., PhD – Director, Scientific Test and Analysis Techniques Center of Excellence
  • Bill Biggs – QinetiQ
  • Jane Pinelis, PhD – Chief of the Test, Evaluation and Assessment Branch, Department of Defense Joint Artificial Intelligence Center (JAIC)
  • David Tate, PhD – Institute for Defense Analysis
  • Mark Gillenson – University of Memphis
  • Jared Freeman – Chief Scientist, Corporate Fellow, APTIMA, Inc.
  • Greg Zacharias, PhD – Chief Scientist, DOT&E OSD

Future of the T&E Workforce Panel

  • Panel Chair:Terry Murphy – Deputy Director, Policy and Workforce Development, Department of Homeland Security (DHS), Office of Test and Evaluation
  • Robin Poston, PhD – Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
  • Darryl Ahner, P.E., PhD – Director, Scientific Test and Analysis Techniques Center of Excellence
  • Laura Freeman, PhD – Director, Intelligent System Lab, Virginia Tech Hume Center
  • Kenneth Stefanek – Learning Director for Test and Evaluation Defense Acquisition University (DAU)
  • Anne Sparrenberger – Former Executive, FedEx
  • Timothy Sienrukos – Test Director, Network Communications Branch, Federal Aviation Adminsitration

Integrating T&E with Agile Development Panel

  • Panel Chair: Robin Poston, PhD, Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
  • Wayne Dumais – Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security
  • Mike Knoll – Vice President, IT, FedEx
  • Antonia Pulley – IT Specialist
  • Dean Ptaszynski – Managing Partner, Agile Leadership Consulting
  • Naveen Kumar, PhD – Faculty Member, University of Oklahoma, Management Information Systems Division

Future of T&E Panel

  • Panel Chair: Eileen Bjorkman, Executive Director, Air Force Test Center, Edwards AFB
  • Cathy O’Carroll – Global Campaign Director, Integrated Test & Evaluation, QinetiQ
  • Libby Vallance-Bull – Head of Air Labs, BAE Systems
  • Mark Gillenson, PhD – University of Memphis
  • Devin Cate – Director of Test & Evaluation, United States Air Force
  • Terry Murphy – Deputy Director, Policy and Workforce Development, Department of Homeland Security (DHS), Office of Test and Evaluation

ITEA AWARDS 


TECHNICAL  SESSIONS

Testing for Subterranean Tunnels

  • Lessons Learned to Address Subterranean Testing Challenges: Unknown Equipment Performance, Unknown Targets, Unknown Environments – Miriam Wallace, Systems Engineer, U.S. Customs and Border Protection
  • Evaluating on the Southwest Border – Steve Jones, Principal Systems Engineer, KaDSci and Wayne Dumais, Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security
  • Geophysical and Operational System Performance Tool for the Detection of Clandestine Tunnels – Weiqun Shi, PhD, Principal Sensor Systems Engineer, MITRE
  • Subterranean T&E Infrastructure, Wayne Dumais, Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security

Advanced Instrumentation

Autonomous Systems DT / Future Ranges

  • Enabling Effective T&E of Autonomous Systems using M&S – Paul Kwashnak, Senior Action Officer, Strategic Capabilities, U.S. Army Test and Evaluation Command, Directorate for Capabilities Integration (DCI)
  • Oal-MS-and-Safety-Enabled-Testingverwater Impact Location (OWIL) – Josue DeJesus, Test Engineer 96th Test Wing, Test Systems Squadron
  • Spectrum and Future Range – Arthur Deleon, Department of Navy (DON) Spectrum Relocation, Secretary of the Navy’s Office of the DON Chief Information Officer (CIO)

Model-Based T&E and Other Advancements

International T&E

STEP Reports on T&E Research #1

Agile Methods

Directed Energy / Hypersonics T&E

  • Live Testing of LASER Systems; Safe Execution – Cedrick Reid, Missile Exercise Coordinator
    KBR
  • Design of Experiments in Characterizing Hypersonic Flow on a Wind Tunnel Model – A Case Study – Gina Sigler, Senior Statistician Scientific Test and Analysis Techniques Center of Excellence (STAT COE)
  • Advanced Weapons Effects Test Capability (AWETC) – Brooke Ezell, Program Manager, Small Business Innovative Research (SBIR) 96th Test Systems Squadron, U.S. Air Force

LVC T&E

Cyber Security T&E

  • Cyber T&E Tools: I’ll Show You Mine if You’ll Show Me Yours; A Realm of Possibility -Paola Pringle, Systems Engineer & Henry (Hank) Steinfeld, Naval Air Warfare Center, Weapons Division
  • Hacking Methods and Their Effects – Paola Pringle, Systems Engineer Naval Air Warfare Center, Weapons Division

STEP Reports on T&E Research #2

  • Testing AI Transparency Features: A Factoral Experimental Design – Huigang Liang, PhD, Department of Computer Science; Nirmalee Raddatz, & PhD; Yinan Yu, Ph.D, University of Memphis 
  • DevSecOps Automated Security Testing Framework: Opportunities & Barriers – Robin Poston, PhD – Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis and Naveen Kumar, PhD – Faculty Member, University of Oklahoma, Management Information Systems (MIS) Division 
  • Testing Machine Learning Algorithms with Consistent Explanations – Sajjan Shiva, PhD & Deepak Venugopal, PhD Computer Science Department, University of Memphis