September 15-18,2020 ~ Virtual Symposium

ONLINE PROCEEDINGS and PRESENTATIONS

ITEA Annual Meeting – Pete Crump, GTRI

KEYNOTE ADDRESSES AND SPECIAL GUEST SPEAKERS

• Major General Maria Gervais – Director of the Synthetic Training Environment Cross-Functional Team, Army Futures Command
• Raymond O’Toole, PhD – Principal Deputy Director, Office of the Secretary of Defense – Director, Operational Test and Evaluation
• The Honorable Kevin M. Fahey – Assistant Secretary of Defense for Acquisition
• Mitch Crosswait, PhD – Deputy Director, Office of the Director of Operational Test and Evaluation, Office of the Secretary of Defense
• John Fitzgibbon – President, TEQ Games
• Greg Zacharias, PhD – Chief Scientist, DOT&E OSD
• Daniel Serfaty, PhD – Founder & CEO, Aptima
• George Rumford – Principal Deputy Director, Department of Defense, Test Resource Management Center
• James Wells – Acting Director, Test & Evaluation Division, Department of Homeland Security

SPECIAL PANELS

Test & Evaluation Leadership Panel

• Panel Chair: Dr. C. David Brown, CTEP, Chesapeake Systems Engineering
• Mike Knoll – Vice President, IT, FedEx
• James Wells – Acting Director, Test & Evaluation Division, Department of Homeland Security
• Robin Poston, PhD – Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
• Devin L. Cate – Director of Test & Evaluation, United States Air Force
• Cathy O’Carroll – Global Campaign Director, Integrated Test & Evaluation QinetiQ
• John Frederick – Federal Aviation Administration (FAA), Manager V&V Strategies & Practices Branch

Testing for Safety and Security Panel

• Panel Chair: Wayne Dumais, Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security
• Steve Rowson, PhD – Associate Professor, Department of Biomedical Engineering and Mechanics, Virginia Tech
• Christopher Mocella – Senior Science Officer, DHS, U.S. Customs & Border Protection, Laboratory and Scientific Division
• John Fitzgibbon – President, TEQ Games
• Mark Espenant – Centre for Security Science
• Bhargav Patel – Senior Technologist/Mechanical Engineer, Department of Homeland Security’s Science and Technology Directorate

T&E of Artificial Intelligence and Autonomy Panel

• Panel Chair: Darryl Ahner, P.E., PhD – Director, Scientific Test and Analysis Techniques Center of Excellence
• Bill Biggs – QinetiQ
• Jane Pinelis, PhD – Chief of the Test, Evaluation and Assessment Branch, Department of Defense Joint Artificial Intelligence Center (JAIC)
• David Tate, PhD – Institute for Defense Analysis
• Mark Gillenson – University of Memphis
• Jared Freeman – Chief Scientist, Corporate Fellow, APTIMA, Inc.
• Greg Zacharias, PhD – Chief Scientist, DOT&E OSD

Future of the T&E Workforce Panel

• Panel Chair:Terry Murphy – Deputy Director, Policy and Workforce Development, Department of Homeland Security (DHS), Office of Test and Evaluation
• Robin Poston, PhD – Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
• Darryl Ahner, P.E., PhD – Director, Scientific Test and Analysis Techniques Center of Excellence
• Laura Freeman, PhD – Director, Intelligent System Lab, Virginia Tech Hume Center
• Kenneth Stefanek – Learning Director for Test and Evaluation Defense Acquisition University (DAU)
• Anne Sparrenberger – Former Executive, FedEx
• Timothy Sienrukos – Test Director, Network Communications Branch, Federal Aviation Adminsitration

Integrating T&E with Agile Development Panel

• Panel Chair: Robin Poston, PhD, Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
• Wayne Dumais – Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security
• Mike Knoll – Vice President, IT, FedEx
• Antonia Pulley – IT Specialist
• Dean Ptaszynski – Managing Partner, Agile Leadership Consulting
• Naveen Kumar, PhD – Faculty Member, University of Oklahoma, Management Information Systems Division

Future of T&E Panel

• Panel Chair: Eileen Bjorkman, Executive Director, Air Force Test Center, Edwards AFB
• Cathy O’Carroll – Global Campaign Director, Integrated Test & Evaluation, QinetiQ
• Libby Vallance-Bull – Head of Air Labs, BAE Systems
• Mark Gillenson, PhD – University of Memphis
• Devin Cate – Director of Test & Evaluation, United States Air Force
• Terry Murphy – Deputy Director, Policy and Workforce Development, Department of Homeland Security (DHS), Office of Test and Evaluation

ITEA AWARDS 

TECHNICAL  SESSIONS

Testing for Subterranean Tunnels

• Lessons Learned to Address Subterranean Testing Challenges: Unknown Equipment Performance, Unknown Targets, Unknown Environments – Miriam Wallace, Systems Engineer, U.S. Customs and Border Protection
• Evaluating on the Southwest Border – Steve Jones, Principal Systems Engineer, KaDSci and Wayne Dumais, Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security
• Geophysical and Operational System Performance Tool for the Detection of Clandestine Tunnels – Weiqun Shi, PhD, Principal Sensor Systems Engineer, MITRE
• Subterranean T&E Infrastructure, Wayne Dumais, Deputy Director, Immigration and Border Security Programs, Office of Test & Evaluation, Science & Technology Directorate, Department of Homeland Security

Advanced Instrumentation

• Leveraging Commercial Cellular for Operational Testing – Robert Carpenter, Lead Engineer, General Dynamics Mission Systems
• JASA – Connecting the (Test) Battlespace – Jonathon Skarphol, Mission Systems Architect & Thomas (Ted) Dempsey, Corporate Large Account Manager, Collins Aerospace
• Signal Noise and SNR in Test Planning – Aaron Ramert, Scientific Test and Analysis Techniques Center of Excellence (STAT COE), AFIT, USAF
• Digital Twins and Digital Threads in Defence Through the Lens of T&E – Christophe Harvey, QinetiQ

Autonomous Systems DT / Future Ranges

• Enabling Effective T&E of Autonomous Systems using M&S – Paul Kwashnak, Senior Action Officer, Strategic Capabilities, U.S. Army Test and Evaluation Command, Directorate for Capabilities Integration (DCI)
• Overwater Impact Location (OWIL) – Josue DeJesus, Test Engineer 96th Test Wing, Test Systems Squadron
• Spectrum and Future Range – Arthur Deleon, Department of Navy (DON) Spectrum Relocation, Secretary of the Navy’s Office of the DON Chief Information Officer (CIO)

Model-Based T&E and Other Advancements

•  A Case Study on the Evaluation of Algorithms for Declaring the Presence of Anomalous Aerosol Signals Indicative of a Potential Terrorist Attack – Alex McBride, Statistician for the Scientific Test and Analysis Techniques Center of Excellence (STAT COE), Alion Science and Technology; Kyle Kolsti, PhD, Retired, U.S. Air Force; Nicholas Schan, Test Scientist U.S. Department of Homeland Security
• The Developmental Evaluation Framework and its Effect on T&E – Rick Thomas, Deputy Director for Space, Cyber, and Information Systems (SCIS) Office of the Director, Developmental Test and Evaluation
• Development and Analytic Process Used to Create a 3-Dimensional Graphical User InterfaceSystem for Baggage Screening – Kevin Zish, Human Factors Engineering, Department of Homeland Security, Global Systems Technologies; Simone McKnight, U.S. Department of Homeland Security; Charles “Chas” McKee, President and CEO Taverene Analytics LLC
• Model-Based Systems Engineering for T&E – Gary Honea, Raytheon Missiles and Defense

International T&E

• Joint Strike Missile Qualification Testing -Terry Alexander, Senior Consultant/ Joint Strike Missile Integration Team, Lone Star Aerospace
• UK T&E Technology Challenges Industry Day – Victoria Van Der Byl, Analyst UK Ministry of Defence’s (MOD) Defence Science and Technology Laboratory (Dstl)
• Operational Suitability: It’s Not Rocket Science, Why So Difficult? – Robert Wojciechowski, Technical Director, Readiness and Analytics Evaluation Directorate, U.S. Army Evaluation Center (AEC)
• HMS Queen Elizabeth Rotary Wing Trials – Neil Thomas, QinetiQ

STEP Reports on T&E Research #1

• Cyber-Security Testing for Hybrid Energy Storage System Located in Smart Grid – Dr. Mohd Hasan Ali, Department of Electrical & Computer Engineering and Dr. Sajjan Shiva, Department of Computer Science, The University of Memphis 
• Automated Assessment of The Quality of Jupyter Notebooks Using Artificial Intelligence and Big Code – Vasile Rus, Ph.D., Professor of Computer Science, The University of Memphis
• Developing a Vehicular Network Emulator to Bridge the Gap in Network Architecture and Application Testing – Lan Wang, PhD, Department of Computer Science, University of Memphis

Agile Methods

• Advancing a Defense DX Framework for the Modernization Age – Paul Kwashnak, Senior Action Officer, Strategic Capabilities, U.S. Army Test and Evaluation Command, Directorate for Capabilities Integration 
• Enhancing the T&E Process Through the Incorporation of Agile Dev, MBSE, and Test Automation – Joshua Walker, Senior Research Engineer Georgia Tech Research Institute (GTRI)
• Microservice Architecture Benefits to Test Systems – Robert Carpenter, Lead Engineer General Dynamics Mission Systems

Directed Energy / Hypersonics T&E

• Live Testing of LASER Systems; Safe Execution – Cedrick Reid, Missile Exercise Coordinator
  KBR
• Design of Experiments in Characterizing Hypersonic Flow on a Wind Tunnel Model – A Case Study – Gina Sigler, Senior Statistician Scientific Test and Analysis Techniques Center of Excellence (STAT COE)
• Advanced Weapons Effects Test Capability (AWETC) – Brooke Ezell, Program Manager, Small Business Innovative Research (SBIR) 96th Test Systems Squadron, U.S. Air Force

LVC T&E

• The Need for Simulation Software ‘Technology Readiness Levels’ (TRLs) in the Development of Simulation Software for Training Test and Evaluation Systems – Kent Pickett, Senior Simulation Engineer, MITRE Corporation; Gil Torres, Deputy Director, Business Development, Naval Air Warfare Center (NAVAIR) Weapons Division; Michael Sheehan, PhD,Department Head, Defense Enterprise Capability MITRE’s National Security Sector
• Overcoming the Challenges of Distributed Test & Evaluation – Gene Hudgins, Director of Test & Training Environments, KBR

Cyber Security T&E

• Cyber T&E Tools: I’ll Show You Mine if You’ll Show Me Yours; A Realm of Possibility -Paola Pringle, Systems Engineer & Henry (Hank) Steinfeld, Naval Air Warfare Center, Weapons Division
• Hacking Methods and Their Effects – Paola Pringle, Systems Engineer Naval Air Warfare Center, Weapons Division

STEP Reports on T&E Research #2

• Testing AI Transparency Features: A Factoral Experimental Design – Huigang Liang, PhD, Department of Computer Science; Nirmalee Raddatz, & PhD; Yinan Yu, Ph.D, University of Memphis 
• DevSecOps Automated Security Testing Framework: Opportunities & Barriers – Robin Poston, PhD – Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis and Naveen Kumar, PhD – Faculty Member, University of Oklahoma, Management Information Systems (MIS) Division 
• Testing Machine Learning Algorithms with Consistent Explanations – Sajjan Shiva, PhD & Deepak Venugopal, PhD Computer Science Department, University of Memphis