September 13-17,2021 ~ Virtual Symposium

ONLINE PROCEEDINGS and PRESENTATIONS

** Mp4 Video’s are too large to upload. If you would like a copy of the MP4 for a keynote or panel please contact Lena@itea.org

ITEA Annual Meeting – Pete Crump, GTRI

KEYNOTE ADDRESSES AND SPECIAL GUEST SPEAKERS

• Raymond O’Toole, PhD, Director (acting) and Principal Deputy to the Director of Operational Test & Evaluation, Office of the Secretary of Defense
• Dana (Keoki) Jackson, PhD, Senior Vice President, General Manager, MITRE National Security
• Kyle Fox, Executive Director, Systems Integration & Test, Raytheon Missiles & Defense
• Shimon Fhima, Director Strategic Programmes, UK Ministry of Defence
• Lieutenant Colonel Matthew Wroten, Deputy Director of USSF Test and Evaluation, Peterson Space Force Base 
• Devin Cate, Director of Test & Evaluation, USAF
• Carroll “Rick” Quade, Director, Navy Innovation, Technology Requirements and Test and Evaluation, Department of the Navy
• James Cooke, Director, U.S. Army Test and Evaluation
• Neal MacKertich, PhD, Principal Engineering Fellow, Raytheon Missiles & Defense (retired)
• Michael Schmidt, PhD, Vice President, Master Builders Solutions
• James Wells – Acting Director, Test & Evaluation Division, Department of Homeland Security

SPECIAL PANELS

Test & Resource Perspective on Emerging Technologies Panel

• Panel Chair: James Wells, Acting Director, Test & Evaluation Division, Department of Homeland Security
• Raymond O’Toole, PhD, Principal Deputy Director, Office of the Secretary of Defense – Director, Operational Test and Evaluation
• George Rumford, Director (acting) and Principal Deputy, Test Resource Management
• Malcolm G. Tutty, PhD, Australian Defence Force Academy, ITEA Southern Cross Chapter – Australia

T&E for AI/ML Enabled Systems

• Panel Chair: Jane Pinelis, PhD, Chief of the Test, Evaluation and Assessment Branch, Department of Defense Joint Artificial Intelligence Center
• Alec Banks, Senior Principal Scientist, Defence Science and Technology Labs
• Chad Bieber, Senior Research Engineer, Johns Hopkins University Applied Research Lab, Department of Defense Joint Artificial Intelligence Center
• Laura Freeman, PhD, Director, Intelligent System Lab, Virginia Tech Hume Center
• John Haman, Statistician, Institute for Defense Analyses
• Galen Mullins, PhD, Senior AI Researcher, Johns Hopkins University Applied Research Lab

The Past is Prologue: A Panel of Past Presidents

• Patricia Sanders, PhD, Independent Aerospace Consultant
• John Foulkes, Consultant
• Rusty Roberts, Georgia Tech Research Institute (GTRI)
• Stephanie Clewer, Systems Application & Technologies, Inc. (SA-TECH)
• Mark Brown, PhD, Vice President, Scientific Research Corporation
• Chas McKee, President and CEO, Taverene Analytics LLC
• Gene Hudgins, Director of Test and Training Environments, KBR
• Bill Keegan, Executive Vice President, Equator Corporation
• Pete Crump, Georgia Tech Research Institute (GTRI)

Digital Engineering Panel

• Panel Chair: Edward Kraft, PhD
• Darryl Ahner, P.E., PhD – Director, Scientific Test and Analysis Techniques Center of Excellence
• COL (R) Rick Bailer, Consultant
• Tom Downs, Manager, Engineering, Weapon Systems, GD-OTS Armaments and Energetics Business Unit
• Kevin Fahey, President and CEO, Cypress International
• Camille Robbins, Director, Virtual Test and Advanced Electronics Directorate, ATC

T&E Workforce Panel

• Panel Chair:Terry Murphy – Deputy Director, Policy and Workforce Development, Department of Homeland Security (DHS), Office of Test and Evaluation
• Robin Poston, PhD – Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
• Darryl Ahner, P.E., PhD – Director, Scientific Test and Analysis Techniques Center of Excellence
• Laura Freeman, PhD – Director, Intelligent System Lab, Virginia Tech Hume Center
• Kenneth Stefanek – Learning Director for Test and Evaluation Defense Acquisition University (DAU)
• Pete Christensen, Consultant

T&E Integrated Into Agile and DevSecOps

• Panel Chair: Robin Poston, PhD, Director of the System Testing Excellence Program, FedEx Institute of Technology, The University of Memphis
• Tom Meservy, PhD, Associate Professor of Information Systems, Brigham Young University
• Mike Knoll – Vice President, IT, FedEx
• Antonia Pulley – IT Specialist, Department of Homeland Security, U.S. Citizenship Immigration Services
• John Stasulli, Senior Director, Missile Defense & C5ISR, Parsons Corp

ITEA AWARDS 

TECHNICAL  SESSIONS

Visual Analytics

• Using Natural Language Processing to Construct a Knowledge Graph of Test Incident Reports – Sagar Indurkhya, PhD, Hector Vazquez, Aakash Indurkhya, Ciro Donalek, Virtualitics, Inc.
• SyncVis, a Framework for 2D and 3D Visual Analytics – Simon Su, PhD, and Vincent Perry, ARL DSRC; Olena Tkachenko, GDIT; Michael An, Parsons
• Integrating Machine Learning and Interactive Visualizations for Heterogeneous T&E Data Analysis -Mariya Occorso and Vincent Perry, ARL DSRC 

Cyber-Physical Systems Testing

• Assurance Cases as a Grand Unified Theory of Weapon Systems and Platform Cyber Risk– Bill “Data” Bryant, PhD, MTSI
• Cyber Test and Evaluation for Supply Chain Risk Management – Sarah Standard, OUSD R&E, Developmental Test, Evaluation, and Assessments
• Cyber Testing Networks Over Their Entire Life Cycle in a Digital Twin Environment-Charles D. Burdick & Deepinder Sidhu, PhD, Cyberspace Analytics Corp.

Future of T&E and Cybersecurity – Current Gaps, Innovations, and Requirements

• Cyber Survivability Test and Evaluation -Ryan Mayer, COMOPTEVFOR, Deputy Director, Cybersecurity OT&E
• How to integrate innovative solutions from SMALL Businesses in the early stage of T&E ventures? – Scott Aughenbaugh, Acting Chief of Staff, National Security Innovation Network (NSIN)
• Advantages of early OT&E Integration –CAPT William Selk, Commanding Officer VX-1
• Joint Artificial Intelligence (AI) Red Teaming –Galen Mullins, PhD, Johns Hopkins University Applied Research Lab (JHUAPL)

Data Analytics & Automated Test Reporting

• Applying Scientific Test and Analysis Techniques in the Agile/DevSecOps T&E Environment –William F. Rowell, PhD, retired
• Seminal Analysis Methodology Based on Uncorrelated Data Collection in Either Benign or Contested Environments –Nathan A. Ruprecht & Elisa N. Carrillo, 746 Test Squadron
• Cost-effective Method to Characterize Antenna Performance –James D. Silk & James M. Ralston, Institute for Defense Analyses
• Data Science and Predictive Modeling –Chelsea Owens & Larisa Funk, Booz Allen Hamilton

Agile Methods and DOE

• Use of DOE Tools in a Development Laboratory – Jasveer Ramroo Beni, Master Builders Solutions Construction Chemicals, LLC
• The Challenges of Agile Software Delivery for Military Embedded Software Solutions –Chris Olinde, Andrew Mishoe, Stephens Summerlin & Ken Bailey, Georgia Tech Research Institute
• Looking at Legacy I&V through an Agile Lens –Scott A. Goodman & Doug Moshier, Raytheon Missile & Defense

 International T&E 1

• Electro-Magnetic Spectrum Operations (EMSO) Challenges for Future Test and Evaluation Systems –Loannis Vagias, Cranfield University; Raffaele Fiengo, National Instruments (NI); Anthony McKelvey, Defence Science and Technology Laboratory (DSTL)
• A Software Connected Approach for Facing the Challenges Associated to New EMSO and Digital Transformation in T&E –Raffaele Fiengo, National Instruments (NI) & Massimo Sciotti, Elettronica GmbH (ELT)
• Globally Deployable Maritime Tracking Range Capability for Maritime Training, Mission Rehearsal, Test and Evaluation –Steve Powell, & Rogiero Ramos Qinetiq & Darryl Newborough, Sonardyne

STEM for T&E

• Forge the Future with Computing – Virginia To, Army Research Laboratory /Parsons
• Topic Modeling and Visualization for Test Incident Report Data  – Sage Leone, University of Maryland; Jamie Infantolino, US Army Research Laboratory; Adam Childs & Cleon Anderson, US Army Research Laboratory/Parsons
• Visual Analytic Application Toolset for Large-Scale Data –Aiden Kenny, Columbia University; Mariya Occorso, Arcadia University;Vincent Perry, US Army Research Laboratory
• Immersive Environments for Visual Analytics –James Hughes, UMD College Park; Selena Hamilton, Penn StateUniversity; Virginia To, US Army Research Laboratory /Parsons

Digital Transformation

• T&E: Required Leadership in The Age of Transformation –Paul McNamara, The Sente Group,Inc.
• Accelerating Capability Delivery Through Mission-Focused MBT&E –Joe Murphy & Bill Beuth, AnalyticalGraphics Inc / An Ansys Company
• Mission Engineering, Capability Evaluation & Digital Engineering Informing DoD Technology, Prototyping and Acquisition Decisions –Suzanne Beers, PhD,OUSD(R&E)/DTE&A (The MITRECorporation)

Autonomous Systems

• The Use and Benefits of Modeling and Simulation with Autonomous Testing –John Whitt & Paul Bounker, AberdeenTest Center/Ground Vehicle SystemsCenter
• Evaluating Autonomous System Information Dominance –Cierra Hall, Judith Stoer & DavidScheidt, Weather Gage Technologies
• Path Planning for Multi-Agent Semi-Autonomous Rover in an Integrated System Test Facility Without the Aid of GPS –Lauren Blanks, Allyson Burba, Isaac Isukapati & Brian Neff, U.S. Air Force Academy and National Robotics Engineering Center
• Advancements in Test and Evaluation for Autonomous Systems (ATEAS) –Charlie Middleton & Lenny Truett, PhD, Scientific Test and AnalysisTechniques Center of Excellence (STAT COE)

International T&E 2

• Modernising T&E is Much Easier to Say… – Richard Cawthorne, Defence Science and Technology Laboratory (DSTL)
• The Queensland Flight Test Range (QFTR) –Rob Dunn & Jim Parkes, QinetiQ Australia Pty Ltd
• System of Systems Synthetic Evaluation – Mark Threadgold and Ben Egan, UK Ministry of Defence, Defence Science and Technology Laboratory (DSTL)

Workforce Certification

• Elevating the T&E Profession through CTEP –Pete Christensen, Consultant
• DOD T&E Certification –Paul Shaw, Professor, Cybersecurity, Defense Acquisition University
• Micro-Credentialing for Professional Development –Taz Daughtrey, President, Association for Testing & SoftwareQuality Assurance
• Value of Testing Certifications for Agile & DevSecOps –Andrew Pollner, American Software Testing Qualifications Board

Test Technology

• Delivering Output Based T&E Capability –Andrew Cunningham, QinetiQ
• Making Flight Test Instrumentation Setup Easier –Ben Kupferschmidt, Curtiss-Wrigh
• Testing Mixed-Use Networks – Insights Into a Complex Test Process –Dan Pleasant, Jarrod Tsukada & KellyCaulk, Keysight Technologies, Inc.
• Testing for the Future Fight: Necessary DoD Range Capabilities to Ensure Operational Superiority of U.S. Defense Systems –Heidi Perry, MIT LincolnLaboratories; Hans Miller, MITRE Corporation; Derrick Hinton, SRC