General Session – Day 1 Wednesday, December 6

7:00 AM – 5:00PM      Registration Desk Open

8:00AM – 8:30AM      Opening Ceremony
                                         South Walton High School Seahawk Sound
                                         Color Guard Presented by Six Sir Knights

                                          ITEA Chairman, Tim Morey
                                          About ITEA
                                          *ITEA Professional Awards Committee Chair, Stephanie Clewer*
                                          *Announcement of the Allen R. Matthews Award Recipient Charles Garcia*

                                          Symposium Chairman, M. John Rafferty
                                          Program Overview

8:30AM – 8:45AM     Welcome Guest Speaker
                                        W. Anthony Meeks, Col, USSF, Director & Commander, *Munitions Directorate & Eglin Research Site*

8:45AM – 9:30AM      Keynote Speaker
                                        James S. Wells, (SES) Director, Office of Test and Evaluation, Department of Homeland Security

9:30 AM – 10:15AM    Keynote Speaker
                                         George Rumford, (SES) Director, Test Resource Management Center

10:15AM – 10:45AM    Break: Poster Papers and Networking Opportunity with our Exhibitors

10:45AM – 12:00PM   Panel 1 Digital Twin Overview and Industry Definition
                                         Moderator: Erwin Sabile, ITEA Program Chair of the 2022 Annual Symposium

Dr. William Fisher, Principal Systems Security Engineer, MITRE
*Chris Weisser, Principal, Booz Allen Hamilton*
Dr. Bonny Banerjee, Associate Professor, Institute for Intelligent Systems & Electrical and Computer Engineering, University of Memphis
Dr. Jeremy Werner, Chief Science Advisor Chief Scientist, OSD, Director Operational Test & Evaluation
James Sabino, Senior Principal Systems Engineer, Raytheon Technologies

12:00PM      Lunch

1:00PM – 3:00PM       Technical Track Sessions

TRACK 1:  TRMC T&E/S&T Cyberspace Test Technology Overview
Moderator:  Pete Firey, Senior Principal, Systems Engineer, MITRE

1:00 PM Pete Firey, Senior Principal, Systems Engineer, MITRE TRMC T&E/S&T Cyberspace Test Technology Overview
1:30 PM Arch Owen, Program Manager for Weapon Security, Draper Laboratory Vader Modular Fuzzer (VMF) – USG Fuzzing Capability
2:00 PM Bharath Selvaraj, DeciSym, LLC Measure and Share: TRMC T&E/S&T Cyberspace Test Technology’s project to improve Cyber T&E impacts across DoD
2:30 PM Owen Cramp, Research and Development Engineer and Bruce Einfalt, The Applied Research Laboratory, The Pennsylvania State University Automated Attack Framework for Test & Evaluation (AAFT)

TRACK 2: T&E in Support of Agile Development Process
Moderator: Robin Poston, Dean of the Moody School of Graduate and Advanced Studies, Southern Methodist University and Research Fellow with the Systems Testing Excellence Program FedEx Institute of Technology

1:00 PM Patrick J. Quilter, Jr. ALPI/Scientific Test and Analysis Techniques Center of Excellence (STAT COE) DevSecOps Process Assessment Collaboration Tool (DSO-PACT)
1:30 PM Joe Murphy, Sr., Ansys Government Initiatives Leveraging Flexible and Interactive Model Based T&E Tools to Improve Efficiency and Effectiveness of Execution Phase Test Programs
2:00 PM Amnon Pollak, FAA Automation and Agency Support Branch, ANG-E582 A Collaborative Approach to Verify and Validate a Complex Air Traffic Control System
2:30 PM Johnston “Jac” Coil, LinQuist Corporation


Model Based Test Engineering: Incorporating Test Engineering into the Digital Engineering

TRACK 3:   Artificial Intelligence & Machine Learning
Moderator: Teresa Dailey, Technical Advisor, 780th Test Squadron

1:00 PM *Lt Col Dan “Matrix” Riley, PhD, AFOTEC Det 2* Generative AI in the Air Force
1:30 PM Jarrod Cornforth and *Brian Gillett, BSc, CEng MIET, DSTL* Transportable Modelling and Simulation System For Test &Evaluation
2:00 PM Andrew Cunningham, QinetiQ Model-Derived Evidence for Composite Energetic Material Mechanical Properties in Support of Qualification
2:30 PM Lance Fiondella, Associate Professor, University of Massachusetts Dartmouth Predictive Resilience Modeling

TRACK 4: Data Analytics / Modeling & Simulation
Moderator: Shelby Pearce, Jacobs Technology

1:00 PM Tim Grabert, Nova Systems Australia T&E Strategy to Validate the Physics-based Modelling of an Uncrewed Aerial System Applied to a Mission Engineering Thread
1:30 PM Dr. Joshua Walker and Michael Coulter, Georgia Tech Research  Institute An Approach for the Evaluation of Open Systems Architecture Compliant Systems
2:00 PM Dr. Kyle Kolsti, STAT COE Demonstration of Bayesian Analysis using Light Aircraft Performance Testing
2:30 PM Jarrod Cornforth, DSTL and Kamran Memon, Ansys General Autonomous Platform T&E Test Bed Approach


3:00PM – 3:30PM       Break: Poster Papers| Networking with our Exhibitors        

3:30PM – 4:15PM       Amy J. Markowich (SES), Exec Dir, Digital Analytics Infrastructure & Technology, Advancement & Mission Systems Groups, Naval Air Warfare Center Aircraft Division

4:15PM – 5:15PM       Panel 2   Artificial Intelligence and Machine Learning
                                       Moderator: Dr. Karen Haigh, Consultant, Cognitive EW & Embedded AI/ML

Dr. John P Hogan, Chief Engineer, Multimode Sensing and Effects, MORSE Corp
Dr. Kristen Alexander, Chief Learning & AI Officer, Office of Secretary of Defense, Director Operational Test and Evaluation 
Dr. Tim Scully, T&E Fellow, Booz Allen Hamilton
Dr. Laura Freeman, Deputy Director, Virginia Tech National Security Institute (NSI), Hume Center for National Security and Technology
*Col (USAF, Ret) William “Dollar” Young, PhD, President / CEO, Security Concepts and Strategic Design (SCASD), LLC*

5:15 PM                       Networking Reception with Exhibitors and Sponsors


General Session Day 2          Thursday, December 7 

7:00AM – 5:00PM       Registration Desk Open

8:00AM – 8:15AM      Opening Remarks
                                         ITEA Chairman, Tim Morey
                                         *Announcement of the ITEA Board of Directors Award Recipient, Dr. Laura Freeman* 

                                         *Symposium Technical Chair, Casey Fulton,* Program Overview 

8:15AM – 9:00AM      Featured Speaker: *Major General* Michael T. Rawls, Commander, Air Force Operational Test and   Evaluation Center, Kirtland AFB

9:00AM – 9:45AM      Keynote Speaker
                                       Dr. Raymond D. O’Toole, Jr., Principal Deputy Director, Operational T&E
                                         *A Pathway to Next Generation Test Dominance*
With invited guests:    Dr. John Haines, Test & Evaluation Transformation – US Engagement, Ministry of Defense, United Kingdom  
                                        *Brian Gillett, UK Mod Principal Advisor for Test and Evaluation, Defence Science and Technology Laboratory* 

9:45AM – 10:30AM     Featured Speaker: Doreen Bingo, Chief Engineer, Test and Evaluation, Boeing

10:30AM – 11:00AM  Break: Poster Papers | Networking with our Exhibitors

11:00AM – 12:15PM   Panel 3   Engaging the Next Generation T&E Workforce     
                                    Moderator: Terry Murphy, Deputy Director DOT&E, DHS

Dr. Laura Freeman,  Deputy Director, Virginia Tech National Security Institute (NSI), Hume Center for National Security and Technology
Dr. Robin Poston, Associate Provost and Dean of Moody School of Graduate and Advanced Studies, SMU
Dr. Mark Gillenson,  University Research Professor, Department of Management Information Systems, Fogelman College of Business and Economics, Director, Systems Testing Excellence Program (STEP), UM
Gregory Simmons, Office of University Programs, Science & Technology Directorate, U.S. Department of Homeland Security
Dr. Kristen Alexander, Chief Learning & AI Officer,  Director Operational Test & Evaluation, DoD
Natalie Heinrich, Student, Virginia Tech 
Camile Holley, Student, University of Memphis

12:15PM                     ITEA Test and Evaluation Professional Awards Ceremony

12:30 PM                     Award Recipient Luncheon

1:30PM – 2:15PM       Special Session

                                      Digital Engineering / T&E Hack-a-thon Discussion
                                      Mr. Kenneth Senechal, T&E Director in the Office of the Commander, Naval Air Systems Command

2:30PM – 4:30 PM      Technical Track Sessions

TRACK 5: Digital Engineering
Moderator: Pete Crump, Georgia Tech Research Institute (GTRI)

2:30 PM Andrew Cunningham, QinetiQ Ensuring the Continued Relevance of UK T3E Services through Capability Development
3:00 PM Steve Summers and Ben Robinson, NI (formerly National Instruments) Building Confidence in Model Systems
3:30 PM Jeff Tolleson, Director, PeopleTec, Will Harrell, Chief Technologist, Redstone Test Center Redstone Test Center’s Approach to Digital Engineering & LVC M&S In Support of Army Modernization
4:00 PM Vitor Lopes Pereira, M.SC., Digital Twins, Ansys Inc. Benefits/Challenges of Applying Digital Twins and Hybrid Analytics in T&E Programs

TRACK 6: Electronic Warfare
Moderator: Seth Kootsouradis 16th EW Squadron, Eglin AFB                                                          

2:30 PM David Zurn, and Dr. Craig Arndt, GTRI Enabling T&E of Cognitive EW Systems through Hybrid Digital Twins
3:00 PM Jeremy Twaits, NI (formerly National Instruments) How to Test Cognitive EW Systems
3:30 PM Hajin Kim, GaN Corporation Modular EW Test and Evaluation System
4:00 PM Jeremy Twaits, NI (formerly National Instruments) Signal Classification using Deep Learning

TRACK 7: Software & Cyber Testing
Moderator: Antwan Phan, Communications and Global Positioning System (GPS) Navigation Program Office, Naval Information Warfare Center Pacific (NIWC Pacific)

2:30PM Adam Beard, National Cyber Range Complex-Unclassified (NCRC-U) A Realistic Wireless Penetration Test of a VA-Representative Network as Performed by DoD Operators
3:00pm Continuation A Realistic Wireless Penetration Test of a VA-Representative Network as Performed by DoD Operators
3:30 PM *OPEN – Please see another track or visit exhibitors*    
4:00 PM Jacob Slattery, John Lillard, Alex Bustos, Dr. Joshua Walker, Georgia Tech Research Institute Spider Prime: A Software Testbed Framework for the Evaluation of Open Systems Architecture Compliant Systems

TRACK 8: Test Design
Moderator:  Chhem Young-Pen, Naval Information Warfare Center, Pacific (NIWC)

2:30 PM Scott Busby, QinetiQ T&E Sovereign Skills Program
3:00 PM *Maia Gatlin* and Grace Kaylor, Georgia Tech Research Institute Improving Flight Test Data Management for Advanced Defense Operations
3:30 PM Brittany Fischer, STAT COE DevSecOps Process Assessment Collaboration Tool (DSO-PACT): A Novel Method to Integrate Traditional T&E into Agile Development
4:00 PM Dr. Mark Kiemele, Air Academy Associates Test Design Optimization

4:30 PM – 5:00 PM – A Beer Garden Break with Exhibitors and Poster Paper Authors 


General Session – Day 3    Friday, December 8

7:30AM – 12:00PM     Registration Desk Open

8:00AM – 8:15AM      Opening Remarks
                                        ITEA Chairman, Tim Morey
                                        *Announcement of the New ITEA Election Results and Executive Committee*
                                        Symposium Chairman, M. John Rafferty 
                                       *Thank you Emerald Coast Chapter – Scholarship!*

8:15AM – 9:30AM      Panel 4    Digital Engineering in support of T&E
                                    Moderator: Jean Petty, Cyber Resilience T&E Coordinator, Office of T&E, DHS

 Christopher C. Collins, Executive Director, Developmental Test, Evaluation, and Assessments
Office of the Under Secretary of Defense, Research and Engineering (OUSD R&E)
Dr. Amy Henninger, Amy E. Henninger, Ph.D., CEH, CISSP, CMSP, CTFL, Senior Advisor and Branch Chief for Advanced Computing, TCD/OS&E-HSARPA/S&T/DHS
Jeff Tolleson, Director, PeopleTec, Inc.
Andrew Cunningham, QinetiQ

 9:30AM – 11:00AM    Panel 5 Modernizing T&E to Keep Pace with Technology
                                    Dr. Laura Freeman, Virginia Tech
Dr. Jeremy Werner, DOT&E’s Chief Scientist
Lindsay Grissom, Senior Solutions Architect, PeopleTec
Jean Petty, Cyber Resilience Test and Evaluation Coordinator, DHS T&E
Christopher Smith, Director Transportation Security Laboratory, FAA
*Jarrod Cornforth, Defense Science ad Technology Laboratory, DSTL*
11:00AM – 11:45AM   Closing Keynote
                                         Col. Michael Christensen, U.S. Space Force, Director, Test and Evaluation
11:45AM                     Closing Remarks

12:00PM                     Adjournment of the 2023 ITEA Annual International Symposium