October 6-9, 2014 ~ Crystal Gateway Marriott ~ Arlington, VA

ONLINE PROCEEDINGS and PRESENTATIONS

KEYNOTE ADDRESSES AND SPECIAL GUEST SPEAKERS

• Dr. C. David Brown, Deputy Assistant Secretary of Defense, Developmental Test and Evaluation, Office of the Secretary of Defense (OSD)
• Mr. Steve Traver, Chief of Staff for Congressman Steve Pearce, 2nd District of New Mexico
• Dr. Steve Hutchison, Director of Test and Evaluation, Department of Homeland Security (DHS)
• Mr. Peter Nikoloff, Director and Senior Weapon Systems Engineer, NOVA Systems (Australia) 
• Dr. Darryl Ahner, Director, Center for Operational Analysis, AFIT 
• Better Buying Power: A Support Contractor’s View – Van Sullivan, President/CEO, TRIDEUM

SPECIAL PANELS

Academia Involvement in T&E

Moderator:  Dr. Steve Gordon – Orlando Field Office Manager, GTRI

Panelists:

• Dr. Robin Poston – Systems Testing Research Fellow and Associate Director of the System Testing Excellence Program for the FedEx Institute of Technology University of Memphis
• Dr. Ray Hill – Professor, AFIT
• Dr. Dave Pearson – Professor of Engineering Management, DAU
• Mr. Pete Christensen – Director, National Cyber Range, TRMC

The Impact of Government Acquisition Trends on T&E

Moderator: Mr. Kevin Gooder – Integrating Division Chief, SAF/AQR

Panelists:

• Mr. David Gill – Director for Test & Evaluation Systems Evaluation & Test Capabilities, The Boeing Company
• Colonel Mike Meyer – Deputy Director, Engineering and Technical Management/Services Directorate, Air Force Life Cycle Management Center
• Dr. Dai Morris – Head of Capability (Weapons, Evaluation and Capability Assurance), UK MOD
• Mr. Stephen Welby – DASD, Systems Engineering, Office of the Secretary of Defense (OSD)

International T&E Trends: T&E Practices for Uninhabited Systems

Moderator: Dr. Dai Morris – Head of Capability (Weapons, Evaluation and Capability Assurance), UK MOD

Panelists:

• Mr. Adrian Britton – QinetiQ (UK)
• Mr. Paddy Mallon – Thales (UK)
• Mr. Peter Nikoloff – Director & Senior Weapon Systems Engineer, Nova Systems (Australia)

Policy Impacts on T&E Execution and Infrastructure
 
Moderator:  Mr. Bruce Bailey – Deputy Director, T&E Range Oversight, Test Resource Management Center

Panelists:

• Mr. Gerry Christeson – Deputy Director, Test Capabilities Development, TRMC
• Dr. Andy Hesketh – Lab Test Value Stream Senior Leader, Boeing
• Dr. Ed Kraft – Chief Technologist, Arnold Engineering Development Complex

T&E for the Rest of Us
 
Moderator:  Mr. Mark Rider – Executive Director, Acquisition Services and Analysis Directorate, Transportation Security Administration Office of Acquisition, TSA 

Panelists:

• Mr. Bradley Flick – Director for Research and Engineering, NASA, Armstrong Flight Research Center
• Mr. Ken Maddox – Deputy Assistant Director for T&E, DHS Defense Nuclear Detection Office (DNDO)
• Mr. Scott Rooney – Operational Test Branch Manager, TSA
• Ms. Kathy Torrence – Data/Comm Integration Test Director, FAA 

TECHNICAL SESSIONS

TRACK 1 – TEST AND EVALUATION POLICIES AND PRACTICES
Chair:  Mr. Kevin Knudsen

• DT&E Contributions to the Defense Department’s Better Buying Power – Rick Thomas – Office of the Secretary of Defense, Office of the Assistant Deputy Secretary of Defense (DASD), Developmental Test and Evaluation (DT&E)
• Reliability Growth in DOD Acquisition Programs – Matthew Avery – Institute for Defense Analyses
• Research Result of Korean T&E Policy – Kwontae Yoo – Korea Defense Acquisition Program Administration BT&E
• T&E and Synchronization across the Big “A” – Terri Kocher – JRAD, Inc.
• “Touch points” – Where T&E and SE Meet – Dr. Suzanne Beers – The MITRE Corporation
• Unified Capabilities Approved Products List Process and Successes – Wayne Stark and Gordon Bradley – TASC, Inc.

TRACK 2 – T&E TOOLS AND METHODOLOGIES TO SUPPORT TESTING OF COMPLEX SYSTEMS
Chair:  Dr. Cihan Dagli

• An Investigation into Modeling and Simulation (M&S) in Support of UK Ministry of Defence Test and Evaluation – Brian Gillettt, CEng MIET – UK Defence Science and Technology Laboratory (Dstl)
• Capitalizing on all Test Data: Statistical Methods for Doing More Without More – Dr. Laura Freeman – Institute for Defense Analyses
• Effectively applying rule-driven automated data reduction tools/capabilities to support testing of complex systems – Jamie Laposta and Angela Roe
• Requirements Based Analysis – Richard G. Wilson – SM-3 I&V Section Head, Raytheon
• Safe Testing of Autonomy in Complex, Interactive Environments (TACE) – David Scheidt, Robert Lutz, and William D’Amico – Johns Hopkins University Applied Physics Laboratory (JHU/APL)
• System Effectiveness Model for a Modular Power System – Joshua Colver and Ashley Dennie
• Trials and Tribuations in Designing and Building a Test & Evaluation Laboratory – Katherine V. Plummer, Osvaldo Ballestas, and KoKo Tha – Boeing Test & Evaluation

TRACK 3 – TECHNIQUES FOR DETERMINING OPTIMAL TEST REQUIREMENTS
Chair:  Mr. Tim Morey

• AMRDEC Techniques and Methodologies for Predictive Signature and Damage Modeling of Unmanned Aerial Systems – Dustin Clark 
• Developing an Empirical Model to Estimate Tibia Injury – Brian Benesch – U.S. Army Research Laboratory (SURVICE Engineering)  
• Techniques for Determining Optimal Test Requirements Wrap-up – Tim Morey  
• Tools to Optimize Operational Test Analysis – Nick Incontrera and Frank Thomason – Definitive Logic

TRACK 4 – REDUCING RISK IN 2020 TESTING
Chair:  Mr. Gene Hudgins

• Achieving Successful Distributed Testing and Training Through Interoperability and Persistent Connectivity – Mr. Gene Hudgins – TENA/JMETC
• Countering the Testing Crunch – Debbie Hugh – Deloitte Consulting LLP
• Design of Experiments for In-Lab Operational Testing of the AN/BQQ-10 Submarine Sonar System – Dr. Justace Clutter and Dr. George Khoury – Institute for Defense Analyses
• Reducing Risk through Improved T&E Knowledge Management – Ryan Norman – TENA
• Risk Reduction Strategy in T&E S&T – Mr. George Rumford – Program Director, TRMC T&E S&T
• T&E S&T Risk Reduction Examples – Thomas O’Brien and Dr Todd Steiner
• Testing for High Reliability: The 1% UXO limit on Cluster Munitions – Dennis DeRiggi, Dave Sparrow (primary), Stefan Tretiak, and COL Erik Webb – Institute for Defense Analyses

TRACK 5 – BEST PRACTICES AND LESSONS LEARNED IN CONSTRAINED FISCAL ENVIRONMENT
Chairs: Mr. Mark London and Mr. Tom Treakle

• Managing Complex Programs Using Predictive Modeling and Simulation – Kartina Hauser and Laura Meier – Deloitte Consulting LLP
• Surveys in Test & Evaluation: The Good, the Bad & the Ugly – Rebecca A. Grier – Institute for Defense Analyses
• The Chief Developmental Testing and Industry Test Lead—Partnering for Success – Joe Manas – Raytheon
• Automatic Air Collision Avoidance System Testing – Tucker Hamilton, Travis Millet, Michael D. Pacini, and Casey Richardson – 416th Flight Test Squadron

TRACK 6 – TEST AND EVALUATION PRACTICES FOR CYBER SYSTEMS
Chair:  Mr. Pete Christensen

• Automated Assessment of Secure Search Systems – Nicholas Hwang – Massachusetts Institute of Technology Lincoln Laboratory
• The Cybersecurity Developmental Evaluation Framework – Dr. Suzanne Beers – The MITRE Corporation
• DoD Cybersecurity Test & Evaluation: Where We Were, Where We Are & Where We Are Going – Pete Christensen – Director, National Cyber Range, TRMC
• Improving the Cyber Security Through the Implementation of the DoD Risk Management Framework – Gerald Blondeaux – TASC, Inc.
• Testing Airborne Cyber Physical Systems (CPS) in Contested Cyber Environments – Noel Zamot – Director, Air Force Programs (Former Commandant, USAF Test Pilot School), Wyle Aerospace Group

TRACK 7 – DESIGN OF EXPERIMENTS TECHNIQUES
Chair:  Dr. Mark J. Kiemele

• Dealing with Categorical Data Types in Designed Experiments – Dr. Francisco Ortiz – Scientific Test and Analysis Techniques in Test and Evaluation Center of Excellence (STAT COE)
• DOE for In-Lab Operational Testing of the AN/BQQ-10 Submarine Sonar System – Dr. Justace Clutter and Dr. George Khoury – Institute for Defense Analyses
• Design of Experiments (DOE) in New Product Design and Development – Dr. Mark Kiemele – President, Air Academy Associates

TRACK 8 – TESTING DISTRIBUTED TEST FOR CYBER SECURITY
Mr. Marty Arnwine – Deputy Program Manager for Operations, Planning and Support Joint Mission Environment Test Capability (JMETC)

• Creating an Automated Software Testing Center of Excellence – Elfriede Dustin – Innovative Defense Technologies
• CyberSecurity Testing at the 46 Test Squadron – Maj Mike Christenson
• Distributed CyberSecurity Testing at the National Cyber Range – Lori Pridmore
• Distributed Threat Support to Cyber Security Testing- Current Efforts and Future Growth – Skip Tornquist
• Joint Mission Environmental Test Capability: Enabling Distributed CyberSecurity Testing – AJ Pathmanathan – OSD
• Joint Staff J6 DoD Enterprise Cyber Range Environment Command and Control Information Systems (DECRE C2 IS) – Bert Daniel

TRACK 9 – DEMONSTRATIONS OF EFFICIENT TEST TOOLS
Chair:  Dr. Jim Streilein

• Applied Cost Analysis in T&E – Pamela Robinson – Raytheon
• Analytical Modeling: A Technique for Handling Big (and small) Data – Dr Mark Kiemele – President, Air Academy Associates
• Innovations in Test Asset Management Software – Christopher Campbell – AssetSmart
• Integrated Test Reporting – Kim Tatum and Chaithanya Rajanna

TUTORIALS

• A Primer on Scientific Test & Analysis Techniques – Dr. Mark Kiemele, Air Academy Associates
• Advanced Statistical Methods for Test & Evaluation – Ms. Laura Freeman, IDA, and Mr. Bram Lillard
• Fundamentals of Agile T&E- Dr. Robin Poston, System Testing Excellence Program, University of Memphis, and Mr. Pete Christensen, Director, National Cyber Range TRMC
• Fundamentals of Test and Evaluation – Mr. Matthew T. Reynolds, Test and Evaluation Program Management
• Introduction to Cyberspace T&E – Mr. Pete Christensen, Director, National Cyber Range, TRMC
• Keys to Rigorous Test and Evaluation of Complex Systems – Practical Objectives and System Decomposition – Mr. Lenny Truett, Scientific Test and Analysis Techniques Center of Excellence (STAT COE)
• Mathematics for Cyber Security – Dr. John Foulkes
• Measures of DoD Test Adequacy – Statistical Power and More – Dr. James R. Simpson – JK Analytics, LLC, and Mr. Tom Johnson – IDA
• TENA/JMETC: Achieving Successful Distributed Testing and Training Through Interoperability and Persistent Connectivity – Mr. Gene Hudgins, TENA/JMETC