October 3-6, 2016 ~ Hyatt Regency ~ Reston, VA

ONLINE PROCEEDINGS and PRESENTATIONS

---

KEYNOTE ADDRESSES AND SPECIAL GUEST SPEAKERS

• Mr. Rick Baily – Vice President, Boeing Test and Evaluation, The BOEING Company
• C. David Brown, Ph.D., CTEP – Deputy Assistant Secretary of Defense, Developmental Test and Evaluation (DASD)(DT&E)
• Steven Hutchison, Ph.D. – Director, Capability Development Support, Department of Homeland Security (DHS)

• AFOTEC/JSF – Maj. Gen. Matthew H. Molloy, USAF, Commander, Air Force Operational Test & Evaluation Center (AFOTEC)
• BIG DATA – Mr. Dave Jimenez, Executive Technical Director, Deputy Under Secretary of the Army, Test and Evaluation (DUSA – T&E)
• State of the Association: ITEA Annual Meeting – Mr. Gene Hudgins, ITEA President

---

SPECIAL PANELS

Adapting to Commercial Customers and New Missions: The Future of T&E at Space Ranges Panel

Panel Chair: Mr. Peter Nikoloff – Director, Nova Systems

Panelists:

• Mr. Ashton Burke – Team Lead, TRMC
• Mr. Chris Hardcastle – Test Program Manager, Commercial Crew Transportation System, The BOEING Company
• Mr. Lars Hoffman – Senior Director of Government Sales, SpaceX
• Mr. Les Kovacs – Director, Executive Branch Affairs, United Launch Alliance

Developing Leaders for T&E at the Speed of Need Panel

Panel Chair: Mr. Terry Murphy – Acting Deputy Director, Policy and Workforce Development, DHS, Director, DOT&E

Panelists:

• Mr. Michael Greco – Manager, Enterprise Services Test & Evaluation Division, FAAMs.
• Sharon Parrish – Deputy Director, OPS Support Lab, Naval Sea Systems Command
• Mr. Dave Pearson – Director, Engineering and Technology Center, Defense Acquisition University
• Mr. Michael Greco – Manager, Enterprise Services Test & Evaluation Division, FAA

Leveraging Complexity Across V&V Session

• Leveraging Complexity Across V&V – Mr. Marshall Short, VP Lab Test, The BOEING Company
• Test Policy and Organization – Kristen Lambrecht, Ph.D., Technical Advisor, DOT&E Land and Expeditionary Warfare
• United Kingdom Ministry of Defense Perspectives on Leading T&E Change and Modeling & Simulation  – Mr. Ketan Patel, Evaluation Deputy Head, UK Ministry of Defence

T&E Support to Achieving Cyber Resiliency Panel

Panel Chair: Mr. Chip Ferguson – Deputy Executive Agent (EA) for Cyber Test Ranges, DT&E

Panelists:

• CCMD Cybersecurity Assessments and Cybersecurity OT&E – Mr. Dave Aland, Staff Assistant, DOT&E
• Control Systems Testing – Mr. Daryll Haegley, Program Manager, Office of the Assistant Secretary of Defense (Energy, Installation and Environment), Installations Energy (OASD)(EI&E)(IE)
• Cyber and Homeland Security Enterprise Programs – Mr. Alex Hoover, Test Area Manager, Department of Homeland Security, Director Office Test & Evaluation (DHS/DOTE)
• DT&E Cyber Test Planning – Ms. Sarah Standard, Cybersecurity/Interoperability Technical Director, DT&E

T&E Workforce of the Future Panel

Panel Chair: Mr. Ed Greer – President, Greer Consulting, LLC

Panelists:

• MG Daniel Karbler, USA – Commander, US Army Test and Evaluation Command (ATEC)
• Captain Andrew Brown – Royal New Zealand Navy
• Mr. Kelly McBride – Vice President, WBB Consulting
• Ms. Megan Maciejewski – Defense Human Resources Activity, Defense Civilian Personnel Advisory Service, (DHRA, DCPAS) a DoD Field Activity, Under Secretary of Defense (Personnel & Readiness)
• NAVSEA Career Paths

Young Guns and the Old Guard Panel

Panel Chair: Mr. John Bolino – Former SES, DoD

Panelists:

• Mr. Wayne Dumais – Test Area Manager, Immigration and Border Security Programs, DHS
• Mr. George Moraru – Test Engineer, Hypervelocity Wind Tunnel 9, Arnold Engineering Development Center (AEDC)
• Mr. Geoff Wilson – Systems Engineer, TRMC / General Infomatics
• Mr. O’Bryan “OB” Woods – ITEA 2016 Junior Achiever Award Recipient, Marine Corps Operational Test & Evaluation Activity (MCOTEA)

---

TECHNICAL TRACK SESSIONS

Autonomous System and Emerging Technologies for T&E

1st Chair: Mark London, Ph.D., Naval Air Warfare Center Aircraft Division
Track 2nd Chair:

• A Real–Time Analytics Approach to System Testing – Joe–Paul Swinski, NASA/Goddard Space Flight Center
• An LVC–enabled Test Environment for Autonomous Aircraft – Angus “Thom” McLean, Scott Rediger, Jaclyn Hoke, Jon Skarphol, and Josh Bertram, Rockwell Collins
• Applied Text Analytics for Test and Evaluation – James Wisnowski, Adsurgo LLC
• Building an Interoperable Platform – Paola Pringle, NAVAIR Weapons Division
• Bounding Performance of Autonomous Systems with Large Operational Domains in AVIA – Miles Thompson and Mike Heiges, Georgia Tech Research Institute
• Distributed Test and Evaluation of Autonomous Systems: Challenges and Opportunities for LVC Testing – Donald Strausberger
• Enhancing Flight Test Safety with Real–time Early Warning Techniques – Daniel Javorsek, Immanuel Barshi, and David Iverson, AFTCNASA Ames Research Center
• T&E for Complex Autonomy  – John Sustersic, Ph.D., Applied Research Laboratory, Penn State University
• Test and Evaluation of Autonomous Systems  – Darryl Ahner, OSD STAT COE

Best Practices in Test and Evaluation

Track 1st Chair: Erwin Sabile, Booz Allen Hamilton, Inc.
Track 2nd Chair: John Schab, MITRE Corporation

• Applying the Gaps Model of the Service Industry: Four Ways That Prevent Test & Evaluation from Meeting Customer Expectations – Allan Alfafara, Northrop Grumman Aerospace System
• Cultivating the Assertive Skeptic: A Proposal for Modernizing Flight Test Safety to Address Human Agency – Daniel Javorsek, USAF
• Military GPS User Equipment (MGUE) Integrated System Test (IST) 3–3; A Statistical Engineering Case Study – Luis Cortes, David Hazelton, Roberta Calderwood, and Rachel Simone – The MITRE Corporation 
• Needs for Testing Counter Small Unmanned Aircraft System (CSUAS) Systems – Albert Sciarretta, CNS Technologies, Inc.
• Rapid Data Analyzer for Net-Centric Systems Test (RDAN) – Andrew Shaffer, Applied Research Lab / The Penn State University
• TDARPA Robotics Challenge: Ten Years of Lesson Learned Put into Action – Jim Pippine, Jesse Strauss, Johanna Spangenberg–Jones, and Chris Orlowski – DARPA
• The CIPP Organizational Process Model – An Application to Military Test Range Management – Joe Stufflebeam and Daniel Stufflebeam – TRAX International
• Translating End Product Verification Requirements into Enabling Products  – Allan Alfafara, Northrop Grumman Aerospace Systems

Cyber Testing for Test and Evaluation

Track 1st Chair:  Jeffrey McNeil, Ph.D., Clemson University
Track 2nd Chair:  Shawn Smith, Ph.D., Vectrus

• Aircraft Cyber Test and Evaluation  – Joseph Nichols, AFTC NASA Ames Research Center
• Cyber4Sight – Danielle Meah and Onur Ozdikmen, Booz Allen Hamilton
• Cybersecurity Testing on Automotive Systems, Electric Grid and HWIL Facilities – Lu Yu, Ph.D., Clemson University
• Identifying Potential Vulnerabilities Before They’re Created – Hank Steinfeld, NAVAIR – PMA–290, and Paola Pringle, NAVAIR Weapons Division
• How to Characterize the Attack Surface of a Non–IT Platform – Maj George Van Osterom, 46th Test Squadron, Detachment 2
• SAF A6/CIO TF Cyber Secure – Colonel Bill “Data” Bryant, SAF/A6CW
• Sandboxing Wireless/RF Vulnerability Research of Connected Systems – Michael Calabro, Booz Allen Hamilton
• The Merge of Electronic Warfare and Cybersecurity Test – Lt Col Jose Gutierrez, 771st Test Squadron
• The Value of Increased Cybersecurity T&E Rigor – Gerald Blondeaux, Engility Corp.

Model–based System Engineering and Other Methodologies for Enhancing T&E

Track 1st Chair:  Phil Hallenbeck, MITRE Corporation
Track 2nd Chair: Pete Crump, GTRI

• An Approach for Integrating Test & Evaluation into Systems Engineering  – Mark Kiemele, Ph.D., Air Academy Associates
• Design of Experiments (DOE) in Developmental Test and Evaluation (DT&E); Guidelines, Best Practices, and Lessons Learned – Luis Cortes, Suzanne Beers, and Michael Sheehan, The MITRE Corporation
• Digitizing Test Organizations to Reduce Complexity and Cost – Paul McNamara, The Sente Group, Inc
• Leveraging Model Based Engineering for Test Planning – Michael Steele, Wyatt Brigham, Krystal Hicks, and Brian Hodgkinson – Northrop Grumman Aerospace System
• Management, Mechanics, and Math (M3): An Enhanced Methodology for the Future T&E of Complex Information Systems – Stephen Conley, ATEC, and Jennie Lenig–Schreffler, ATEC C4ISRED
• Model Based System Engineering – George Hollenbeck and Javier Villafane, Raytheon
• T&E in the Digital Engineering Era  – Edward Kraft, USAF/AFMC/AFTC
• Test Early with Agile Acceptance Test–Driven Development – Joshua Strain, Raytheon

T&E Systems Engineering Integration and the T&E Tools and Methodologies to Support Testing of Complex Systems

1st Chair: Kevin Knudsen, The BOEING Company
2nd Chair: Mark London, GWU

• A Knowledge and Analytics Based Framework and Model for Forecasting Program Schedule Performance – Kevin Knudsen, Stevens Institute of Technology
• An Enterprise Approach to Evaluation of Complex Systems through Big Data Analytics – Ryan Norman, Training Enabling Architecture (TENA) Software Development Activity (SDA)
• MBSE as a Solution to Information Volatility impacting T&E – Alexander Auguste, Northrop Grumman Corporation, Aerospace Sector
• Common Range Integrated Instrumentation System (CRIIS) Test Range Modernization – Roshelle Orgusaar, USAF AFLCMC/EBYC
• Forecast Overall System Capabilities with Independent Subsystem Performance Test Results – Ya Lun Li, George Washington University
• How to Manage the Complexity of Testing the SoS – Paola Pringle, NAVAIR – PMA–290
• System of Systems (SoS)–Design of Experiments (DoE) Framework – Larry Harris, SPAWAR/PEO–C4I/PMW 120, and Luis Cortes, The MITRE Corporation
• Live, Virtual & Constructive (LVC) for Integrated Test in Contested Environments – Mark Phillips, Gilbert Torres, Thomas Treakle, and Edward Powell – TRMC
• The Cooperative Avionics Test Bed Support to the F–35 Development and Test Program – Cecil Jones, F–35 Program Office (Software IPT)