PRE-WORKSHOP TUTORIALS

• Advantages of Using Bayesian Analyses in Flight Test – Instructor: Dr. Eileen Bjorkman and Dr. James Brownlow, 412 Test Wing
• Combinatorial Testing Techniques – Instructor: Dr. Mark Kiemele, Air Academy Associates
• Cyber Security and Information Assurance – Instructor: Mr. John Jorgensen
• Fundamentals of Agile T&E – Mr. Pete Christensen, OSD T&E Portfolio Manager and DASD DT&E Technical Advisor, The MITRE Corporation, and Dr. Robin Poston, System Testing Excellence Program, University of Memphis
• Introduction to Cyberspace T&E – Instructor: Mr. Pete Christensen, OSD T&E Portfolio Manager and DASD DT&E Technical Advisor, The MITRE Corporation
• Leading Change through Scientific Test and Design of Experiments (DOE) – Instructors: Mr. Gregory T. Hutto, Wing Operations Analyst, 96 Test Wing, and Dr. James R. Simpson, Group Operations Analyst, 53d Wing
• Leveraging  M&S Tools for Rigorous Test Designs – Instructor: Mr. Joe Murphy, Analytical Graphics Inc. (AGI)
• Testing 1-2-3 – Instructor: Mr. Matthew T. Reynolds, Test and Evaluation Program Management
• Mission-Based T & E Strategy – Instructor: Mr. Christopher M. Wilcox, U.S. Army Evaluation Center
• Successful Distributed Testing and Training – Instructor: Mr. Gene Hudgins, TENA/JMETC
• What T&E’rs Need to Know About SYSTEMS ENGINEERING And PROGRAM MANAGEMENT And Why – Instructors: Dr. Dave Bell, The MITRE Corporation & SMU, and Dr. C. David Brown, Ph.D., Deputy Assistant Secretary of Defense, Developmental Test and Evaluation (DT&E) Director, Test Resource Management Center (TRMC)

TECHNICAL SESSIONS

Overcoming Resource Constraints in T&E – TRACK 1

Chair: Dr. Eileen Bjorkman

• Session A – Adapting T&E methods to meet fiscal realities
  • Using Non-Traditional Reliability Data to Achieve Evaluation Adequacy in Resource-Constrained Test and Evaluation – Karen L. O’Brien and Mr. Robert Tamburello
  • Is Agile right for Hardware? – Gina M. Parodi de Reid
  • Methods for T&E Cost Efficiencies – Dennis Truong
• Session B – Utilizing modeling and simulation to reduce cost in a resource-constrained environment
  • Benefits & Limitations of Utilizing M&S in Support of Blunt Trauma Non-lethal Munitions Evaluations – Sara Campbell
  • Through the Years: How Weight Has Impacted the Army’s Wheeled Vehicle Reliability – Angelo Christino
  • Overcome Test Resource Constraints by Introducing Test Laboratory Accreditation System – Jin Park
• Session C – Utilizing STAT for T&E in a resource-constrained environment
  • What’s the Problem? Selecting the Right Statistical Tool for the Job in a Resource-Constrained Environment – Dr. Eileen A. Bjorkman
  • Fingerprints of a Well-Designed Test: Right-Sizing Experiments in Austere Times – Laura J. Freeman , Gregory R. Hutto, & James R. Simpson
  • Using Uncertainty Reduction as a Measure of Value to Optimize Test Programs – Dr. Eileen Bjorkman

Statistical Methods for T&E – TRACK 2

Chair: Mr. Kedar Phadke

• Session A – The Power of STAT in T&E
  • The Power of STAT (Scientific Test and Analysis Techniques) – Dr. Darryl Ahner
  • Key Aspects of STAT in DoD Test and Evaluation – Michael Harman
  • OSD’s guidance to use Statistical Test Power as a foolproof measure of test rigor is a no brainer, right?– Kedar Phadke
• Session B – Statistical methods for improving T&E outcomes
  • Use of a Common Telemetry Header to Standardize Range Safety and Visualization – Craig Freeman
  • Capitalizing on all Test Data: Statistical Methods for Doing More without More – Laura J. Freeman
  • Leveraging M&S Tools for Rigorous Test Designs – Joe Murphy , Analytical Graphics, Inc. 
• Session C – STAT and other scientific methods for T&E
  • DT&E: From Evaluation Framework to Statistical Integrated Test Design – Dr. Suzanne M. Beers
  • Radar Performance Assessment via Design of Experiments – Luis A. Cortes
  • Answering the Question of Likelihood – Charles Rinke

Tools and Methodologies for Cyber Testing – TRACK 3

Chair: Dr. Ed Cerutti

• Service Virtualization: Expanding the Breadth and Scope of Security Testing – Wayne Ariola and Arthur Hicken
• Improving Cybersecurity Test and Valuation at the Army’s Network Integration Evaluation (NIE) – Donald Wise
• Cyber Testing Tools and Methodologies – C. Jason Chiang, Alex Poylisher, Yitzchak Gottlieb and Constantin Serban
• Lifecycle Cyber Security T&E Methodology: A proposed Cyber Security T&E methodology integrated across the entire system lifecycle to improve cyber performance and reduce testing costs – Carolyn Keith
• Increasing the Reliability and Productivity of Cyber Testing via Experiment Speedup – Constantin Serban & Alexander Poylisher
• Shift Left: Inserting Cyber Security Testing & Evaluation into the Acquisition Lifecycle – MAJ Patrick Major and Kathy Fontaine
• Security Patterns in Systems Acquisition and Test – John Jorgenson
• Cybersecurity T&E Process – Pete Christensen

Innovative Test Tools and Methodologies for Improving T&E – TRACK 4

Chair: Mr. Luis Cortes

• An Approach to Lean Reliability Test and Evaluation Without Increasing Risk – Dr. Carol Vesier
• Storyboarding the National Airspace System (NAS) – Harry Bilicki & Wanda Lopez-Labarbera
• Using System Readiness Levels to Improve Reliability Predictions and T&E Investment Decisions – Mark London (with Timothy Eveleigh, D.Sc., Thomas H. Holzer, D.Sc., Shahryar Sarkani, D.Sc.)
• Performance Testing and Evaluation of Transformative Apps Devices – Anthony Downs
• The Evolution of Complex Cavity Measurement Techniques from Precision Metrology Applications to Aircraft Electromagnetic Environment Assessments – Dennis Lewis
• Closing the Gap of Standardizing RAM Testing for Small Unmanned Robotic Systems – Sandy Sheng and Meghan Dodge

Policy, Process, Procedures and Facilities for Future T&E – TRACK 5

Chair: Mr. Greg Babich

• Creating a Competitive Advantage Through an Uncommon, Yet Proven Approach To Managing the Test Environment – Paul McNamara
• Promoting a New Paradigm of Reliability Test and Evaluation: Lessons Learned & Policy Improvements – Robert Tamburello
• A Practical Guide to Designing Reliability Test and Evaluation Programs: Achieving Efficiency without Causing Deficiency – Robert Tamburello

Efficient Distributed Test Capabilities to Accelerate T&E – TRACK 6

Chair: Dr. Ed Chow

• Preliminary Results of an Adaptive Modulation and Coding Scheme for Airborne Telemetry – Brett T. Walkenhorst
• Mobilization of Test Assets – Ko K. Tha
• PREdictive Smart Synchronization (PRESS) Algorithms; Removing Data Bias from the Virtual Test Range – Farrokh Vatan, Anthony Barrett, Ed Chow, Mark James, Kent Pickett, and Jason Allen
• TimeFlex: Time Alignment for Improved Accuracy in Distributed Testing – C. Jason Chiang & Constantin Serban
• SOA Required Trust-APIs Require Integrity – Wayne Ariola and Arthur Hicken
• Interoperability and Persistent Connectivity: Keys for Successful Distributed Testing and Training – Gene Hudgins

Data Mining and Analysis Techniques for Processing Large T&E Data Sets – TRACK 7

Chair: Mr. Robert “Bob” Weeks

• Rapid Data Analyzer for Net-Centric System Test (RDAN) – Andrew Shaffer
• Analyzing Big Data: Using Lessons Learned to Influence Future Reliability Testing – Angelo Christino
• Cataloging Your Test Equipment Saves Time and Money! Join This Session to Learn from the Pioneers in Data Cataloging – Christopher J. Campbell

Effective Techniques for Recruiting and Training the T&E Workforce – TRACK 8

Chair: Ms. Dana Leaman

• Testing and Measurement Literacy: Knowing What You Need To Know To Improve Acquisition Outcomes – Jim “Smitty” Smith & Dana Leaman
• Developing Test & Evaluation (T&E) workforce for Indian Defense Acquisition Programs – Col. Rajesh Sood
• Predictive Approach for Assessment of Return on Training Investment – Meredith Carroll, Roberto Champney, Xuezhong Wang, Christina K. Padron, David Haddad

Applying Automation to Reduce T&E Costs – TRACK 9

Chair: Mr. Mark London

• Application Delivery, Automating Automation-for more complete test coverage – Scott King
• Applied automated data reduction capabilities: Developing automated data reduction capabilities provide consistent and repeatable data analysis and reduce tester/analyst workloads while increasing results confidence – Angela Roe & Robert Posey
• CA LISA DevOps Service Virtualization & Release Automation – Brad Plack, Sr Solution Strategist
• Using a Novel Evaluation Risk Assessment Process to Prevent the Failure Modes in Reliability Test and Evaluation Programs – Robert Tamburello

Vendor Solutions Sessions

• AESA Test Range Instrumentation Radars – Advantages and Benefits for a Resource Constrained Environment – Mr. Boaz Nathan – Regional Marketing Manager, Europe, ELTA Systems
• Enterprise Cataloging Software Designed for Test Equipment – Christopher Campbell, President and CEO, AssetSmart