Loading Events
  • This event has passed.
2019 LVC and Agile Workshop Pre-Workshop Tutorials

Accelerating T&E Using LVC and Agile

Program Schedule-at-a-Glance

Tuesday, September 17th – Pre-Workshop Tutorials

NOTE: Pre-Workshop Tutorials require a separate fee from the Workshop.
Single Tutorial – $205, Two Tutorials – $385 (use discount code “LVC-Agile-Tutorial” at check out).

8:00 a.m. – 12:00 p.m.       Morning Tutorials

  • Accelerating Cybersecurity Test and Evaluation
  • Integrating Systems Engineering, Agile, DevSecOps, and Test and Evaluation
  • Using Design of Experiments to Accelerate the Knowledge Gain from Test Data
  • Verification and Validation – Accelerating T&E through the Application of Credible Models and Simulations

1:00 p.m. – 5:00 p.m.       Afternoon Tutorials

  • Accelerating Cybersecurity in Acquisition
  • How to Plan Test Strategy for Agile Development in a Government Framework
  • Introduction to Agile Test and Evaluation
  • Using TENA/JMETC to Improve the Test and Training Process


Accelerating Cybersecurity in Acquisition
Instructor: Mr. Pete Christensen, The MITRE Corporation

Now more than ever, Program Managers (PM) and their teams must ensure that cybersecurity is given careful consideration throughout the system acquisition lifecycle from program inception through operations and sustainment. Cybersecurity requirements must be identified up front and early. Test infrastructure and tools must be provisioned to build cybersecurity capabilities into the acquisition from the very first lines of code. Program Teams must exploit every opportunity to integrate functional testing and cybersecurity testing Results of early cybersecurity testing can be used to influence design and development efforts and posture programs for success in Developmental Test (DT), Operational Test (OT) into deployment and operations. There are many opportunities to accelerate Cybersecurity in Acquisition, enabled by new technologies (Cloud), new software development approaches (DEVSECOPS) and robust Cybersecurity Testing venues such as the National Cyber Range Complex (NCRC). The concepts and ideas presented here are relevant across the whole of government. This presentation will provide an overview Cybersecurity in DOD Acquisition and how program Teams might leverage new technology, development approaches and test infrastructure accelerate Cybersecurity in Acquisition.

Accelerating Cybersecurity Test and Evaluation
Instructor: Mr. Alex Hoover, Department of Homeland Security (DHS)

Cybersecurity raises a number of challenges for the test and evaluation professional. As an emerging performance domain, there is a lack of standard institutional processes and methods for specifying and understanding cybersecurity capability, as opposed to a more familiar performance domain such as Reliability, Availability, and Maintainability. This lack of standards extends to the tools (manual and automated) available to handle cybersecurity test and evaluation. This tutorial will provide a point of view for cybersecurity performance assessment and align it with the fundamentals of Design of Experiments to provide a method for handling this domain using classical test and evaluation processes. Some days we hear “testing cyber is just testing.” Other days, it’s “cyber is different from everything else.” Both of these viewpoints are valid within their limited context, and discussion of these topics will be included in this tutorial.

How to Plan Test Strategy for Agile Development in a Government Framework
Instructors: Mr. Hans Miller and Colleen Murphy, The MITRE Corporation

This course provides a framework and guidance for programs transitioning to an agile construct or new programs established with an agile construct. The intended audience includes requirements managers, program managers and test managers executing DoD programs; however, the overall principles could apply to multiple agencies. This course is not a singular solution for agile testing; it acknowledges the different approaches needed for different programs and is intended to provide students with an understanding of concepts that can be tailored to their specific program. This course will walk through characteristics of agile process and where it does and does not apply to help inform expectations. It will cover US code, OSD and service policy as it applies to agile testing and planned policy updates designed to allow greater flexibility. The core of the course covers upfront planning and strategy considerations for successful testing; requirements, contracting, infrastructure investments, automation and test execution. It concludes with how to translate that strategy into concise, timely, and relevant documentation from the TEMP, test plan, and test reporting.

Integrating Systems Engineering, Agile, DevSecOps, and Test and Evaluation
Instructors: Dave Brown, PhD, CTEP, Chesapeake Systems Engineering, and Dave Bell, PhD, CTEP, The MITRE Corporation

Most of the capability of complex systems is now being delivered by software, and in the process, systems engineering and T&E are getting a bad rap. We often hear that systems engineering processes are cumbersome, overly rigid and inflexible, resource excessive, and time consuming. We hear that T&E is overbearing, redundant, and resource intensive. We also hear that systems engineering and T&E are yesterday’s processes, replaced now by Agile, especially for software development, but hardware development as well. However, Agile does not make systems engineering and T&E obsolete. In fact, systems engineering actually provides a top-level structure and process to integrate Agile into large scale developments, especially of hardware/software integrated systems. Also, many elements of systems engineering are part of the processes that every Agile development team uses during each sprint. There are also many practitioners stating that developments incorporating Agile needn’t accomplish any T&E. Again, T&E is very much a part of, and well-integrated into Agile. Therefore, a program’s T&E must be planned by practitioners that understand Agile and Systems Engineering. This tutorial will give T&E practitioners the overview and top-level understanding of Agile and Systems Engineering that they need to plan and oversee effective and efficient T&E for a program using Agile development methodology.

Introduction to Agile Test and Evaluation
Instructor: Ms. Jennifer “Jenny” Rekas, The MITRE Corporation

Agile software engineering process models, such as Scrum, Kanban, or XP, have been popular for several years. Originally, Agile testing practice was focused on individual software projects and how automated test could be accomplished for small teams. As Agile has become a more accepted process model, organizations look to scale it for larger, more complex systems that are not all software-based, as well as identify how to perform test and evaluation in an Agile context using DevSecOps technologies. This tutorial introduces several Agile and DevSecOps process concepts, with a focus on Test and Evaluation. Topics for this lecture-based tutorial include: review of Agile processes at the individual project level and scaled process models for larger systems; examples of Agile testing practices; introduction to DevOps, particularly how test and evaluation fits into that paradigm; and exploration of a case study of how Agile test and evaluation was implemented on a large system of systems effort.

Using Design of Experiments to Accelerate the Knowledge Gain from Test Data
Instructor: Steve “Flash” Gordon, PhD, Georgia Tech Research Insatitute (GTRI)

The use of Design of Experiments (DOE) to evaluate test data can provide more information in less time using fewer resources than previously-used data analysis methods. This tutorial will briefly discuss Design of Experiments methods and processes, demonstrate standard procedures to reduce noise in the experiment or test, conduct a DOE application in class, and assist participants in hitting various targets consistently. Comparison of traditional testing methods and DOE methods will be presented in order to illustrate the time and funding avoided by using DOE and the additional information gained from the DOE analysis.

Using TENA/JMETC to Improve the Test and Training Process
Instructor: Mr. Gene Hudgins, KBR

TENA provides for real-time software system interoperability, as well as interfaces to existing range assets, C4ISR systems, and simulations. TENA has also been selected for use in JMETC events, well-designed for its role in prototyping demonstrations and distributed testing. JMETC is a distributed LVC testing capability developed to support the acquisition community during program development, developmental testing, operational testing, and interoperability certification, and to demonstrate Net-Ready KPP requirements in a customer-specific JME. JMETC uses a hybrid network architecture. The JMETC Secret Network (JSN), based on the SDREN, is the T&E enterprise network solution for secret testing. The JMETC MILS Network (JMN) is the T&E enterprise network solution for all classifications and cyber testing. JMETC provides readily available connectivity to the Services’ distributed test capabilities and simulations, as well as industry test resources. JMETC is also aligned with the JNTC integration solutions to foster test, training, and experimental collaboration. This tutorial will inform the audience as to the current impact of TENA and JMETC on the Test and Training community; and its expected future benefits to the range community and the warfighter.

Verification and Validation – Accelerating T&E through the Application of Credible Models and Simulations
Instructor – Ms. Simone Youngblood, The Johns Hopkins University Applied Physics Laboratory

M&S is a key tool in system acquisition used to: reduce the time to field a system, reduce the resources needed to develop and evaluate that system, inform decision risk; and enhance training. Verification, Validation and Accreditation (VV&A) are processes that focus on ensuring that M&S used in support of T&E provides credible representations of the system under test, its performance space, and its effectiveness. As we seek to accelerate T&E and expand available training systems, we need to evaluate ways that VV&A can assist these acceleration needs. VV&A goals emphasize quality, identifying M&S use risk, formalizing the conceptual model description, and establishing recommended practices for VV&A. V&V topics of particular import for the T&E community include: leveraging test data to develop validation referents, selecting V&V methods that align with available referent data, and ensuring that V&V evidence meets the rigor and requirements of the oversight Test Organizations. This tutorial will address these topics and discuss VV&A methods that will assist in the acceleration of M&S used in T&E and training.

Event Details


17 - 17 Sep 2019


DoubleTree by Hilton Hotel Orlando East-UCF Area




Networking Reception








Location Map


September 17, 2019


DoubleTree by Hilton Hotel Orlando East-UCF Area
12125 High Tech Avenue
Orlando, FL 32817 United States
View Venue Website


ITEA White Sands Chapter



Upcoming Events