The ITEA Journal of Test and Evaluation offers a forum for sharing knowledge and ideas crucial to our changing T&E workforce. Authors can submit articles for submission with standard review and editing, or for the more lengthy ITEA peer review or referee processes. Please consider writing an article, share this document with coworkers, and provide feedback on the themes.
Please submit your contributions today to
Thank you in advance for your assistance,
Steve "Flash" Gordon, PhD
ITEA Publications Committee Chair
Articles of General Interest
Articles of general interest to ITEA members and The ITEA Journal readers are always welcome and authoring these articles is a great way to contribute to our industry.
Articles needed by The ITEA Journal include specialty features, each 2-3 pages long:
- Book Reports for T&E or related topics such as systems engineering, scientific principles, and acquisition.
- Cultivating the T&E Workforce addresses the future of T&E by looking for ways to encourage students to pursue and remain in Science, Technology, Engineering; and Mathematics courses and majors, and for innovations in professional education for the T&E workforce.
- Featured Capability describes unique, innovative capabilities; demonstrates how they support T&E.
- Historical Perspectives recall how T&E was performed in the past or a significant test or achievement, often based on personal participation in the “old days” of T&E.
- Peer-Reviewed Articles. ITEA members may submit articles designated by the author(s) to be peer-reviewed. The process usually takes 30 extra days. These peer-reviewed articles will be highlighted in The ITEA Journal; this new opportunity for authors offers more value to their published article.
- Refereed Articles. ITEA members may submit articles designated by the author(s) to be refereed. The process may require several extra months. These refereed articles will be highlighted in The ITEA Journal; this new opportunity for authors offers more value to their published article.
- Scientific Methods in T&E solicits articles on innovations in statistical/mathematical methods for T&E.
- Tech Notes discusses innovative technology that has potential payoff in T&E applications or could have an impact on how T&E is conducted in the future.
The ITEA Journal of Test and Evaluation Themes
T&E of Cyber Security and Readiness (Issue 38-3, September 2017). Key information passed through network connections improves the speed and lethality of combat operations; yet, use of networks opens the door to vulnerabilities. Network connections for home computers, smart phones, social media, and entertainment add enjoyment; yet, ease of use often equates to increased ease of misuse and scamming. Systems that support the military, our finances, our health records, and our other personal information must pass information assurance, information security, net readiness, and cyber readiness tests. Yet, these tests, when passed, do not provide 100% assurance of protection. Systems and the networks that connect them are subject to all sorts of attacks from all sorts of sources; however, the goal of the attack is nearly always to take something valuable. Money, personal information, trust, freedom, military information and plans, or intellectual property are often taken with very minimal effort and cost. How much testing is required to provide an acceptable level of protection to expected attacks? How do we predict future possible attacks?
(Manuscript deadline: June 1, 2017)
T&E for Enhanced Security (Issue 38-4, December 2017). This issue seeks articles about testing for enhanced security in the land, sea, air, space, and cyber domains. The theme includes testing by homeland security and law enforcement of systems to protect water, power, natural gas/petroleum, food, pharmaceuticals, transportation, and communications processing and distribution systems. The United States National Guard, the Department of Homeland Security, and State homeland security components have unique testing needs and experiences, and articles on these topics are encouraged. How do the Federal Aviation Authority and the National Aeronautics and Space Administration collaborate on testing the nation’s airspace? How are robotic vehicles tested? Articles from international partners are also encouraged in these listed areas and in the areas of national defense and homeland security.
(Manuscript deadline: September 1, 2017)
Testing Using Facilities Around the World (Issue 39-1, March 2018). Where in the world are the valuable, unique T&E facilities and other resources that test planners should be aware of? Our T&E infrastructure is regularly evaluated for downsizing, improvement, or changes in ownership. The T&E ranges worldwide have challenges related to fauna, flora, and civilian activities. Obviously, the right footprint of T&E infrastructure depends on the tests in the pipeline and future systems in design. How do we know what and how much is necessary? Can we share government, industry, and academia facilities within and across country boundaries?
(Manuscript deadline: December 1, 2017)
Unmanned and Autonomous Vehicle Testing (Issue 39-2, June 2018). For these systems, we must test and train as we fight. Unmanned and autonomous vehicles fly reconnaissance, target location, and combat sorties. They fly in combat and public airspaces. They travel on the ground, in the air and space, and on and under the water on a variety of missions. Unmanned and autonomous vehicles may be fully controlled by humans, semi-automated, or fully autonomous individually or in dissimilar teams. They have been demonstrated to operate in autonomous swarms. How have we conducted T&E of these systems in the past? Are there best practices or lessons learned? Are there any guidelines for how to test the behaviors in representative operational environments? How can we test these systems in degraded environments in order to determine operational robustness to combat conditions and to cyber degradations?
(Manuscript deadline: March 1, 2018)
Test and Evaluation of Hypersonic Systems (Issue 39-3, September 2018). Two of the hypersonic systems technological challenges are to advance hypersonic technology itself, staying ahead of rivals, and to develop countermeasures for use in combat situations when an adversary employs such technology against our systems. By the very nature of these hypersonic systems, testing and evaluation will have very significant challenges – some yet to be adequately described. These challenges include having the range space, instrumentation, and data capture systems to conduct the testing live or having the trusted simulations to conduct the testing in a live-virtual-constructive environment. Secondly, testing the countermeasures on both sides of engagements may be a challenge. It should be noted that hypersonic speed provides potential improvements in operational flexibility for accomplishing the mission (such as short notice urgent space launch or engaging time-critical targets), diminishing the effectiveness of current detection and countermeasures systems, and potential reductions in operational cost to accomplish the mission. Because of hypersonics, we will need testing improvements in aerothermodynamics, materials science, hypersonic navigation, guidance and control systems, endo-atmospheric and exo-atmospheric flight dynamics, instrumentation including telemetry, and extremely large data flows.
(Manuscript deadline: June 1, 2018)
Advanced Instrumentation and Information Systems Technology for T&E (Issue 39-4, December 2018) Testing requires data and analysis of the data from instrumentation and information systems. In order to improve these systems, science and technology (S&T) advancements are sought in these areas: Time-Space Position Information (TSPI), Advanced Sensors, Advanced Energy and Power Systems, Non-Intrusive Instrumentation, Range Environmental Encroachment, and Human Performance Measurement and Assessment. For this theme, articles related to these S&T areas are requested, and articles describing advancements in real-time data analytics, automated analysis, and automated test reporting are also welcomed. Advanced instrumentation and information systems could cause drowning in data absent advances in data analytics.
(Manuscript deadline: September 1, 2018)
Statistical Methods in T&E (Issue 40-1, March 2019). Mathematical and statistical methods have traditionally been used in testing. Some new approaches in using statistical methods provide a tool to allow testers to estimate how much testing is enough. Too little testing and too much testing waste money. Application of statistical methods coupled with disciplined up-front analyses, may help increase the scientific unpinning of tests. Up-front analyses include following accepted processes to determine outputs, determining how to measure the outputs accurately, identifying what super-set of inputs may affect the outputs, determining the critical few inputs and how to measure the inputs accurately, setting statistical confidence, evaluating the design for statistical power, and making trade-offs. How are designation of standard operating procedures and conducting measurement system analyses related to reducing unnecessary noise and maintaining statistical power? Would upfront analyses also include verification and validation of requirements and verification, validation, and accreditation of modeling and simulation to support the test? What are the consequences of unnecessary noise in the systems that support testing? How can we increase statistical power of tests without increasing testing?
(Manuscript deadline: December 1, 2018)
T&E for Cyber Security and Readiness (Issue 40-2, June 2019). Key information passed through network connections improves the speed and lethality of combat operations; yet, use of networks opens doors to vulnerabilities. Network connections for home computers, smart phones, social media, and entertainment add enjoyment; yet, ease of use often equates to increased ease of misuse and scamming. Systems that support the military, our finances, our health records, and our other personal information must pass information assurance, information security, net readiness, and cyber readiness tests. Yet, these tests, when passed, do not provide 100% assurance of protection. Systems and the networks that connect them are subject to attacks from many sources; however, the goal of the attack is nearly always to take something valuable. Money, personal information, trust, freedom, military information and plans, or intellectual property are often taken with very minimal effort and cost. How much testing is required to provide an acceptable level of enduring protection to expected attacks?
(Manuscript deadline: March 1, 2019)
The Right Mix of T&E Infrastructure (Issue 40-3, September 2019). Our T&E infrastructure is regularly evaluated for downsizing, improvement, or changes in ownership. The right footprint of T&E infrastructure depends on the tests in the pipeline and future systems in design. How do we know what and how much is necessary? Can we share government, industry, and academia facilities within and across country boundaries? Would this type of sharing cause conflict of interest issues? Will overlap of contractor testing, developmental testing, and operational testing reduce the demand on test infrastructure? Can a shift earlier for developmental testing in representative operational environments and for integrated testing reduce the load on test infrastructure?
(Manuscript Deadline: June 1, 2019)
Training the Future T&E Workforce (Issue 40-4, December 2019). Test and evaluation over the next decade will need a workforce of professionals from many academic disciplines. The academic majors will certainly include science, technology, engineering, and math (STEM); yet, management, communications, psychology, and other types of majors also may be needed for the T&E profession. We will need a steady supply of the right academic majors from our technical schools, colleges, and universities, and we will need initial training for the incoming workforce to be ready to become T&E professionals. The need for an inflow of new talent suffers from a constrained supply and competes with many demands for the same disciplines from industry, academia, and other parts of the government. Increasing the throughput of the right new talent would help considerably. And, innovative ways to attract the new workforce, provide recurring training to the existing workforce, and fund career enhancement will help T&E retain the workforce needed.
(Manuscript Deadline: September 1, 2019)
Systems Engineering and T&E Synchronization (Issue 41-1, March 2020). These activities are part of an integrated, solid T&E process. Systems engineering provides the process and tools to build the right, effective products in the best way. Reliability strives to develop a system that is available and suitable for intended use and resilient to disruption. Lifecycle support looks at maintainability and supportability with long-term ownership costs in mind. Testing makes sure these requirements and others are satisfied by the designed and produced system. Blending these initiatives into an integrated T&E program could help us field the right system for the user. Invited papers could include discussions of success stories, lessons learned, drawbacks, benefits, good intentions gone awry, and alternative views.
(Manuscript Deadline: December 1, 2019)
Modeling and Simulation (M&S) Use in T&E (Issue 41-2, June 2020) M&S allows depiction of places and times where the users of the M&S cannot otherwise go. These spaces and times could be in the past, future, or into areas where enemy defenses or other physical barriers prevent the immediate travel. In light of this powerful benefit of M&S, there are at least two situations where M&S gives the most benefit in T&E. The first is the reduction of testing cost. Rather than running flight tests or destroying weapons systems, we simulate the activity in the laboratory to determine if the system satisfies the developmental documentation and performance and the system meets operational effectiveness and suitability. We can then verify performance with much fewer flight tests -- saving money by running fewer high-cost live tests. The second is the ability to use M&S to generate operational edge conditions that we cannot create in the operational environment. We can simulate operational conditions that would be expensive or impossible to create in a physical operational test. Examples could be testing aircraft in lethal environments or after the departure from safe flight or load testing an air traffic control system with more tracks than would be possible in the operational environment to prove performance requirements.
(Manuscript Deadline: March 1, 2020)
Test Range Environmental Encroachment Topics (Issue 41-3, September 2020). Unless properly handled or accommodated, environmental encroachment can cause limits to testing and training, sonar energy employment restrictions, range radar interference, reduced land and sea maneuver space, and increased cost. The science and technology (S&T) research in this area includes advanced marine mammal monitoring, wind turbine mitigation to range radars, endangered species monitoring, monitoring of electromagnetic interference (EMI) from systems like high voltage power lines, and solar power tower effects. Papers related to these topics, to developing alternative ranges, and to range encroachment issues in general are requested. Also, papers that discuss ways to complement range testing with gaming or simulation are welcomed. T&E challenges related to fauna, flora, and civilian activities will continue to impact test ranges, but the limitations can be moderated.
(Manuscript deadline: June 1, 2020)
Success Stories in T&E (Issue 41-4, December 2020). This is a broad theme for articles that describe how T&E has helped to improve systems that would have otherwise been less effective, safe, or supportable. But for the improved testing regimen, under which this system was evaluated, lives would have been lost, costs would have increased, and/or battles would have been lost. This issue will mostly focus on T&E experiences where testing helped influence product changes that made the product better in terms of cost, safety, or effectiveness. Product or system modifications as a result of feedback from tests after the development phase of acquisition may cost more, but the test results later in a program are often essential to building the right product. This issue is also seeking examples of tests where, for some reason, systems were fielded even though they were lacking in effectiveness, suitability, or resiliency. So, we would also welcome “Less than Successful Stories in T&E” in this issue as well. Examples of how things have gone wrong help us understand the importance of making sure things go right.
(Manuscript deadline: September 1, 2020)
Mission Engineering: Interoperability Testing Across Mission Support Levels (Issue 42-1, March 2021).
(Manuscript Deadline: December 1, 2020)
Success Stories in T&E (Issue 42-2, June 2021).
(Manuscript Deadline: March 1, 2021)