Название: Advanced Testing of Systems-of-Systems, Volume 2: Practical Aspects
Автор: Bernard Homes
Издательство: Wiley-ISTE
Год: 2022
Страниц: 306
Язык: английский
Формат: pdf (true), epub (true)
Размер: 11.3 MB

In this second part of the book on systems-of-systems testing, we will focus on more practical aspects such as managing test projects, testing processes and how to improve them continuously. We will see the additional but necessary processes such as the management of requirements, defects and configurations, and we will also see a case study allowing us to ask ourselves several useful questions. We will end with a perilous prediction exercise by listing the challenges that tests will have to face in the years to come.

As a society today, we are so dependent on systems-of-systems that any malfunction has devastating consequences, both human and financial. Their technical design, functional complexity and numerous interfaces justify a significant investment in testing in order to limit anomalies and malfunctions.

Based on more than 40 years of practice, this book goes beyond the simple testing of an application – already extensively covered by other authors – to focus on methodologies, techniques, continuous improvement processes, load estimates, metrics and reporting, which are illustrated by a case study. It also discusses several challenges for the near future.

In DevOps environments, it is recommended to enable automatic creation of environments to test builds as they are created by developers. As proposed by Kim et al., it is necessary to allow to recreate – automatically – the test environments rather than trying to repair them. This automatic creation solution ensures an identical test environment to the previous version, which will facilitate regression testing.

In the context of Agile and Lean methods, any delay in deliveries and any non-compliance with schedules is a “loss of value” and should be eliminated. It is however important to note that the principles of agility propose that it is the development teams that define the scope of the functionalities to be delivered at each iteration.

Automation of processes or tests: Automating is often seen as a synonym for industrializing, and therefore as a magic solution to achieve economies of scale or to limit quality variations between deliveries, as in the industrial world. However, if substantial savings are desired, it is necessary to identify the processes generating unnecessary losses or expenses. These “losses” can be seen according to Lean practices as loss of time (e.g. delays) or loss of material (e.g. corrections, rewriting, etc.). An analysis of the effectiveness of the processes implemented will therefore be necessary. Similarly, test automation can generate improved quality and timeliness in the short term but introduce increased load and longer-term timeline degradation: automatic test case synchronization activities between the various components of the system-of-systems, the activities of maintenance of the automated test cases and the needs for traceability towards the requirements will generate an increasingly important workload.

Pragmatic and clear, this book displays many examples and references that will help you improve the quality of your systemsof-systems efficiently and effectively and lead you to identify the impact of upstream decisions and their consequences.

Advanced Testing of Systems-of-Systems 2 deals with the practical implementation and use of the techniques and methodologies proposed in the first volume.

Contents:
1 Test Project Management
2 Testing Process
3 Continuous Process Improvement
4 Test, QA or IV&V Teams
5 Test Workload Estimation
6 Metrics, KPI and Measurements
7 Requirements Management
8 Defects Management
9 Configuration Management
10 Test Tools and Test Automation
11 Standards and Regulations
12 Case Study
13 Future Testing Challenges
Terminology
References
Index