The study was unable to distinguish among the effectiveness of these three approaches. The Tickit guidance does not require companies to use common metrics. Hence, it was not possible to collect any quantitative data which would differentiate these approaches. The study attempted to evaluate qualitatively the effectiveness of these approaches in three different ways. However, the results were inconclusive. In fact, it seems that in most of the companies the emphasis is still on the control of product quality, while the concept of process quality is somewhat misunderstood.
This study affirms that the Tickit guideline does provide a suitable baseline for software quality assurance, but it does not offer specific guidance on how to ensure the improvement of software processes. Once a company reaches the level of Tickit certification (approximately Level 2 of the CMM standard), there seems to be little need for it to improve. For this reason there was limited evidence of systematic process innovation in any of the eight companies. This may explain why it is difficult to distinguish which of the three strategies is the most effective. Therefore, the study points to the need to improve the Tickit guidelines and the ISO standard in three ways. Firstly, the notion of process improvement should become a central feature of both. Secondly, these documents should recommend software metrics in order to encourage companies to measure their achievement. Thirdly, the guidelines should encourage companies to reduce the bureaucracy associated with software quality management. This is particularly true of the documentation, acceptance, and distribution of process innovation.