Quality inspection is a crucial activity in manufacturing by practicing a standard procedure for inspection before product delivery. The improvement of inspection time becomes a focal point of the visual inspection activities due to the handling time of product after inspection which received less attention by the practitioners. In practical, high handling time normally occur by virtue of operators who taking a long time in handling the products, especially unsymmetrical products after inspection; thus lead to delay of subsequent process. In this paper, a proper methodology of solving high handling time problem is proposed by adopting seven new quality tools such as affinity diagram and Process Decision Program Chart (PDPC). The analysis of the tools is to determine the factors that affect the handling time and subsequently develop a solution to minimize the handling time by making improvements on this quality work. A supporting jig is selected as the solution to countermeasure the problem, hence can achieve 34% of improvement in reducing handling time. The supporting jig is proven to be an effective method in minimizing the handling time and implemented to a case study conducted in a semiconductor company.