Image acquisition device works as follows: Uniform light from the light source shines on the collected image, and reflected light or transmission light with color features occurs after the reflection or transmission of image; then, the reflected light or transmission light exposures to the filter through the optical system, and gets R, G, B component through color filter; finally, the light exposures to corresponding Charge Coupled Device to convert into analog signal respectively,and converts to digital signal of RGB, storing and getting the RGB image after signal processing. The ideal color image acquisition equipment should meet Luther condition, that there is a linear transformation among tristimulus values and the values collected. But in practical application, the light source of color image acquisition device, the color filter and Charge Coupled Device are nonlinear. Furthermore,this image acquisition device uses the RGB color space which is equipment related. Therefore, to improve the accuracy of color reproduction, we need to find more accurate corresponding relation between input color information and output color information,and apply the mapping relation to the image under study. Based on the above analysis, color restoration model diagram designed in this paper are as Fig. 1.