Large scale neural networks, also known as the deep neural net- works(DNNs) or deep learning, have demonstrated a great promise in processing unstructured data. State-of-the-art performance has been reported in many unstructured data processing tasks, ranging from visual object classification, speech recognition, to nature language processing and information retrieval [4]. Nowadays, The DNN has become one of the most popular tools to process big data [5].