The architecture of LBPNet can be divided in to two parts: (i) deep network for feature extraction, and (ii) regular network for classification. Two layers, respectively using LBP and PCA filters,hierarchically connected in the deep network part to extract high-level over-complete representations of the images (Figure 1).