In order to address the problem of gender recognition from face images, we design a powerful and complex CNN performing as good as the current state-of-the-art by Jia and Cristianini [11] (96.86%) on the LFW dataset. This CNN is referred as “Starting CNN” below.