In this paper, a genetic algorithm based dynamic neu-ral network (GADNN) is proposed to preside over both the performance and the complexity of the neural network for training process. This method provides the opportunity of checking different weights, biases, number of hidden lay-ers, number of nodes and selected inputs during the search process. Therefore, it has the chance to find an effective model with less prediction error and less complexity.