In this paper, a genetic algorithm based dynamic neural network (GADNN) is proposed to preside over both the performance and the complexity of the neural network for training process. This method provides the opportunity of checking different weights, biases, number of hidden layers, number of nodes and selected inputs during the search process. Therefore, it has the chance to find an effective model with less prediction error and less complexity.