RNG means Renormalization Group Theory. It is a mathematical theory which can be used to derive a turbulence model which is similar to the k-epsilon model. When this was first done it was a kind of revolution that a mathematical theory could be used to derive this kind of turbulence model. It was done by Yakhot and Orzag. The exact formulation and constants in the RNG k-epsilon model is not the same as in the old k-epsilon models though. The RNG models have not been that much of a revolution though and they are not that frequently used today. Some people claim that for rotating flows RNG models are superior. I have tested a RNG k-epsilon model a few times and the only application where I noticed better results with it was in rotating cavities, but then it turned out to be more interesting to run transient and even DES/LES simulations.