If the 2 sample sizes are different, then the quantiles are usually selected to correspond to the sorted values from the smaller data set. The quantiles for the larger data set are then interpolated. Thus, it is possible that none of the data from the larger data set are used in the Q-Q plot.