If there is a time lag, or phase shift as measured in the envelope time domain between the AM-AM and AM-PM responses, or their individual frequency components, IM asymmetry will occur.
Reduction of AM-PM in the PA design would alleviate the IM asymmetry issue.