As a result from our survey, most respondents found that challenges in developing listening skill related to the listener, the speaker and physical setting. The fact that mostly are having difficulty in idiom expression and slang and lack of background knowledge in problems related to the listener, difficult to comprehend the speaker’s accent and the speakers speaks too fast in problems related to the speakers, and noise in problems related to physical setting.