Don't overthink it.
If you do get in the presence of an English speaker, it's so easy to just have your mind freeze up, your body freeze up, You end up stuttering if you can get anything out at all and leave feeling terrible, never wanting to speak English again. Rest assured it's not just you!