Not only that, but English speakers are already used to understanding foreign accents. Most English-speaking countries have a lot of residents who were born in different countries. So native English speakers have a lot of experience with speaking to people with different accents. They may not even think about the fact that your English isn't perfect.