Your Fix
If you want to get your speaking skills up to par with how much you understand, you can’t just be in the environment passively listening, but you must actively notice and pay attention to what’s going on around you.
When you’re conscious of what you’re hearing and reading, then you can make real progress.
So the first step is be more conscious of how specific vocabulary is used when you’re listening and speaking and then actually reproducing that language in situations where you’re forced to speak. This can be as extreme as moving to the country of your target language or as relaxed as meeting with a language group once a week via Meetup.com wherever you live.
If your target language is a little more obscure, you might have more luck finding online forums for that specific language. Consider creating a weekly Meetup group on your own via Google Hangouts or in person.