The problem is that VS keeps a file handle to the DB alive for the session and the “add new connection” dialog doesn’t realize the “other program” is actually itself.
I poked around for a few mins and found a “Detach” option in the MDF file context menu: