At the moment this seems to be working correctly though from my perspective.
I ran through this example on my end on a basic install:
http://localhost/joomla340/
Results in a being added
If I'm on the canonical URL:
http://localhost/joomla336/index.php
Then no canonical element is added in.