While these are extreme examples that are surprising in the magnitude of the difference,
they show how hard it is to predict the success of new designs.
Both of these are user-interface examples,
but controlled experiments can be used heavily in backend algorithms (e.g., recommendations, search relevance, etc).