When an application runs in fullscreen mode, it runs in "exclusive mode". That means it has full and direct control over the screen output.
But when it runs in window mode, it needs to send its output to the window manager (windows explorer) which then manages where on the screen that output is drawn. This takes some additional performance. The performance penalty, however, is greatly reduced in newer version of windows.