Is there a difference between running games in Windowed or Fullscreen?

Does playing game when it's windowed increase performance? Decrease it?

Does the same also hold true to fullscreen mode? I've always thought that playing on Fullscreen meant a higher fps boost, but I never confirmed this.

Is there a difference between the two, and if so, what are they?