Multiple excel files show up in windows taskbar

I just got a new computer and I've noticed that when more than one excel file is open, there is a respective number of windows (buttons) open on my Windows task bar. This wasn't the case on my old machine. I'm running the same version of windows and excel as I was before so this leads me to believe that there is a setting somewhere to change this. Any help? It's just annoying, not a 'real' problem.