All you have to do is hover your mouse over the taskbar icon and middle-click ... On most computer mice, the scroll wheel in the center doubles as a middle-click button. However, if you have ...
If you only use the mouse wheel for scrolling ... you can middle-click its taskbar icon to open a second window. You can also use the middle-click button to close open windows.