In Windows 8.1, I have the Windows icon in the bottom left. Next to it, I have an icon for Windows Explorer. If I click on it, that icon remains there and I can see a Windows Explorer in the task bar. So, basically, I can click again on the icon to open another instance.

I have added Internet Explorer in the same section as well. If I click on it, it opens Internet Explorer in the task bar. However, in this case, I am loosing its base icon. It will only appear until I close all instances. Is there a way to keep that icon in there even if some instances are opened?