>Since Windows 8.1, menus in Internet Explorer appeared when pressing Alt+F. Now, they appear on a permanent basis. Anyone would know what is the switch which controls that?

Just a right click right to the TABs ( in IE10 it works - don't think it has changed

You can toggle to Menu bar on/off