>In IE 5, whenever I remove the Links item in the list of favorites, the next time I start it up, it again appears in the list.

I think the system needs it there, it is the links shown on the toolbar. Instead of deleteing the folder, just delete all its contents.