First probably use REGEDIT and search how the things are.

Then I would suggest using a third-party utility to clean the Registry. Google search "windows registry cleaner" returns several tools.

Once I remember, I searched the registry to clean multiple versions of ATL COM control -- not really a creative job to do :)