I always insert a new control and then delete the old one.
I always use the properties box to select the component and then click on the Form titlebar and hit Delete.