>Those components are stable enough that I've not really found a need to use a Factory to build them at run time.

The Factory patten doesn't have to do with stability (as I understand it), but with the ability to call a method to create an object of the desired subclass. If you subclass a container, e.g., the superclass would call a factory method to create objects of the appropriate subclass.