OK, I may sound too happy, but I've just discovered how to have an ampersand in a caption of a commandbutton (didn't try with other stuff with captions yet): add two hotkey prefixes, and they will show as one underlined ampersand.

this.caption="\<\<update"

displays as "&update.