For videoconferencing you don't even need to wear pants ;) Funny you mention that, once time during a VC session someone got up, and wasn't wearing pants.
My normal summer "work" attire is a golf shirt and cargo shorts - I'd never skip the pants.
(I actually won't even go on the VC unless I have shoes/sneakers on....but that's becuase of my barefoot phobia)