Don't rely on the Click(), try using the MouseDown() or MouseUp().
The event tracking will fire in the following sequence
object.MouseDown()
object.MouseUp()
object.Click()

You can track the specific button and shift/ctrl/alt combinations there.