Say what you think to him, I know that all of us need a job, and a lot have family to support, but no one has the right to treat you in that way, as you don't have the right to do it to someone else.
You can loose your job, but he will loose more, it's harder to find a good and loyal employee.
Never let anyone disrespect you, and you always respect others, that's my point of view.
Take care, and don't feel bad, the one that gets angry is the one that looses.
I never forget a face, but in your case I will make an exception :-)