If we think it is wrong to take a family farm away from the family when the farm is worth $2m, or $3m or up to $5m
then why are we forcing more successful families to suffer the loss of the their farm?

To raise tax money that is a rounding error in the federal budget?
It is simply not a significant source of revenue.

So what is the point? Punish the rich?

That is exactly the point. It is greed and envy. The government seems to thinks that everything that everything that we earn belongs to them and that we are lucky if they allow us to keep a portion of it. The so-called 99% accuse the so-called 1% of being greedy. Really, it is the other way around. Many of the 99% seem to think that they are entitled to the fruits of someone else's labor because, in their opinion, that someone else has too much.

It is not just family farms that suffer because of inheritance tax. It is small businesses of all types.