>Then we have the oddballs
>
>mouse --> mice
>louse --> lice
>house --> houses
>foot --> feet
>deer --> deer
>moose --> moose

I've long ago proposed some regulation of this matter. Add more rules to allow such plurals for all compatible nouns and then they are all regular (as in "complying to the rules"). Here: Make irregular nouns regular.

Then I felt sorry for the other kinds of words (I somehow never bought the idea these are "parts of speech", because it always implies that someone was making a speech, and it had some parts... which were probably boring at least), so I added more proposals: ...irregular verbs, too... and ...find lost verbs.... and there's one about lost adjectives, but not too many were found.