In most cases true. However, the past tense can be tricky. For instance,

hoe --> hoed
know --> knew
go --> went
chide --> chided

or strange past participle examples:

strive --> strove --> striven

I really like what Richard Lederer once wrote:



The verbs in English are a fright.
How can we learn to read and write?
Today we speak, but first we spoke;
some faucets leak, but never loke.
If I still do as once I did,
Then do cows moo, as they once mid?
-Richard Lederer